Yup, the official driver is your best option for gaming. No experience with fedora here. I think they use wayland instead of X11 by default, right? I know that wayland had a tough time with Nvidia gpus. No idea if anything has changed in the last two years.

Most problems with newer cards have been fixed with version 550. Gaming related, the only thing that will cause you pain is VR or Kernel Level AC

I heard about some beta version of SteamVR with Support for linux through Steam Link a while ago, but never got it to work under endeavour. ALVR came damn close. It was able to see my Quest 3 and SteamVR was running and detecting the headset + controllers too. Unfortunately never with any display output. I just hope Valve brings out some Headset based on SteamOS.