As an AMD user on Wayland who primarily uses Steam/Proton, I haven't had any Wayland-related issues with gaming at all. This isn't surprising, since the compositor used by Steam Deck (Gamescope) is also Wayland-based.
FYI: If you ever do have compositor-related issues (X11 OR Wayland), you can almost always fix the issue by running the game in a nested Gamescope instance by editing the game's launch command.
Nvidia or not, stick with X11 until you have a reason to use Wayland.
I need Wayland for my packaging work, and one of my devices requires Wayland so I use it for that and it's a decent experience, but Wayland still has drawbacks (weaker automation API, some programs still don't work) so I wouldn't recommend switching off X11 unless you have a reason.
I have the same card and, like others, I haven't had gaming-related issues with Wayland. Can't really speak to a performance difference between Wayland and X11 for the games I play, seems comparable to me.
The only reason I switched to Wayland was because I use 2 displays, one 4K and the other 1440p, and I wanted fractional scaling. X11 can do this with workarounds, but the same scale factor gets applied across all displays. I wanted a different scale factor for each display, and it seemed like there was no way to make this work (in my case at least...it's very possible I was doing something wrong).
But Wayland fixed the issue for me so ¯_(ツ)_/¯ I would've kept using X11 if not for that special case
I hope 545 brings GAMMA_LUT support, night light is basically the only thing keeping me away from Wayland at the moment on my desktop. I absolutely love Wayland with my laptop
It works fine (runs with minor graphical gliches) for me but i have heard that its a complete mess for others. I'd recommend checking how well your particular system works.
If it works well then it might be a good idea to switch since wayland does have some pros comared to X11.
I would personally stick with X11 for now. Last time I tried Wayland it worked but all sorts of just strange issues started popping up everywhere. Nothing big but annoying and frustrating to fix. This was using KDE Plasma.
With recent drivers and recent enough DEs it is usable to a certain extent. There are some known issues documented in the release notes of each version. Here's for 535. TL; DR the major blockers are: (1) Variable Refresh Rate doesn't work for some cards; (2) GAMMA_LUT is not implemented (no night light) and (3) Nested X11 clients have synchronisation issues that might result in some flickering or dupicate frames, it's more noticeable on things that refresh slowly, although much better recently. Also (4) NvFBC capture doesn't work with nested X11 clients which might or might not be important for some people.
I'm using it with Plasma; it's OK, no major concerns but my setup is pretty basic.