I switched my home server from ARM SBCs to a $140 N100 (16GB) and honestly it's a real improvement.
I love the original concept of the SBCs --- affordable and efficient, with hardware acceleration for compute-heavy tasks. But the reality for me lately has just been more trouble than it's worth, and running a mainline kernel on x64 is such a better experience. (I'm mostly griping at the Orange Pi I had --- RPi tend to have better SW support.)
Only complaints are that it will thermal throttle on long workloads (e.g., transcoding or facial recognition on my entire Immich library), and the SSD slots --- it comes with an mSATA drive in the first slot which is 4 lanes (I think?) and supports mSATA and NVME. The second slot is slower (1 lane?) and only supports NVME. So I had to put my nicer NVME SSD in that slot if I wanted to use the included mSATA drive, but consequently the NVME speed is slower than it should be. (I could swap it to the fast slot but then I couldn't use the included mSATA drive.)
$20 more and it probably beats the snot out of the Pi performance wise and probably came in a case and with the power cables to run it...A Pi at $120 is lunacy.