Here is the thing, I have 4 RPi’s of different generations (all the way from Zero W to 4B 4GB) that I use to host services at home for personal use.
Lately, I have realized I am running out of RAM to host more services, not to mention not enough switch ports to connect to.
Now I know the obvious solution is to get a more powerful setup (maybe a thin client) but electricity isn’t cheap and I am not particularly in the best shape financially speaking to shell out $300+ on a decent client to host my services.
Where I live, electricity is also very expensive. I monitor every watt.
I asked the same question half a year ago, here's what I've learnt: RPis tend to be less reliable and aren't that energy efficient. They're great for small appliances, but for servers (e.g. NAS) not as much.
Get an used Thinclient/ mini PC. They cost something between 50-150€ and give you a huge performance boost, more ports, a x86 architecture, are better repairable (still often bad) and more.
Mine uses about 10-15 W on normal use, and 20 rarely when my cloud is under heavy use.
Just curious, why is an x86 architecture a sought after feature in your opinion? My understanding is that ARM is more “bang for your buck” in terms of computation effort to power draw.
I say this because my M2 (ARM based) MacBook does all sorts of heavy lifting and still lasts me more than a day on a single charge compared to my old Intel MacBook running the same services doing the exact same stuff.
Please correct me if I am wrong. I would really appreciate to learn more from people who have more knowledge than I am.
There's a big shift happening right now, you're right on that.
Traditionally, ARM is not as capable in solving complex issues, but more efficient.
That's why it has always been used on smartphones for example. You want a lot of battery and don't need to do highly complex stuff on that, that's what you have your PC for.
The big focus in the last years has always been to top the competitor in terms of performance, and only right now, people begin to question if the computing power they have right now isn't enough and if they rather wouldn't like to have a device that's more efficient.
The tradeoff is, you're more limited to this specific architecture. Apple solved this by making a compatibility layer for x86 apps, but that of course comes with a performance hit.
I'm no expert in that topic tho, so take all I said with a lil grain of salt.
Right now, I think you're better off with x86, because your server will definitely run on some sort of Linux, and we don't have any compatibility layer or something like that yet.
My understanding is that ARM is more “bang for your buck” in terms of computation effort to power draw.
Yes but it's also usually a small "bang".
my M2 (ARM based) MacBook does all sorts of heavy lifting
The new Apple silicon is a quantum leap in technology in many ways. Apple managed to make something with desktop-level power and SBC-level efficiency. It's why they abandoned desktop computers altogether.
The industry is in the process of shifting in that direction but they're still way behind Apple.
I upgraded my Plex and *arr server (i3 nuc) with a beelink 12i N100 based mini pc and could not be happier. $167 with 512gb nvme and 16gb RAM. It pulls 6W peak power
With hardware support enabled it can live transcode four 1080p streams, which my old NUC (5th Gen i3) could also do. The GPU on the NUC could not handle 4k, so it would fall back to using the CPU which would not keep up with a live stream.
The N100 can transcode one 4k HDR with Atmos 7.1 audio and stream in real time. It was just a test, there was a bit of a stutter as it settled in, but I think that might be due to the drive enclosure being connected via USB, so it was storage bandwidth rather than CPU/GPU. The USB ports on the computer are 3.2 gen 2, but the enclosure is only 3.0 at 5Gb/s.
Base os is Ubuntu, Plex Media server is installed via apt from Plex repo, *arr services (lidarr, sonarr, radarr, bazaar, sabnzbd) all run on containers which I manage in a docker compose file. Media storage is an external, 4 bay SATA enclosure attached via USB. 4 six terrabyte disk drives in raid 6 on lvm/md, plus a 4tb SSD which is stand alone storage, formatted as btrfs.
I've heard good things about used/refurb HP (elite desk and pro desk) and Lenovo (m700 and m900) mini-pcs. A quick search shows they're going for ~120-140$ for a quad core with 16 gigs of memory.
That’s what I’ve literally just traded up to from a Pi. Prodesk 600 G3 comes standard with a 6 core i5 8500, has 4 full size ram slots, an m2 ssd slot and has a mount for 3.5” hdd, all drawing only 65w.
There’s a low profile one as well but then you’re stuck with sodimm, no space for a full size hdd and no pci-e slots.
I picked it up second hand for NZD 100 so I imagine it would be even cheaper in the states.
Do prefer the Elite Desk though. The Pro only has one drive bay, so you'd have to use an adaptor to use the slim optical bay for a 2.5" drive. The Elite has 2x 3.5" bays and one 2.5" bay plus an NVMe slot so you can build a decent starter NAS. It's also got 4 DIMM slots for up to 64 GB of memory and if you get a 7th gen Intel with it, it'll have hardware accelerated transcoding.
Get a mini pc. If you can find a cheap intel NUC on ebay for example. Way more power in a compact form that doesn't draw that much more power than a rpi.. much less four of them.
Or even a thinkcentre, I got mine for less than $300 with 36gb ram, 1tb nvme ssd, and es i9
It was even closer to $200, and I had a plan to make a cluster out of these, but one this thing is powerful enough to do like anything, so I dropped the idea
Edit: also, about the power consumption, it's very similar to rpi5 and at the same time can do so much stuff
I had budget to try xeon d soc motherboard for a smal itx case. Put 64gb ecc ram into it but could hold 128gb.
That server will be 8 yo this year. That particular supermicro mb was ment for some oem routerlike 64_86x with 10g ports and remote management.
I'm not sure if intel or amd have any cpus in that segment anymore, but it's very light on wattage if mostly idle/maintaining vms.
One option I'm looking at is to get a dedicated hetzner server, even the auction and lowest grade 'new' offerings are pretty good for the price if you account for energy costs and upfront gear cost.
There's the Orange Pi 5 Plus if you want something really energy efficient. It has 16GB of RAM, an 8 core CPU, dual 2.5G ethernet, and it can use an M.2 2280 SSD. It looks like there's going to be a 32GB version, but it's not available yet.
I‘d just get an old computer. My server runs my whole homelab with 4 spinning disks, 2 ssds while having 10+ services. It takes 50 watts since it is pretty old but it works well. If I turned off the spinning disks it might be even lower.
I bet most of the power is used by spinning disks. My setup (diy desktop) used 22W with 3 SSDs, but after replacing one SSD with 3.5" HDD it went up to 35W
Even raspberry pi 4 doesn't run on 3-4w, it's probably for the older models and zeros
Rpi4 is more like 5-6w, and 8-10w theoretically
RPI5 is 12-15w theoretically
Rpi5's power supply is actually 27w, my thinkcentre's power supply is 60w
Rpi5 has a 2.4ghz 4cores
My thinkcentre has 2.4-5ghz 8cores 16threads
Also, arm is fun, but it's a headache to selfhost a lot of stuff on it
And really, I moved from RPI hosting to x86-64, I didn't know some apps like jellyfin, or elk, or basically anything can open instantly. Even nextcloud is working pretty well
And you can put an ssd inside, or even two, or even do some soldering a put 3 ssds inside
I'm even starting on RAM which you can buy and replace
If you don't already use it, zram swap is great for providing a little bit extra oomph. If your server doesn't have a lot of compressed data in memory, it can literally more than double your effective ram.
I'm not super into the whole sphere here. But as you mentioned the Pi I thought I might chime in. I just ordered a Pi 5, 8GB RAM and 2-3x effective speed of the Pi 4.
I'd youre looking for more powerful hardware in this format the Rockx 5 and Orange Pi 5 are alternatives that go up to 16GB RAM.
I use a quartz64 from pine. Back when it came out it was beefier than the rpi4. With the 5 that has now changed but it still is a great little machine.
My instance runs on it aswell as my other webservices (A Homepage, cgit instance and a small blog). Handles everything really well with the 8GiB of RAM.
Setup is a bit of a pain, especially because I had the urge to run gentoo on it. Compile times are actually acceptable.
It costs 80 bucks, which is really acceptable.
Edit: Forgot to mention energy efficiancy, ARM is unbeaten by x86 in that department. People on here recommend old PCs a lot, which, depending on your local energy prices could quiet quickly void the savings made by buying it.
Also it has a SATA port, which requires some tinkering with the Devicetree to get running but allowed me to use an old 1TB SSD i had in the house.
The Quartz64 is good but to slow to do anything to complicated. You can pickup minipcs for the same price that will have way more performance but will still draw only a few watts.