What's up, selfhosters? - Sunday thread
What's up, selfhosters? - Sunday thread
It's Sunday somewhere already so why wait?
Let us know what you set up lately, what kind of problems you currently think about or are running into, what new device you added to your homelab or what interesting service or article you found.
I'll post my ongoing things later/tomorrow but I didn't want to forget the post again.
A couple of days ago, after testing it myself for a few months to make sure I understood how everything works, I made the switch to NextCloud Calendar, and will no longer use Google Calendar.
This is the best part though... I somehow convinced my wife to do the same. She let me install the NextCloud app(optional for Calendar stuff but makes the setup easier) and DAVx5 on her phone (both from F-Droid, so DAVx5 was free). I exported and imported her calendar, and made sure the notifications were set up to her preferred default.
It's multiple days later, and she hasn't complained!
I've also moved all of my contacts over to NextCloud, but have yet to coerce my spouse to do the same.
Crazy enough, I have everything going that I want to on my server!
- *arr suite and jellyfin
- traefik reverse proxy with crowdsec + bouncer for some sites (e.g. not documents or media)
- paperless-ngx for documents
- immich for photos
- leantime to manage personal projects
- Book stack for a personal wiki
- calibre-web for my library
- syncthing for file and music syncing so I don't have to stream music
- valheim server for me and my friends
- boinc for turning my server to a productive heater in the winter
- home assistant for my in-renovation smart home
As far as my server goes, I have everything I need. Maybe setting up something for sharing files over the web if needed. I used nextcloud for that before it killed itself completely and I realized I never really needed it.
Next is working on my smart home because we had to fully strip the house to renovate. KNX first, zwave for things that KNX doesn't have or are crazy expensive, ESPHome for everything that the other two can't accomplish. Minimal 2.4GHz interference and don't have to rely as much as possible on flaky wireless in a brick house.
If hardware service counts. :) I have been fighting for the last few months with my Promxox server telling me a drive went read only , from a SSD and even a HDD, very odd behavior and it finally pulled the last straw with me last Thursday. I had a 4TB drive acting as my Storage/backup drive which this complained about so I put a 1TB drive in which is pretty much 2 yrs old so plenty of life on it.
I went through and tested the SSD with extended tests and it passed with flying colors, so it dawned on me, maybe it's the SATA data cable, and sure enough, it was. When I had run the
sudo smartctl -x -T permissive /dev/sdbit only presented very little information on it, swapping the cable and it now presents the full SMART data and stats as it should. Additionally, it's been more stable with the performance so far. So I call that a win.In the software side, I have been going through the Home Assistant instance and removing dead/old entities I never had gotten to removing
I lost all my inpsiration after my last install. I've literally just got immich and a raid array. I want to add a few things:
- Public facing website
- Jellyfin
- VPN server
- Individuous
- XMPP
I. Build a PC for video editing because it was becoming impossible to do on the laptop. I realized that I can use the GPU also to run large language models myself.
So this week I've been setting up ollama and Open WebUI to be able to move some of my queries I ask ChatGPT and ask them on my computer, even if I'm away.
This way I don't need to send sensitive data to the USA and China. It works quite well but I only can use smaller models up to 14B because of the 12 GB VRAM my graphics card only has.
I'm trying to figure out setting up TrueNAS scale and docker for the first time. Building a NAS and self hosting a few things from an old all in one mini PC.
Why is it so hard to send large files?
Obviously I can just dump it on my server and people can download it from a browser but how are they gonna send me anything? I'm not gonna put an upload on my site, that's a security nightmare waiting to happen. HTTP uploads have always been wonky, for me, anyway.
Torrents are very finnicky with 2-peer swarms.
instant.io (torrents...) has never worked right.
I can't ask everyone to install a dedicated piece of software just to very occasionally send me large files
I'm currently half way thru building a ZFS array using (5) 8tb Ironwolf Pro drives. I'm modelling and 3d printing a custom drive cage with brackets to hold them all inside the shitty Dell tower case I have dedicated to it. Hoping I can get it done sometime Sunday, I'm on V2 of the drive cage print and it takes like 8 hours to do lol.
Installed grocy on a server and magic mirror on a pi. Now we can track all the daily tasks of life which makes my wife happy
I've gotten a CalDAV server, audiobookshelf, and selfhosted obsidian live sync running on my laptop while I wait for movers to bring my shit to my house. Then gotta migrate it all across to my mini PC afterwards. Doing a modular NixOS setup to replace/complement what I used to have running on proxmox.
Once everything is on a dedicated machine I'm going to make a nice little homepage for it, inspired by a previous thread here.
Working on Smart Playlists for Pinepods I'm the developer of the self-hosted podcast management server and Sunday is always my new feature day. I've had a lot of fun adding in new features lately. Like designing a homepage and adding OIDC login support. Don't let anybody tell you auth isn't fun.
I changed my proxmox server from zfs raid pool to software raid with mdadm. Saved me a ton of ram and cheap ssd's don't really like zfs, so it's a win win. And while messing around with drive setups I also changed the system around a bit. Previously it had only single ssd with LVM and 7x4TB drives with zfs but as I don't really need that much storage it's now running 3x1TB SSD + 4x4TB HDD, both with software raid5 so 2TB of fast(ish, they're still sata drives) storage and 12TB (or 10,6 in the real wold, TB vs TiB) of spinning rust storage.
Well enough for my needs and I finally have enough fast storage for my immich server to maintain all the photos and videos over 20+ years. Took "a while" to copy ~5TB over 1gig lan to other system and back, but it's now done and the copying didn't need babysitting in the first place, so not too big of a deal. Biggest unexpected issue was that my 3,5" hdd hotswap cradles didn't have option to mount 2,5" drives so I had to shut down the server and open the case to mount the drives.
And while doing that my piHole was down, so the whole network didn't have DNS server around. I'd need to either set up another pihole server or just set up some scripts to the router to change DNS offerings to dhcp clients while pihole is down and shorten the lease time to few minutes.
Set up paperless-ngx and cannot get my scanner to send a scan to a FTP server. It supposedly supports sending to FTP but doesn't have much documentation for it. I've tried FTPS, SFTP, and unsecured FTP. Both secure types just cause it to error out. But with unsecured the scanner just freezes then reboots. Really annoying me. I'm about to give up and just scan to s USB thumb drive then copy the scans to the server.
Currently trying to figure out how to create and maintain an internal CA in order to enable pod to pod TLS communication, while using letsencrypt for my public ingresses.
Considering moving my stuff into a VirtualBox VM or two rather than running directly on my PC. Then at some point in the future when I have the hardware for it I can fairly easily move it to proxmox. Also means installing a clean OS on my main PC is a quicker task as it would just be install virtual box, load up the VMs and a lot of stuff would already be done.
Today I'm experimenting with Ansible. Wanna try setting up a Docker hosted RSS reader with it. Hopefully will write up controls for my whole Docker server with Ansible once I'm more familiar.
Recently set up Nextcloud, but ran into trouble getting it to connect with a domain because of Starlink being the ISP. Found out about tailscale and have been getting things connected and accessible with Tailscale’s magic DNS that it uses.
Currently trying to figure out how to use the iOS tailscale app to connect to an exit node, which will be my server at home, but it’s not easy. Apparently it can be done through the shortcuts and automation on the iPhone, but can’t sort out a way to connect easily that doesn’t throw errors with no good documentation to say what I’ve done wrong.
Moved my fediverse apps friendica, lemmy, 35c. (only user is me) to one server since it was overkill having 2 barely using 8% if that if their cpu/ram. Suprisingly easy with yunohost backups, remade users and restored backup if just the apps. Updated enhance panel, switched the sites im making for family to use as a portfolio for local webdev to ols, fairly easy,, was using wordpress templates wrong so I fixed that and redid the home pages, now I feel less confident with wordpress and wonder if ive always made sites wrong, think i just forgot since its been years.
Scripting enlarging 2400 10x10 png files to 512x512 Stable Diffusion generated images that look like high resolution cityscapes in the style of Salvador Dali. I can't get the API to spit out a single image.
Trying to figure out how to get my qBittorrent docker container to route all traffic through my VPS through wireguard. The catch is that the webui needs to be accessible through LAN.
Finally managed to set up tvheadend with rebreoadcasted IPTV from a private group with functioning and automated import into jellyfin.
Works very well (if the IP stream doesnt crash)Edit: Spelling mistake.
Additional info: Took me 3 weekends to figure out how it all works together, finding out that firefox browser neither on desktop nor android can play live tv on jellyfin (even with transcode) and that EPG is a bitch to get right with obscure tv stations.
And webgrabplus has asinine documentation. Meaning: non existant. Go figure it out yourself what each parameter means, lol)still learning truenas. i think I've figured out nextcloud which is basically a nightmare whenever I've had to install it
Working on testing stalwart... And will need to organize and document properly my various nft rules and routing tables, because its slightly getting out of hand...
Recently set up OliveTin on a pi zero w for some automation scripts I wan to be able to trigger from my mobile. I'm loving it.
I'm iterating again on my lab setup and moving a few apps that I expose externally to their own VM so I can lock that sucker down even further. Right now I have a few different servers with podman/docker containers grouped by application type. e.g. critical apps: foregjo, nextcloud, vaultwarden. My arr stack. Media consumption. Knowledge & tracking apps, and general apps.
I eventually intend to throw the external apps into a DMZ VM but my network isn't setup to do that right now, so instead I'm getting them set up on their own host and will lock down the firewall to only allow it to communicate with my reverse proxy and nothing else.
It's been fun reworking my Ansible playbooks to do all my server provisioning (still need to figure out Terraform) along with running app installs and updates automatically at the press a button. Working with firewall rules via Ansible was a bit of a headache at first but now I'm in a really good spot.
I'm also testing out linkwarden and hoarder to finally replace what I lost with Omnivore a while ago.
We finally got our music server set up after a lot of finagling with wireguard. It's really cool; we have slsk-dl set up to batch download our playlists from Soulseek, which we can then play in Jellyfin. Next I'm gonna set up Nextcloud for backing up photos, projects, the whole shebang.
Trying to get headrest working in docker. But backups end up filling my host drives docker volume with cached chunks.
Tried setting and volume mounting the cache dir but it still fills up.
Duplicacy worked though so might just stick with that. Just gotta try restoring files now.
Set up an instance of Supabase for an application I'm building that needs a REST backend. So far, so good, using it's Auth functions for OTP login and they work well.
I've been slowly, but steadily, migrating the services I run on my TrueNAS CORE (FreeBSD) from Jails to Debian VMs so I can migrate to TrueNAS 25 (no more SCALE it seems, and Linux) around April without many hurdles, hopefully.
Besides having to learn some systemd, it has been a smooth ride.
Now I'm down to the last 2 services, which I think are the most complicated setups I have and with no nice deb packages to ease installation: Paperless-ngx and Photoprism.
I'll probably look into playing with Containers (LXC/Incus) to have the same lightweight and efficiency as Jails once the migration to Linux is done. But honestly, if everything is running nicely, I won't be very motivated to do so, let's see.
I've got a project to look forward to. Have my Proxmox server with a UPS, running NUT to watch the battery percentage and power down gracefully if the % gets too low. I have Home Assistant watching that so it's supposed to notify me before that happens. It's not notifying me though, so I gotta look into that. I know it's not working this morning because the power went out, so now I'm just sitting here theorizing instead of actually looking at it. 🙃
My NAS and our desktops are all on WiFi, so I'm planning to run some cable or install moca or something. Our uplink is currently only 100mbit (max for this ISP, I refuse to switch) but our city plans to roll out gigabit everywhere in the next couple years, so I want something forward compatible (powerline will probably be too limiting). SO has been complaining about latency, and I think the WiFi card is to blame, so I'm trying this before upgrading the WiFi card.
Our house has the following:
- phone lines everywhere (could maybe use the existing cables to fish through cat6?)
- cable jacks e everywhere (have an unused satellite dish)
- lots of power plugs
- two floors (rambler + basemen) with pretty much no shared walls (everything will need to jog a bit)
I'm going to try running some cable tomorrow (holiday in the US, just want a test run from bedroom internet source -> basement water heater room), but if that doesn't work, I'll need a backup plan.
Anyone have experience with any of the above? Tips?
I've recently setup an recipe archival project using tandoor, I'm working on converting all my grandparents fading old as dust cooking recipes from their misc handwritten cursive notecards to digital.
Setup was uneventful but it took a little research to figure out how to use a remote postgres server, turns out the app doesn't give an error when it can't connect to the server, it just fails to run
Have to say the actual program itself is absolutely absurd and how they choose their permissions, it breaks all conventional and took quite a bit to get used to.
Anyone know how to set up NPM on truenas scale? I've spent all day trying to get my SSL certs and it fails every damn time. Just says the donation is unknown or that it can't find my npm install 😮💨
I'm using a freedns domain tho so maybe I'm gonna need to try buying a domain.
Managed to set up immich remote machine learning (old 7th gen Optiplex to gaming PC). If only I bought an nvidia card.. I wasn't able to get it my AMD 7800 XT to work with immich ML.. Next up is setting up microservices because immich is crippling my unraid server 🤦🏼😭
I finally set up Joplin server. It is a revelation after too long using Syncthing to sync databases. I wasn't able to use Joplin on Android anymore- the sync to file system had gotten too slow. Now everything syncs pretty much instantly!
I've been trying to learn K8s and more recently the Gateway API. The struggles are that most Helm charts don't know Gateway (most are barely Ingressroute) and I'm trying to find a solution to one service affecting the other gateways.when a service cannot find a pod, the httproute fails and when one route fails, the ingress fails. It's a weird cascading problem.
Right now, I'm considering adding a secondary service to each gateway that resolves to a static error page. I haven't looked into it yet; it cane to me in the brief moment of clarity before I fell asleep last night.
Also, I may be doing everything wrong, but I am learning and learning is fun.
I setup a VPN for my moms Synology so I can request and download media for her through my local qbit instance and using Radarr/Sonarr to move the files over.
I have a problem where both arrs don't auto start when I power up the debian VM in Proxmox even though the daemon is running and restart policy is set to always...
She doesn't make a lot of requests so I just go and start them manually but I would eventually like to get it fixed..
My girlfriends phone was having issues connecting to self hosted servers, so I set her DNS from private to network default. Hope this helps any android users that may have issues.
So I recently sandboxed a webapp I am getting ready to launch.
Basically Unifi switch > Vlan port > Server > Hosting Webapp instances, worker instance, cloudflared and DBs.
Pretty chuffed at the docker config actually. Just configuring my WAF and tunnel settings with Cloudflare to reduce the scanning from VPS providers. Anyone have a solution or will I need to configure some sort of nginx instance to do it as Cloudflare only allows a certain length for each WAF rule for free.
Side thought, does anyone know of a tutorial for CICD to auto build my containers and deploy? I've been reading github and codeberg docs and playing around to no avail. I'm temped to just write a go script to handle it on my server.
I bought a coral tpu and setup frigate. I've been tweaking the alerts and motions. Moving home assistant notifications from reolink to frigate. Was thinking of singing up for frigate+ for additional animal objects. Has anyone signed up for frigate+? Is it worth it?
Had Jellyseer break on me again on Truenas scale, something about a jellyfin API blah blah blah. Decided that Sonarr and Radarr are fine enough to interface with that I don't need it and deleted the image.
Still haven't properly set up my backups ... Have my Nextcloud on a zfs (single disk sadly) and want to send it to a server at my parents place (also zfs) but both are behind NAT. While I've successfully set up wireguard between the two, but the connection won't stay up so there's still a ways to go till I got a happy off-site Backup.
I'm running Nextcloud and PaperlessNXG on my servers. Over the last few months I tested out my remote management. Now that I'm back home, I've been making a few adjustments based on my learnings. Firstly, Wireguard is slower than a turtle, while Tailscale has been a little bit faster. I'm guessing this is due to my upload speed and switching to fiber may fix this.
I'd also like to add TubeArchivist back in since there's some great videos that I don't trust Google to preserve given the direction things are going.
The folks on the "privacy" Lemmy gave me some good tips on app replacements and after making a big spreadsheet with all my apps, their licenses, etc., I cut down my remaining proprietary apps by at least 50% and I only have a few proprietary essentials that still depend on Google Play. I've been meaning to do this for a long time and I almost have a path towards completely removing all Google, Amazon, and Microsoft products from my life.
Next, I'd like to set up Wander to eventually get rid of Garmin/Strava but I haven't been able to figure it out and I'm still locked in to some degree because of my hardware (Garmin watch). The Ring doorbell has to be the next thing to go, but I'm exhausted and haven't had the motivation to start a new project until the dust settles from the last one.
I just setup a local llm with open webui and lm studio using qwen 2.5 coder 7b as the model, gonna test it this week.
Set up pi-hole on my network and I’m realizing it clashes with my VPN on my desktop and private relay on my Apple devices lol. Progress everywhere else though?
This year has been my first foray into self hosting in general. I have been doing a lot of learning and have a long way to go but have got to the point where I have proxmox running with a few VMs running an arr stack, a jellyfin server and a Plex server.
I'm just super happy to get everything running and now need to fine tune stuff. Currently trying to figure out why the Plex server is down half the time externally.
I'm having a lot of fun!
I don’t have a technical issue at the moment.. financial one 🤣
I store my data on an OLD my book Live 3TB HDD. Runs fine but it’s getting full now, and the day it decides to shut down I don’t have any backups.
So I want to buy at least a 2 bays RAID1 array.
I’ll plug it on my server directly, and that would become my NAS.
Maybe two 6TB drives, so I’ll double my existing storage?
I'm still using Docker Rootless, which I want to change for Podman since Rootless is second-class for Docker, but I haven't been able to read the documentation enough to understand Podman Quadlets to migrate my compose files, and there are some incompatible configurations so even if using
podlet, I have to edit some things manually.I also want to migrate to MicroOS if possible in my server, but I'm still testing things in a VM to understand enough and the cost-benefit u.u
Tried to setup custom domains using Nginx Proxy Manager and Let's Encrypt DNS-01 challenges so I wouldn't have to open any ports and it worked!... except not really?
Proxy Manager shows everything was successful but the domains don't go anywhere. It seems to be because the TP-Link router from my ISP does DNS Rebinding protection... with no option to turn it off apparently... why......
So now I don't know where to go. I'm not really fancying hosting DNS myself but if I can't fix this any other way then I guess I'll do it. Or maybe I should ditch the ISP TP-Link and get something I could flash OpenWRT on?