I'm going to rebuild my proxmox server and would like to have a few opinions.
First thing is I use my server as a NAS and then run VMs off that.
I have 2 x 20tb in ZFS mirror but I'm planning on changing that to 3 x 24tb in ZFS1.
I currently have a ZFS pool in proxmox and then add that pool to Open Media Vault.
Issue is, if my OMV breaks and I'll have to create another VM, I'm pretty sure all that data would become inaccessible to my OMV.
I've heard of people creating a NFS in proxmox and then passing it through to OMV?
Or should I get HMB cards and then just pass it through the VM and then just run it natively within OMV. I'd need to install the ZFS kernal into OMV as well.
I run snapraid and mergerfs, as the nas storage. Not much changes on my NAS and the stuff I really care about like my pictures and videos are on a small ZFS pool. Both are directly on proxmox, meaning I can just plug them in to another Linux machine and research if it all goes sideways.
Its all shared from the host via SMB NFS or for jellyfin and immicher its a moint point for the container
You can bind mount a directory on your pool into an lxc too. I do this with smb and a few other file/data services without issue but never tried omv. If containers work for you it might be the simpler way to go.
I have some notes from doing it but its been a minute, the overview is:
create your users in and out of the container with the correct ids
edit the conf to pass through the dir and map the ids
edit the subuid and subgid
The documentation on this kinda sucks because its not all in one place so if you find the first link you might get lost without the info in the second. I took me a few forum posts to find out about all the id mapping stuff and finally find the right page.
My own approach is to run vm/lxc of SSDs that's are hosted on proxmox directly.
Then I have a truenas with Nas storage. I mount that through SMB to proxmox and pass the different dirs into the vm/lxc that need them.
SSD are much better performance for vm/lxc.
Edit: even running the Nas as a vm i would mount it with SMB, making it easy to spilt them up later if you want. Also I have 10gbit netcards between the nas and proxmox.