mierdabird @ mierdabird @lemmy.dbzer0.com

Posts

0

Comments

83

Joined

2 yr. ago

Thanks for this, I accidentally locked my wife's tablet when I was testing if Linux would run on it from USB drive. Came back to win 11 and it was bitlocked, with no codes in her Microsoft account and no idea where else to find them. Hopefully I can study this and figure out a way to bypass it

Standalone cosmos installation is now recommended instead of the docker container. It's technically still beta, but I've been running it since February and very happy with it. The dev has indicated updates will focus on the standalone installation going forward.

I have found it's made everything vastly easier for me - the marketplace, integrated reverse proxy and URL manager mean you can literally spin many services up with a single click. Yet it has sub-menus for docker env and compose data that allow you to dig deeper into how the containers work if you're interested in it.

https://cosmos-cloud.io/docs/index/ "Install Cosmos as a standalone service"

In terms of the tinyminimicro's I think i5-6500T 7500T or 8500T (T signifies 35w TDP) could all fit your price point depending on RAM/SSD specs. I haven't done much research on the n100 processors but I think they are broadly comparable to the above i5's

While I get leaning towards AMD products, I've been doing so as well, when I built my first server with a Ryzen 5 2400GE I have found that there just isn't as much resources/support for enabling transcoding with the vega 11 in Jellyfin or Immich. Most Intel iGPU's have a hardware chip specifically tuned for transcoding called quicksync that you should strongly consider.

Especially in the $100-200 price range tiny mini micro's from HP/Lenovo/Dell are widely available and offer lots of capability in a power-efficient (~10-15w idle, 40-50w full load) and easily maintainable form factor. The Lenovo's in particular are interesting due to a few models having full pci-e slots if you decide later you want a GPU.
Lenovo pci-e

Finally for software I would suggest looking into Cosmos Cloud, I use it and have found it made it so much easier to setup and manage all my docker containers and domain name/reverse proxy settings.

Any Intel CPU with quicksync will likely be plenty transcoding capability for his use case with significantly lower power draw

For the record, pre-merger Boeing pulled the same crap with their rudder hardcover crashes in the early 90's. Everything from telling NTSB to blame the wrong piece of equipment to blaming the pilots, even to stealing evidence.

https://imgur.com/a/5wcFx8M

If this is your first time trying to selfhost I highly recommend Cosmos Cloud, I've been using it for 6 months and it's made every step of the way so much easier for me. It manages docker containers and has included reverse proxy and security features, with paid option for personal VPN like tailscale.

Most services work perfectly from a catalog of pre-built docker compose files, but Jellyfin I remember I did have to go to the internal docker IP on the actual host machine to set the server up and working properly to be visible from other machines

Which, of course, was not called ObamaCare, it was called the Affordable Care Act. Conservatives created the nickname so they could just say it's bad because Obama, and their voters would eat it up

Bro 2.0 came so fast I didn't even have time to do 144, like why did they even bother releasing that when 2.0 was coming the very next day lol

Like you ended up doing a PiHole at home? I'm surprised there's no access control. I was on the verge of setting that or Adguard home up for myself but realized using Adguard's public servers is effectively the same thing, just without the extra privacy of hosting at home.

I've run the duckduckgo version of this for years but only recently found out you can get most of this functionality natively in android (android 13 for me) by setting a private DNS as shown in the below image. My duckduckgo app tracking protection does still catch attempts but it's basically just google now, instead of dozens of companies before.

I'm surprised you're getting disappointing results with Qwen 3 Coder 480b. I run Qwen 2.5 coder 14b locally (Open WebUI + Ollama) on my 3060 12gb and I've been pretty pleased with it's answers so far relating to python code, Django documentation/settings, and quirks with my reverse proxy.

I assume you aren't hosting the 480b locally right? Are you using Open WebUI and an Open API key?

I initially installed Ollama/OpenWebUI in my HP G4 Mini but it's got no GPU obviously so with 16GB ram I could run 7b models but only 2 or 3 tokens/sec.
It definitely made me regret not buying a bigger case that could accomodate a GPU, but I ended up installing the same Ollama/OpenWebui pair on my windows desktop with a 3060 12gb and it runs great - 14b models at 15+ tokens/sec.
Even better, I figured out that my reverse proxy on the server is capable of redirecting to other addresses in my network so now I just have a dedicated subdomain URL for my desktop instance. It's OpenWebUI is now just as accessible remotely as my server's.

When on your wifi, try navigating in your browser to your windows computer's address with a colon and the port 11434 at the end. Would look something like this:

http://192.168.xx.xx:11434/

If it works your browser will just load the text: Ollama is running

From there you just need to figure out how you want to interact with it. I personally pair it with OpenWebUI for the web interface

Tesla was the first to make it popular in modern vehicles iirc

Not really sure I understand how these work, do you just feed it a large textual document like a transcript or something, and it turns it into a more machine readable vector format or something?

Or is it just a much smaller LLM that's more optimized for reading than generating?

The update is giving me a performance uplift on my 3060 that's WAY more than 7%, using qwen2.5-coder:14b-instruct-q5_K_M here's rerunning the exact same prompt before and after:

The problem is big businesses like Temu can bulk ship and still only pay a certain %.

But it will ruin small businesses who do only small shipments and will now see a flat fee that may be half or more the value of the good.

So I googled it and if you have a Pi 5 with 8gb or 16gb of ram it is technically possible to run Ollama, but the speeds will be excruciatingly slow. My Nvidia 3060 12gb will run 14b (billion parameter) models typically around 11 tokens per second, this website shows a Pi 5 only runs an 8b model at 2 tokens per second - each query will literally take 5-10 minutes at that rate:
Pi 5 Deepseek
It also shows you can get a reasonable pace out of the 1.5b model but those are whittled down so much I don't believe they're really useful.

There are lots of lighter weight services you can host on a Pi though, I highly recommend an app called Cosmos Cloud, it's really an all-in-one solution to building your own self-hosted services - it has its own reverse proxy like Nginx or Traefik including Let's Encrypt security certificates, URL management, and incoming traffic security features; it has an excellent UI for managing docker containers and a large catalog of prepared docker compose files to spin up services with the click of a button; it has more advanced features you can grow into using like OpenID SSO manager, your own VPN, and disk management/backups.
It's still very important to read the documentation thoroughly and expect occasional troubleshooting will be necessary, but I found it far, far easier to get working than a previous Nginx/Docker/Portainer setup I used.