What AI services are you selfhosting? Or, have tested and passed on
What AI services are you selfhosting? Or, have tested and passed on
Part of Living Cartoon Company
Wondering about services to test on either a 16gb ram "AI Capable" arm64 board or on a laptop with modern rtx. Only looking for open source options, but curious to hear what people say. Cheers!
You're viewing a single thread.
I messed around with home assistant and the ollama integration. I have passed on it and just use the default one with voice commands I set up. I couldn't really get ollama to do or say anything useful. Like I asked it what's a good time to run on a treadmill for beginners and it told me it's not a doctor.
Like I asked it what's a good time to run on a treadmill for beginners and it told me it's not a doctor.
Kirkland brand meseeks energy.
Hey now Kirkland brand is respectable, usually premium brands repackaged. Such as how Costco vodka was secretly ("secretly") Grey Goose
There are some experimental models made specifically for use with Home Assistant, for example home-llm.
Even though they are tiny 1-3B I've found them to work much better than even 14B general purpose models. Obviously they suck for general purpose questions just by their size alone.
That being said they're still LLMs. I like to keep the "prefer handling commands locally" option turned on and only use the LLM as a fallback.