Which AI model to run locally on android
Which AI model to run locally on android
If you were running a LLM locally on android through llama.cpp for use as a private personal assistant. What model would you use?
Thanks for any recommendations in advance.
You're viewing a single thread.
Running an llm on a phone will absolutely destroy your battery life. It also is imperative that you understand that the comfort of ai is bought with killing of innocents (through expediency of climate catastrophe, exploitation of the planet and the poorest on it).
I think using ai to experiment on a home server which already exists wouldnt be problematic IN A VACUUM but you would still normalize using the tech which is morally corrupt.
Not trying to instigate a fight but if you make this argument, I hope you're also vegan
Oh yeah. So i cant ask for one thing and not do another. Classic bad faith argument. Good try.
I'm not even trying to argue against you, I'm arguing for veganism. The same arguments that you used for why the use of AI is bad can be used for why not being vegan is bad. The production of animal products even has a way bigger impact.
In that case i very much suggest a different approach.
"If that is your take, you will love veganism."
Btw, i dont eat animal products. Pretty recently too.
Veganism is frequently a cult.
It is not. Eating meat is actually a torture and murder industry and people who eat meat are actually eating pieces of corpses.
Even when I still ate meat, I could understand that morally there is no difference to eating humans.
No need to argue here.
Literally any lifestyle can become a cult. The presence of vegan cults is because veganism is more popular than ever so evil people exploit that to form cults. There are fitness cults too, does that mean everyone who works out is a cult member?
I assume you know what "frequently" means. Otherwise, do these lifestyles classify people in categorical terms as vegan/meateaters or morally right and wrong?
I mean, ideally yes, everyone would go vegan, but that's a far bigger lifestyle change than just continuing to not use AI like we've done for decades
I am a fan of LLMs and what they can do, and as such have a server specifically for running AI models. However, I've been reading "Atlas of AI" by Kate Crawford and you're right. So much of the data that they're trained on is inherently harmful or was taken without consent. Even in the more ethical data sets it's probably not great considering the sheer quantity of data needed to make even a simple LLM.
I still like using it for simple code generation (this is just a hobby to me so Vibe coding isn't a problem in my scenario) and corporate tone policing. And I tell people non stop that it's worthless outside of these use cases and maybe as a search engine, but I recommend Wikipedia as a better start almost Everytime.