Google quietly released an app that lets you download and run AI models locally
Google quietly released an app that lets you download and run AI models locally
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally. - google-ai-edge/gallery
Excellent, I will be sure not to use this, like all Google shit.
god i can't wait for the ai bubble to pop
There is already GPT4All.
Convenient graphical interface, any model you like (for Llama fans - of course it's there), fully local, easy to opt in or out of data collection, and no fuss to install - it's just a Linux/Windows/MacOS app.
For Linux folks, it is also available as flatpak for your convenience.
Why would I use this over Ollama?
Ollama can’t run on Android
Is there any useful model you can run on a phone?
Llama.cpp (on which ollama runs on) can. And many chat programs for phones can use it.
Try PocketPal instead
Alibaba also provides an OpenSource App, it even has support for their multimodal voice chat Model qwen2.5 omni: https://github.com/alibaba/MNN
You never heard of ollama or docker model runner?
Android and iOS.
Google hosting their shit on Microsofts servers and telling you to sideload and not using their own software distribution method for their own OS is kind of crazy if you think about it
Is the chat uncensored?
And unmonitored? Don't trust anything from Google anymore.
What makes this better than Ollama?
Quote: "all running locally, without needing an internet connection once the model is loaded. Experiment with different models, chat, ask questions with images, explore prompts, and more!"
So you can download it and set the device to airplane mode, never go online again - they won't be able to monitor anything, even if there's code for that included.
Censoring is model dependent so you can select one of the models without the guardrails.