Google quietly released an app that lets you download and run AI models locally
Google quietly released an app that lets you download and run AI models locally
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally. - google-ai-edge/gallery
You're viewing a single thread.
Is the chat uncensored?
And unmonitored? Don't trust anything from Google anymore.
What makes this better than Ollama?
Quote: "all running locally, without needing an internet connection once the model is loaded. Experiment with different models, chat, ask questions with images, explore prompts, and more!"
So you can download it and set the device to airplane mode, never go online again - they won't be able to monitor anything, even if there's code for that included.
never go online again - they won't be able to monitor anything, even if there's code for that included.
Sounds counter-intuitive on a smart phone where you most likely want to be online again at some point in time.
So trust them. If you don't and want to use this, buy a separate device for it, or VM.
Can't? This is not for you.
I won't gonna use my smartphone as a local llm machine.
Okay man.
That is exactly what Ollama does too.
everything is unmonitored if you don't connect to the network.
But not everything works in those conditions.
it does if you make it work in those conditions.
software that "phones home" is easy to fool.
Just firewall the software or is there anything more fancy i would need to do?
typically the phone home is looking for a response to unlock.
use a packet sniffer to see what the request/response is and replicate it with a proxy or response server.
this is also know as a man-in-the-middle (mitm).
takes skill and knowledge to do, but once you do a few dozen it's pretty easy since most software "phone homes" are looking for static non-encrypted responses.
Thanks for the info!
Tell that to my Red Dead Redemption 2 install.
Censoring is model dependent so you can select one of the models without the guardrails.