The website does a bad job explaining what its current state actually is. Here's the GitHub repo's explanation:
Memory Cache is a project that allows you to save a webpage while you're browsing in Firefox as a PDF, and save it to a synchronized folder that can be used in conjunction with privateGPT to augment a local language model.
So it's just a way to get data from browser into privateGPT, which is:
PrivateGPT is a production-ready AI project that allows you to ask questions about your documents using the power of Large Language Models (LLMs), even in scenarios without an Internet connection. The project provides an API offering all the primitives required to build private, context-aware AI applications.
So basically something you can ask questions like "how much butter is needed for that recipe I saw last week?" and "what are the big trends across the news sites I've looked at recently?". But eventually it'll automatically summarize and data mine everything you look at to help you learn/explore.
I don't think this name is very fitting, because that was my first thought as well. Something like "Firefox local assistant" would probably be a bit clearer.
This thing sounds mostly like a way to explore the possibilities with AI. Which I'm all for.
It sounds like it will learn from what you do in your browser, and as we are humans and therefore have alot of habits, then we might find this tool useful!
but it is not a feature i want. not now, not ever. An inbuilt bullshit generator, now with less training and more bullshit is not something I ever asked for.
Training one of these ais requires huge datacenters, insanely huge datasets and millions of dollars in resources. And I'm supposed to believe one will be effectively trained by the pittance of data generated by browsing?
Dunno, this seems like an interesting idea. What if I've read through a bunch of engineering papers, maybe I could use this as a sort of flashcard to double check my understanding.
We're not breaking ground on AI innovation (in fact, we're using an old, "deprecated" file format from a whole six months ago)
The ggml format isn't "deprecated" it's completely dead. In those 6 months we've also seen 2-4x speedups on some systems, not to mention improved accuracy via kquants. I don't know why they would build out a new extension with such an ancient dependency.