How To Install PrivateGPT - Chat With PDF, TXT, and CSV Files Privately! (Quick Setup Guide)
How To Install PrivateGPT - Chat With PDF, TXT, and CSV Files Privately! (Quick Setup Guide)
As this technology becomes more accessible you can only imagine the possibilities. I dont have a machine fast enough to make this worth it but i might fuck around with it.
You're viewing a single thread.
Oh this looks really neat. Thanks for posting.
I don't see any kind of hardware requirements? Do you happen to know what is recommended? Lots of ram? GPU beefly CPU??
You'll want a GPU with a lot of VRAM (16GB or more) and system RAM that's about twice as big.
CPU doesn't matter since everything runs on the GPU.
It also works without a GPU (by running on the CPU), but that's very slow. In my opinion you shouldn't bother if you don't have a GPU that's up to the task.
Ok, I can't run it :(
Hmm maybe those intel GPUs might be worth a look.
Intel isn't there yet, the major frameworks only support AMD and Nvidia well enough for stuff like this.