Revolt tries to be a discord clone/replacement and suffer from some of the same issues. Matrix happens to have a lot of feature in common, but is focused on privacy and security at its core.
Mistral modèles don't have much filter don't worry lmao
They is no chance they are the one training it. It costs hundreds of millions to get a descent model. Seems like they will be using mistral, who have scrapped pretty much 100% of the web to use as training data.
Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.
You are limited by bandwidth not compute with llm, so accelerator won't change the interferance tp/s
Too be fair to Gemini, even though it is worse than Claude and Gpt. The weird answer were caused by bad engineering and not by bad model training. They were forcing the incorporattion off the Google search results even though the base model would most likely have gotten it right.
The training doesn't use csam, 0% chance big tech would use that in their dataset. The models are somewhat able to link concept like red and car, even if it had never seen a red car before.
Google uses their own chip for AI
They know the tech is not good enough, they just dont care and want to maximise profit.
You can take a look at exllama and llama.cpp source code on github if you want to see how it is implemented.
Around 48gb of VRAM if you want to run it in 4bits
To run this model locally at gpt4 writing speed you need at least 2 x 3090 or 2 x 7900xtx. VRAM is the limiting factor in 99% of cases for interference. You could try a smaller model like mistral-instruct or SOLAR with your hardware though.
Those slowndown article were clickbait / bad journalism , youtube hasn't been slowing down the site for adblock user.
I put zorin on my parent's computer 2 years ago, while its a great distro, their windows app support is just marketing, its an out of date wine version with an unmaintained launcher. Worse than tinkering with wine yourself.
It is already here, half of the article thumbnails are already AI generated.
It works pretty well. You can create a good dataset for a fraction of the effort and price it would have required to do it by hand. The quality is similar. You just have to review each prompt so you don't train your model on bad data.
Do you use comfyui ?
You are easier to track with Adnauseum
Windows is not fine with ARM, which can be a turnoff for some.
Llama models tuned for conversation are pretty good at it. ChatGPT also was before getting nerfed a million time.