Researchers show that training on “junk data” can lead to LLM “brain rot”
Researchers show that training on “junk data” can lead to LLM “brain rot”
arstechnica.com
Researchers show that training on “junk data” can lead to LLM “brain rot”
9 comments
-
-
Using a complex GPT-4o prompt, they sought to pull out tweets that focused on "superficial topics"
Wait a moment... They asked an LLM, to tell them what was "junk", and another LLM, trained on what an LLM marked as junk, turned out to be a junk LLM?
It talks about model collapse, but this smells like research collapse.
-
I say continue! It will be fun to have a brain rotted ai that can only quote memes
-
This explains the AWS collapse even better.
-
-
no, training LLM on other LLM, on unverified facts, or sources leads to brain rot.
-
same, same, but different, but still the same
-
-
AI brain rots humans, itself, the internet.... Just great
-
Is junk data just YouTube content because of so, then it's already poisoned my kids and their friends.
Whatever 67 means.
-
9 comments
Just like humans.