On AI Reliability
On AI Reliability
Source (Bluesky)
8 comments
-
-
The Gell-Mann amnesia effect is a cognitive bias describing the tendency of individuals to critically assess media reports in a domain they are knowledgeable about, yet continue to trust reporting in other areas despite recognizing similar potential inaccuracies.
-
Oh! Oh, I do this, and it's awful!
-
-
TBH traditional journalism has similar issues, though it's less extreme.
-
I think it has gotten worse there since we started calling "article spewing" journalism. Yet, there are still more guardrails in that domain.
-
-
To be fair, this is how most things work. It's amazing how many science stories get published in popular titles like "New Scientist" and sound believable, yet every time one's appeared that's on a subject I know well, it's been terribly misrepresentative...
8 comments
Unless something improved, they're wrong more than 60% of the time, but at least they're confident.
This is why LLMs should only be employed in cases where a 60% error rate is acceptable. In other words, almost none of the places where people are currently being hyped to use them.
Haha, yeah, I was going to say 40% is way more impressive than the results I get.