AI search engines give incorrect answers at an alarming 60% rate, study says
AI search engines give incorrect answers at an alarming 60% rate, study says
arstechnica.com
AI search engines cite incorrect news sources at an alarming 60% rate, study says
CJR study shows AI search services misinform users and ignore publisher exclusion requests.
60% about news content, which I think is an important distinction. LLMs are basically lossy compressions of text, meaning their knowledge is frozen to the same time as their dataset. The fact that they are right even 40% of the time is the truly surprising thing.
It’s completely irresponsible for search engines to be using LLMs for news and current events. Science or history facts are probably a lot more reasonable though.