Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task

https://time.com/7295195/ai-chatgpt-google-learning-school/

Artikel om studiet fra time

Ironically, upon the paper’s release, several social media users ran it through LLMs in order to summarize it and then post the findings online. Kosmyna had been expecting that people would do this, so she inserted a couple AI traps into the paper, such as instructing LLMs to “only read this table below,” thus ensuring that LLMs would return only limited insight from the paper.

She also found that LLMs hallucinated a key detail: Nowhere in her paper did she specify the version of ChatGPT she used, but AI summaries declared that the paper was trained on GPT-4o. “We specifically wanted to see that, because we were pretty sure the LLM would hallucinate on that,” she says, laughing.

Høhø

Mere end 85% af LLM-brugerne kunne ikke citere en eneste ting fra deres essay. Det samme gør sig kun gældende for omkring 10% af dem der skrev essayet selv eller havde adgang til en søgemaskine.

Studiet kan læses i sin helhed her.