science @lemmy.world cum_hoc @lemmy.world 2mo ago

Scientists Use AI to Prove People Can Be Talked Out of Conspiracy Theories

From the article:

This chatbot experiment reveals that, contrary to popular belief, many conspiracy thinkers aren't 'too far gone' to reconsider their convictions and change their minds.

22 comments

Another way of looking at it: "AI successfully used to manipulate people's opinions on certain topics." If it can persuade them to stop believing conspiracy theories, AI can also be used to make people believe conspiracy theories.
- Anything can be used to make people believe them. That's not new or a challenge.
  
  I'm genuinely surprised that removing such beliefs is feasible at all though.
  
  If they're gullible enough to be suckered into it, they can similarly be suckered out of it - but clearly the effect would not be permanent.
  
  the person needs to have a connection to the conspiracy theorist that is stronger than the identity valence gained by adopting these conspiracies
  
  The person needs to speak emotionally and sincerely, using direct experience (cookie cutter rarely works here)
  
  The person needs to genuinely desire for the improvement of the other's life
  
  That is the only way I have ever witnessed it personally work, and it still took weeks.
The researchers think a deep understanding of a given theory is vital to tackling errant beliefs. "Canned" debunking attempts, they argue, are too broad to address "the specific evidence accepted by the believer," which means they often fail. Because large language models like GPT-4 Turbo can quickly reference web-based material related to a particular belief or piece of "evidence," they mimic an expert in that specific belief; in short, they become a more effective conversation partner and debunker than can be found at your Thanksgiving dinner table or heated Discord chat with friends.

This is great news. The emotional labor needed to talk these people down is emotionally and mentally damaging. Offloading it to software is a great use of the technology that has real value.
More like LLMs are just another type of propaganda. The only thing that can effectively retool conspiracy thinkers is a better education with a focus on developing critical thinking skills.
Let me guess, the good news is that conspiracism can be cured but the bad news is that LLMs are able to shape human beliefs. I'll go read now and edit if I was pleasantly incorrect.

Edit: They didn't test the model's ability to inculcate new conspiracies, obviously that'd be a fun day at the office for the ethics review board. But I bet with a malign LLM it's very possible.
- A piece of paper dropped on the ground can 'shape human beliefs'. That's literally a tool used in warfare.
  
  The news here is that conspiratorial thinking can be relieved at all.
  
  "AI is just a tool; is a bit naïve. The power of this tool and the scope makes this tool a devastating potential. It's a good idea to be concerned and talk about it.
- LLMs are able to shape human beliefs.
  
  FUCKING THANK YOU!
  
  I have been trying to get people to understand that the danger of AI isn't some deviantart pngtuber not getting royalties for their Darkererer Sanic OC, but the fact that AI can appear like any other person on the internet, can engage from multiple accounts, and has access to their near entire web history and can make 20 believable scenarios absolutely catered to every weakness in that person's psychology.
  
  I'm glad your post is getting at least some traffic, but even then it's not gonna be enough.
  
  The people that understand the danger have no power to stop it, the people with the power to stop it are profiting off of it and won't stop unless pressured.
  
  And we can't pressure them if we are arguing art rights and shitposting constantly.
  
  We need to make it simpler and connect the dots. Like, what's the worst that could happen when billionaires have exclusive control over a for-profit infinite gaslighting machine? This needs to be spelled out.
All of this can be mitigated much more by ensuring each citizen has a decent education by modern standards. Turns out most of our problems can be fixed by helping each other.
At first glance the major takeaway here might be that AI can do gish-gallop but with the truth instead of lies.

And it doesn't get exhausted with somebody's bad faith bullshit.
"Great! Billy doesn't believe 9/11 was an inside job, but now the AI made him believe Bush was actually president in 1942 and that Obama was never president."

In all seriousness I think an "unbiased" AI might be one of the few ways to reach people about this stuff because any Joe schmoe is just viewed as "believing what they want you to believe!" when they try to confront any conspiracy.
- With the inherent biases present in any LLM training model, the issue of hallucinations that you've brought up, alongside the cost of running an LLM at scale being prohibitive to anyone besides private-state partnerships, do you think that will allay conspiracists' valid concerns about the centralization of information access, a la the reduction in quality google search results over the past decade and a half?
  
  I think those people might not, but I was once a "conspiracy nut," had a circle of friends who were as well, and know that for a lot of those kinds of people YouTube is the majority of the "research" they do. For those people I think this could work as long as it's not hallucinating and can point to proper sources.
Is it a theory when we have proof? I mean it's only sort of an obvious to say that Psychiatry is no different from MKULTRA. It might be such to say that such IS such but what's the fucking difference?

Oh yeah. Psychiatry is private. MKULTRA is a weapon. Not that much of a difference either. They're both targeting wallets.

22 comments