A hacked database from AI companion site Muah.ai exposes peoples' particular kinks and fantasies they've asked their bot to engage in. It also shows many of them are trying to use the platform to generate child abuse material.
I actually don't think this is shocking or something that needs to be "investigated." Other than the sketchy website that doesn't secure user's data, that is.
Actual child abuse / grooming happens on social media, chat services, and local churches. Not in a one on one between a user and a llm.
Wait… so you meant to tell me that predatory simps are using AI incorrectly? Man…. If only someone could have called this years ago- something could have been done to minimize it!
Who knew that unchecked growth could lead to negative results?!
Ain't that what are the tools there for. I mean I don't like cp and I don't want to engage in way with people who like it. But I use those llms to describe fantasies that I wouldn't even talk about with other humans.
As long as they don't do it on real humans nobody is hurt.
A bit off topic... But from my understanding, the US currently doesn't have a single federal agency that is responsible for AI regulation... However, there is an agency for child abuse protection: the National Center on Child Abuse and Neglect within Department of HHS
If AI girlfriends generating CSAM is how we get AI regulation in the US, I'd be equally surprised and appalled
Paywall.
That site frankly does not even look legit and looking at the plethora of other AI sites I don't know who would use this one. It's not even displaying correctly and has like 0 information on anything. If I were to stumble upon that site I'd think it is shady as hell.
This is a weird one, because while fantasy is fantasy, and doesn't necessarily indicate an intention to act on anything, these people were dumb enough to share these specific fantasies with some random AI porn site. That's got to be an indicator of poor impulse control, right?
That alone should probably warrant immediate FBI background checks, or whatever relevant agencies have jurisdiction for these types of criminal investigations in each user's locality.
Of course, I am saying it's without actually having read any of the chats. So it's possible my opinion would change from "this should be investigated", to summary executions and burn the bodies for good measure... but no way I'm reading those fucking chats.