How much does it bother you that OpenAI is trained on your data? What can we do about it?
How much does it bother you that OpenAI is trained on your data? What can we do about it?
It feels like we have a new privacy threat that's emerged in the past few years, and this year especially. I kind of think of the privacy threats over the past few decades as happening in waves of:
- First we were concerned about governments spying on us. The way we fought back (and continue to fight back) was through encrypted and secure protocols.
- Then we were concerned about corporations (Big Tech) taking our data and selling it to advertisers to target us with ads, or otherwise manipulate us. This is still a hard battle being fought, but we're fighting it mostly by avoiding Big Tech ("De-Googling", switching from social media to communities, etc.).
- Now we're in a new wave. Big Tech is now building massive GPTs (ChatGPT, Google Bard, etc.) and it's all trained on our data. Our reddit posts and Stack Overflow posts and maybe even our Mastodon or Lemmy posts! Unlike with #2, avoiding Big Tech doesn't help, since they can access our posts no matter where we post them.
So for that third one...what do we do? Anything that's online is fair game to be used to train the new crop of GPTs. Is this a battle that you personally care a lot about, or are you okay with GPTs being trained on stuff you've provided? If you do care, do you think there's any reasonable way we can fight back? Can we poison their training data somehow?
I've been posting publically for years. I expect when I do, it was viewed and used by anyone any time for anything. AI hasn't changed that.
If they want to train their artificial stupidity model on my posts, go for it. If they're looking for artificial intelligence, on the other hand, they might want a smarter dataset.
The biggest problem to me is what I just saw you post in another reply, that these models built upon our knowledge exist almost solely within proprietary ecosystems.
and maybe even our Mastodon or Lemmy posts!
The Washington Post published a great piece which allows you to search which websites were included in the "C4" dataset published in 2019. I searched for my personal blog
jonaharagon.comand sure enough it was included, and the C4 dataset is practically minuscule compared to what is being compiled for larger models like ChatGPT. If my tiny website was included, Mastodon and Lemmy posts (which are actually very visible and SEO optimized tbh) are 100% being scraped as well, there's no maybe about it.Thanks for linking to that, I hadn’t seen that article before. Interesting seeing it broken down like that and being able to search for a website to see if it was part of the training data
Regardless of how anyone feels about their writing being used for model training, there's definitely nothing anyone can do to prevent it other than just not writing anything visitble to the public.
Not yet, I think. If AI as regulated more strictly, users might get the chance of putting permission on their data. However that well look like. I hope it's better than the cookie opt-out or do-not-track setting in your browser though.
It depends on if the data is suitably anonymized or not. If my data isn't able to be reconstructed word for word in a way to directly links back to me? I don't know if I mind that anymore then I'd mind someone reading content I wrote and taking inspiration from that.
On the topic of privacy - how do people feel Lemmy compares to Reddit for privacy? I don't really like the way Lemmy handles deleted content for example.
I’m okay with it as long as I’m aware of it. If the platforms are up front about it, then users can choose for themselves whether they want to potentially contribute to training data. It will be interesting to watch the next few years.
How will we able to choose whether we want to give access to the data when we do not own the data in the first place(atleast with how data works now)
anything you post publicly is always going to be game, but we also give up way more data than we should. Im worried less about my social posts and more about all the breeched data AIs are going to run with.
Do I care? Sure, a little, someone is going to get paid and it's not going to be me. There's nothing I can do about it and my boss gets paid for my work too.
I'm considering using Power Delete Suite to delete my account, overwrite my previous comments, and maybe leaving a couple of my top comments up regarding tech support so people can still find information on troubleshooting
The issue is that most of the content posted is archived fairly quickly. Deleting/rewriting only hurts the humans that might have gone looking for it. The way I look at it is, if the data is searchable/indexable by search engines (as a proxy for all other tools) at any point of its life cycle then it's essentially permanent.
I'm conflicted, because on one hand id like my data left alone. On the other i realize how important reddit posts are in tech issues, or other troubleshooting topics. When I try to fix my linux issues for example the top most helpful results are from reddit.
Maybe we should go back in time and use mailing lists or usenet forums.
GIGO - Garbage In, Garbage Out. I asked ChatGPT to write a short essay and include a bibliography with URL 's. Every URL was a 404, and when looking up the bibliographic entries, they were nonexistent as well.
That's because you don't understand the tool you are using and use tech-sounding language in the wrong context to look like you do.
GPT models generate text based on the patterns of the tokens it learned during training. The URL it gives you doesn't work because they have to only look legit. It's all statistical patterns.
It's not because they fed it garbage during the semi-supervised training, it's because that literally is what the tool is meant for. Use the right tool like google scholar if what you need are sources.
If data is anonymised, this is fine. However, AI is opening to a huge issue of the misuse of data collected, disinformation and misinformation. I’d like to be able to enforce my right to data deletion about myself, if any, or to rectify the information, which is not possible at the moment and against the EU legal framework. Certainly AI needs to be regulated and enforced before companies and companies led by government use it as an intelligence weapon.