Reddit will block the Internet Archive
Reddit will block the Internet Archive
www.theverge.com
Reddit will block the Internet Archive
23 comments
-
-
Reddit says that it has caught AI companies scraping its data from the Internet Archive’s Wayback Machine, so it’s going to start blocking the Internet Archive from indexing the vast majority of Reddit. The Wayback Machine will no longer be able to crawl post detail pages, comments, or profiles; instead, it will only be able to index the Reddit.com homepage, which effectively means IA will only be able to archive insights into which news headlines and posts were most popular on a given day.
Reddit is interesting right now. I took a look last week at the front page and there was an obvious post against trump. I checked inside and most of the comments were generic or something? Hard to pinpoint. It reminded me of conservative or td. I think they were bots? Here on lemmy, you might not get your post on the all page, but it seems like mostly real people.
-
It seems unlikely that there's a lot of people botting Lemmy right now just because...why bother? But I doubt there's anything systemic in place to prevent it, and I'd imagine that the decentralized nature would make it really easy to skirt attempts to block it.
-
I've come across quite a few bots, but I'm a mod so it might be that that's why. The mods and admins here on my instance are amazing, they catch a lot of crap. I think you're witnessing well ran instances, not an absence of bots.
-
We had the whole... 'Fediverse Girl' thing, a while back now... somebody stole someone's pic and was was dming people as a sort of brute force catfish attempt...
But I haven't seen too much of anything else?
-
-
-
Honestly for the best, given how the site has degraded over the last decade.
Internet Archive doesn't need a thousand bots posting slurs at one another for eternity
-
What a weird pay model. Is their plan for AI companies to pay insane API fees to scrape data from Reddit? Why would anyone pay when every other model scrapes it for free?
-
Cool. Block links to it and other archives too.
That’s only fair. (And it’ll piss off reddit users)
-
Fuck Reddit and Fuck Spez.
-
23 comments
Pot calling the kettle black. Funny how they have a problem with AI accessing what they perceive as their data. Fucking moochers.
"They can't monetize our users' self-created content for ridiculously exploitative gains. Only we can monetize(*) our users' self-created content for ridiculous exploitative gains!"
(* Well, try to monetize, they haven't actually got it to work yet)