AI companies are violating a basic social contract of the web and and ignoring robots.txt
AI companies are violating a basic social contract of the web and and ignoring robots.txt
www.theverge.com The rise and fall of robots.txt
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
![The rise and fall of robots.txt](https://lemmy.world/pictrs/image/d58d347c-eaf6-475a-bfe8-f71a8eb9140e.jpeg?format=webp&thumbnail=256)
4
crossposts
You're viewing a single thread.
All comments
187
comments
Well the trump era has shown that ignoring social contracts and straight up crime are only met with profit and slavish devotion from a huge community of dipshits. So. Y’know.
128 0 ReplyOnly if you're already rich or in the right social circles though. Everyone else gets fined/jail time of course.
6 0 ReplyMeh maybe. I know plenty of people who get away with all kinds of crap without money or connections.
1 0 Reply
187
comments
Scroll to top