AI companies are violating a basic social contract of the web and and ignoring robots.txt
AI companies are violating a basic social contract of the web and and ignoring robots.txt
www.theverge.com The rise and fall of robots.txt
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
![The rise and fall of robots.txt](https://lemmy.world/pictrs/image/d58d347c-eaf6-475a-bfe8-f71a8eb9140e.jpeg?format=webp&thumbnail=256)
4
crossposts
You're viewing a single thread.
All comments
187
comments
They didn't violate the social contact, they disrupted it.
55 0 ReplyTrue innovation. So brave.
14 0 Reply
187
comments
Scroll to top