Reddit blocking all major search engines, except Google
Reddit blocking all major search engines, except Google
readwrite.com Reddit blocking all major search engines, except Google
%%excerpt%% Reddit has commenced its assault on search engines, blocking those that don’t have a commercial relationship with the company, like Google.
You're viewing a single thread.
154
comments
this is just going to cause indexers to ignore robots.txt
"We always obey the robots.txt"
- A bunch of corporations that have no accountability and plenty of incentive to just ignore it and have all been caught training AI on off-limits data.
Rate limiting could “fix” that unfortunately.
154
comments