Cloudflare will now block AI crawlers by default
Cloudflare will now block AI crawlers by default
Cloudflare wants AI companies to get permission to crawl websites.
The website hosting service is fighting back against the crawlers
I love the tar pit idea, where they just generate AI slop to feed the crawler, but this is good too.
One would be considered malicious, which I think is great, but others may not.
can some1 point me to fuck_cloudflare?
Curious, I don’t understand the hate for Cloudflare
I mean theres a few reasons.
Theres what Richard Stallman says about CF
Also they dont seem to shut down sites that host large amounts of misinformation
Theres also the fact that CloudFlare is centralized, and when CF goes down, large portions of the internet goes down. The fact theyre a large US company that can see what anyone on the internet does on any of the many many websites they host (its something like 60% iirc)
A large portion of the reasons are in this article: https://expertbeacon.com/why-cloudflare-sucks-an-in-depth-look-at-the-perils-of-an-internet-giant/
It's part of a lot of shit, so Cloudflare outages can be insanely disruptive. Last time there was one, members go their direct deposits late, which fucked over our poorer members who need the money ASAP.
What if I get identified as AI crawler. Will they lock me down from parts of their internet until I pay them ?