Cloudflare offers to make AI pay to crawl websites
Cloudflare offers to make AI pay to crawl websites
Cloudflare will block AI bots from crawling websites by default for new customers, and broker pay-per-crawl deals between its customers and bot operators.
This idea that you could have Cloudflare help by telling off AI crawlers sounds nice, but how long until it becomes a premium feature that requires loads of money to operate because AI companies lobby them to make it inaccessible to the masses? Or something equally as bad happens?
I don't believe they have that capability
Oh yes, they have and more, they are one of the most powerfull security and AI company with a ton of services. Perfectly capable to remove the plug of any service and web. Sadly with similar privacy concerns as Google.
Believe all you want, reality doesn't care.
I agree!
This could further accelerate the arms race between malicious srappers and websites.
My fear is this would create collateral damage, block legitimate scrappers and visitors, hassle people with an increasing number of captcha.
yeah i think that there’s a good chance for vpn users to be harassed by anti ai measures
They probably can. Link