Major websites are blocking AI crawlers from accessing their content

There’s a couple good stories about this today.

“Nearly 20% of the top 1000 websites in the world are blocking crawler bots that gather web data for AI services, according to new data from Originality.AI, an AI content detector”

https://www.axios.com/2023/08/31/major-websites-are-blocking-ai-crawlers-from-accessing-their-content

blocking bots crawler data detector good major privacy services stories today web websites world