folks don't know that AIs scraping websites accounts for like half of all internet bandwidth usage right now. Sites get scraped- ie, all the contents downloaded- over and over again, destroying/wasting their bandwidth, often maxing it out. It's like being continually DDOS'd
It's a counterattack for AI companies that persistently scrape and rescrape your web site, even when you tell them not to
when a scraper grabs it, it becomes a 10-gig HTML page and 💣 goes the scraper
Item #6 in my latest "Linkfest" newsletter: buttondown.com/clivethompso...
folks don't know that AIs scraping websites accounts for like half of all internet bandwidth usage right now. Sites get scraped- ie, all the contents downloaded- over and over again, destroying/wasting their bandwidth, often maxing it out. It's like being continually DDOS'd