With the rise of AI, web crawlers are suddenly controversial

As unscrupulous AI companies crawl for more and more data, the primary social contract of the web is falling apart.