Meta's AI crawler sent 9.1 billion requests in Q2, raising concerns among developers.

iconKuCoinFlash
Share
AI summary iconSummary
AI and crypto news platforms are reporting Meta’s aggressive web crawling activity. According to MetaEra, the company’s AI crawlers sent 9.1 billion requests in Q2 2026, with Meta-WebIndexer increasing by 163%. Developer Pieter Levels noted spikes in server load caused by the traffic. DataDome tracked the surge, showing that Meta’s crawler now outpaces its training tool. An anonymous Meta employee said the goal is to build an in-house search engine for AI queries. On-chain news and AI developments continue to shape the tech and crypto landscape.
ME AI news, according to monitoring by Beating, Meta is aggressively scraping web pages to build indexes for its AI search. Independent developer Pieter Levels reported that Meta heavily scraped multiple websites under his ownership this week, causing multiple load alerts on one of his VPS servers. DataDome statistics show that in the second quarter of this year, Meta’s two AI crawlers issued a total of 9.1 billion requests. The Meta-WebIndexer, responsible for building search indexes, saw a 163% quarterly increase, with its June request volume surpassing that of the training crawler for the first time. Meta has been known since 2024 to be developing its own search engine to reduce reliance on Google and Bing for Meta AI. Now, this search indexing system is clearly accelerating expansion—but such intense scraping brings virtually no real users back to websites. A Meta employee privately revealed that the company aims to build its own “Google” to avoid sending AI search requests to Google, only for Google to use them for training. This information currently comes only from anonymous leaks and has not been confirmed by Meta. (Source: MLion)
Source:Show original
Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.