Google Crawler Updates Causing Spikes In Crawling For Some Sites – Search Engine Roundtable
Some sites, hosted on some CDNs (content delivery networks), are experiencing a big spike in server response times for crawling, while seeing a drop in total crawl requests. So technically, the crawling has dropped but Google is taking much longer to crawl a lot less. Supposedly, this started earlier this month and is still an issue for some.
This was discovered by Gianna Brachetti-Truskawa who posted more about this both on LinkedIn and Bluesky and she wrote:
Have you seen a recent drop in new users, and/or found that Google’s crawl rate has dropped on your site while server response times seem to be higher than usual?
Google have quietly updated their list of IP ranges used for crawling (as of 04.02.2025). If your website is delivered via a CDN, their WAF protecting your site from DDoS attacks might have Googlebot run into rate limiting or be blocked now – unless they updated their allowed IP ranges accordingly.
This did not affect every CDN, in fact, CloudFlare handled it fine,…
The post Google Crawler Updates Causing Spikes In Crawling For Some Sites – Search Engine Roundtable first appeared on One SEO Company News.
source: https://news.oneseocompany.com/2025/02/25/google-crawler-updates-causing-spikes-in-crawling-for-some-sites-search-engine-roundtable_2025022560239.html
Your content is great. However, if any of the content contained herein violates any rights of yours, including those of copyright, please contact us immediately by e-mail at media[@]kissrpr.com.