Over the last few months we noticed an uptick in website owners and some content delivery
networks (CDNs) attempting to use 404 and other 4xx client errors (but not 429) to attempt to
reduce Googlebot’s crawl rate.
networks (CDNs) attempting to use 404 and other 4xx client errors (but not 429) to attempt to
reduce Googlebot’s crawl rate.
This post is also available in: English