Crawler Hints: How Cloudflare Is Reducing The Environmental Impact Of Web Searches
Crawler Hints provide high quality data to search engine crawlers on when content has been changed on sites using Cloudflare, allowing them to precisely time their crawling, avoid wasteful crawls, and generally reduce resource consumption of customer origins.