How Often Google Crawls and Indexes
October 16, 2018 / Roger Montti
In a webmaster hangout, a publisher asked how fast Google removed pages from the index if they added a non-index unfollow to it. The publisher stated they had added index but the page remained in Google’s index. Google’s John Mueller responded with an answer that described how often some pages are indexed. John Mueller revealed that URLs are crawled at different rates. That’s somewhat well understood. What was of more interest was that he said some URLs can be crawled as little as once every six months.