Bing Makes its Search Crawler Bingbot More Efficient
October 22, 2018 / Matt Southern
Bing’s search crawler, bingbot, has been improved to maximize crawl efficiency. Bingbot, as one might assume, is similar to Googlebot. Its job is to discover new and updated content and add it to Bing’s index. One of the concerns Bing has been hearing from webmasters regarding bingbot is that it doesn’t crawl frequently enough. As a result of not crawling frequently enough, some site owners believe the content in Bing’s index isn’t as fresh as it could be. On the other hand, there are site owners who believe bingbot crawls too often, which causes constraints on website resources. Bing says this is an engineering problem that hasn’t been fully resolved yet.