Anyone can figure out how often bots visit their site by sifting through their log files everyday and organizing each bot and checking on the timespan between crawling, etc.
But who wants to do that?
Patrick Altoft created the Crawl Rate Tracker for WordPress. It does the grunt work to 1) visually display the rate at which [...]
{ 0 comments }