About Develop Daly
Develop Daly is the blog, portfolio, and home of web designer, Search Engine Optimizer (SEO), and WordPress fanatic Patrick Daly.
Learn More
Subscribe via RSS or
MSN
Bots Really Like Me Now
I have no clue what happened, but two days ago Yahoo! and MSN started crawling my site like crazy. I didn’t do anything out of the ordinary but it seems like something clicked on my site. So its been…
Track the Crawl Rate of Spiders on Your Blog
Anyone can figure out how often bots visit their site by sifting through their log files everyday and organizing each bot and checking on the timespan between crawling, etc.
But who wants to do that?
Patrick Altoft created the Crawl…
