Tag Archives: crawl stats

Crawl Stats from Google webmaster tools show an improvement in performance

Google bot crawl stats for my site

Google bot crawl stats for my site

This screen shot is from my Google webmaster tools account. The first two graphs show the number of pages crawled and the number of kilobytes downloaded per day.  The last graph shows the time that Google bots needed to download pages.

You can see that Google has been crawling my site as much as ever, but since I tuned my Raspberry Pi server cluster, the time spent downloading pages has plummeted.