Wednesday, December 06, 2006

A test on slowing the Google Crawl Rate

Last week I decided to change the crawl rate of one of the sites I control within the Google Webmaster Tools. I am left with mixed results, so far after one week of changing this switch there has not been a significant decrease in crawl traffic from what is normally seen. Admittedly the day I turned it down Google was crawling twice as much as any normal day, it is still crawling at a higher than average level.

Just after this feature was launched, I tried the opposite on a new site that was launched around the same time. I set the crawl rate to faster which has had limited to no effect on the crawl rate.

With this data I believe that this feature may be live on the Webmaster Tools, however it does not have enough of an overriding strength to determine Google’s crawl rate at this time. I would bet that they are still experimenting with what this tool is capable of doing. I will update you as soon as I see a change.

Labels: , ,

1 Comments:

Blogger Svetoslav said...

I look forward to the results. I never tested these features.

1:05 AM  

Post a Comment

<< Home

My Photo
Name: Aaron Shear
Location: San Francisco, California, United States

I have been in the search industry since the late 90’s, no not 10-20 years. My career started early in the search Day’s at Inktomi, where I supported large search portals. For example, MSN, AOL, iWon, Hotbot, CNet too name a few. After Inktomi I became a freelance consultant. I consulted for a few of the Top SEO’s around 2002 time frame; obviously the market has changed since then. After consulting I joined a small SEO firm called SEO Inc as the CTO. At SEO Inc. I successfully optimized some of the largest clients including IGN, Sony, VEGAS.com, Beaches and Sandals Resorts to name a few. Even though SEO Inc was a ton of fun, I still wanted the ultimate SEO challenge. I moved on as the global head of SEO for Shopping.com an eBay company. This challenge was an interesting one, how do I optimize a site with 50 million products? Every month I helped the business grow by leaps and bounds. I am now consulting for mostly enterprise e-commerce clients. Yes there is more too me than this profile shows, but you will just have to ask.

Powered by Blogger

Add to Google Subscribe in Bloglines