Project menu ≡

Official Google answers to common SEO questions

Enter your question:

Question:

How many bots/spiders does Google currently have crawling the web?

Google's Matt Cutts answers:

Official Google Answer

Summary of the answer:

The summary of the answer is available to paid members. Become a member now. It's fast, easy and risk-free.

Related questions:

Question Views
Prefetching resources 450
Tips on requesting reconsideration 651
What are Google's plans for indexing the deep web? 467
Does Googlebot use inference when spidering - having crawled site.com/article/page1.htm and /page2.htm, can it guess at the existence of a /page3.htm and crawl it? 385
Is there a way to tell Google bots to exclude recurring words on a website such as "leave comment" or "print page" when indexing in order to improve the keyword density? 373
Websites lose backlinks due to other websites going out of business or closing (Geocities, AOL member pages). Does Google remove the back link juice that once came from these pages? 470
Whenever Google detects a violation of its Webmaster Guidelines, can we expect a feature to be added in Google Webmaster Central where it could help the webmasters learn what the issue was? 401
Following your interview with Eric Engel - you mention about "If Modified-Since." We worked on many websites whereby the actual file timestamp doesn't change but the content does as the pages are database-driven. How should we deal with such situations. 359
Say your index page has been cached by Google and then you change the meta description. How long does it take for a Google bot to recrawl that page? 479
How does Google calculate site load times in the data it exposes in Google's webmaster statistics? 396