Project menu

Official Google answers to common SEO questions

Enter your question: Please wait...Please wait...

Question:

Uncrawled URLs in search results

Google's Matt Cutts answers:

Official Google Answer

Summary of the answer:

The summary of the answer is available to paid members. Become a member now. It's fast, easy and risk-free.

Related questions:

Question Views
If Google crawls 1,000 pages/day, Googlebot crawling many dupe content pages may slow down indexing of a large site. In that scenario, do you recommend blocking dupes using robots.txt or is using Meta Robots noindex,nofollow a better alternative? 908
Should a "Sale Page" be in a robots.txt file to avoid duplicate content? 872
Can I use robots.txt to optimize Googlebot's crawl? 735
In regards to the new canonicalization tag, does it make sense for large corporations to consider placing that tag on every page due to marketing tracking codes and large levels of duplicate URLs like faceted pages and load balancing servers? 970
If a page is disallowed by robots.txt, will a link to this page transfer/leak link juice? 791
What is the nofollow equivalent for JavaScript links/redirections (now that you follow those too)? 703
Can you think of any reason whatsoever to validate spending more than 5 minutes creating meta keywords? 977
Do dates in the URL of blogs or websites help determine freshness of the content or is it largely ignored? 864
Now that Google can crawl JavaScript links, what is going to happen with all those paid links that were behind JavaScript code? 890
We still have old content in the index. We block them via robots.txt, use 404 and delete via Webmaster Tools, but Google still keeps it. What can we do to quickly delete content from the index? 845