edit Michael Cottam on January 4, 2011
edit Make sure your important pages can rank
First, some background: Search engines use computer programs called "crawlers" (or “spiders” or “robots”) to discover web pages and add them to their indexes. Google calls its crawler “Googlebot,” and lots of SEO (search engine optimization) professionals call it that, too.
Read the rest of this article on AboutUs.com blog.