Waiting for Godot- Rather Googlebot
by Brian on Oct.29, 2008, under More SEOMatrix
What are the types of bots that Google sends out to the web?
Googlebot: crawl pages from our web index and our news index
Googlebot-Mobile: crawls pages for our mobile index
Googlebot-Image: crawls pages for our image index
Mediapartners-Google: crawls pages to determine AdSense content. We only use this bot to crawl your site if AdSense ads are displayed on your site.
Adsbot-Google: crawls pages to measure AdWords landing page quality. We only use this bot if you use Google AdWords to advertise your site.
He’ll often leave a little stamp in the weblogs like crawl-66-249-71-23.googlebot.com
Or, the image crawler will leave a little Googlebot-Image/1.0
To check to see how relatively frequent Google’s bots are coming around to your site, you can do the query in the Google search box cache:yoursite.com
Leave a Reply
You must be logged in to post a comment.
