Stephan Mack Online

Entries from August 2009

Search Engine User Agent Bot Names

August 17th, 2009 · No Comments

Because I found it extremely difficult to locate the user agent / bot names of the various big search engines, I’ve decided to list them here:
Google User Agents:

Googlebot: crawl pages from our web index and our news index
Googlebot-Mobile: crawls pages for our mobile index
Googlebot-Image: crawls pages for our image index
Mediapartners-Google: crawls pages to determine AdSense [...]

[Read more →]

Tags: Uncategorized