Google

Googlebot

Google's primary web crawler responsible for indexing the web for Google Search results.

Overview

Operated By
Google
Purpose
Discovers, crawls, and indexes web pages for Google Search.
User-Agent String
Googlebot/2.1
Respects robots.txt
Yes
Category
search
Website
https://developers.google.com/search/docs/crawling-indexing/googlebot