Glossary: AI Crawlers and GEO Terms Explained

This glossary defines the terms used across SEO for LLM, in plain language.

Term Meaning
GPTBot OpenAI's crawler for collecting content that may be used for model training.
OAI-SearchBot OpenAI's crawler for including pages in ChatGPT search results.
ChatGPT-User The agent that fetches a page when a ChatGPT user triggers it.
ClaudeBot / Claude-SearchBot / Claude-User Anthropic's training crawler, search crawler and user-triggered fetcher.
PerplexityBot / Perplexity-User Perplexity's search crawler and its user-triggered fetcher.
Google-Extended A robots.txt token controlling use of content for some Google AI products. Google says it does not affect inclusion in Google Search.
Googlebot / bingbot The classic search crawlers behind Google and Bing.
robots.txt A file telling crawlers which paths they may fetch. It states a policy and does not enforce it.
llms.txt A proposed text file describing a site for language models. Not a confirmed ranking signal.
Grounding Giving a model fresh search results so its answer can cite sources.
Query fan-out Splitting one question into several related searches.
Citation A source linked or named inside an AI answer.
GEO Generative engine optimization: making content easier for AI engines to find and cite.

See the methodology for how we label evidence and the data page for our tests.