A bot that fetches web pages for an AI company, either to answer questions in real time or to collect training data. GPTBot and ClaudeBot are examples.
Glossary
AI crawler
Related terms
ClaudeBot
Anthropic's crawler that collects web content for training Claude models. Anthropic uses separate agents for search results and for pages people ask…
GPTBot
OpenAI's crawler that collects web content which may be used to train its models. Blocking it doesn't block ChatGPT search, which uses…
Answer engine optimisation (AEO)
Making content easy for answer engines and voice assistants to quote: direct answers, clear questions and structured data. Often used to mean…
AI citation
A link to a source shown inside an AI-generated answer. Being cited means an assistant used your page to answer the question…
AI Mode
Google's conversational search mode, which answers with an AI-written response and links, and lets people ask follow-up questions.
AI visibility
How often, and how favourably, a brand appears in AI-generated answers for the questions that matter to its customers.
Work with us
Ready for your next stage of growth?
Tell us where you want to take your brand. Our team will come back within one working day with next steps.