Glossary

ClaudeBot

Anthropic's crawler that collects web content for training Claude models. Anthropic uses separate agents for search results and for pages people ask Claude to read.

GEOAll terms

Related terms

  • AI crawler

    A bot that fetches web pages for an AI company, either to answer questions in real time or to collect training data.…

  • Content signals

    A robots.txt extension, proposed by Cloudflare in 2025, that states how a site's content may be used: for search, as input to…

  • Large language model (LLM)

    An AI model trained on huge amounts of text to understand and write language, such as GPT, Claude or Gemini. It powers…

  • AI agent

    Software that acts on a person's behalf using an AI model, such as browsing sites, comparing options or filling in forms. Clear,…

  • GPTBot

    OpenAI's crawler that collects web content which may be used to train its models. Blocking it doesn't block ChatGPT search, which uses…

  • Zero-click search

    A search answered on the results page itself, by a snippet or AI summary, so the person doesn't click through to any…

Work with us

Ready for your next stage of growth?

Tell us where you want to take your brand. Our team will come back within one working day with next steps.

Your privacy

We use cookies to run this site and, with your consent, to understand how it's used and to measure our marketing. Read our cookie policy.

↑↓ to moveEnter to openEsc to closeFuzzy search across every page

Region

We work with clients across the UK and beyond. Prices are in pounds (GBP) and exclude VAT. The site is in English (UK).