Glossary

Crawling

How search engines discover pages, by following links and reading sitemaps with automated programs called crawlers or bots.

SEO & contentAll terms

Related terms

  • Search engine optimisation (SEO)

    Improving a website so it ranks higher in search results for the searches your customers make, through technical fixes, useful content and…

  • Anchor text

    The clickable words in a link. Descriptive anchor text tells people and search engines what the linked page is about; "click here"…

  • Google Search Console

    Google's free tool showing how a site performs in search: the queries people use, clicks, indexing problems and Core Web Vitals.

  • Internal linking

    Links between pages on the same site. They help visitors find related content and show search engines which pages matter most.

  • Link building

    Earning links from other websites through useful content, digital PR, partnerships and outreach.

  • Log file analysis

    Studying server logs to see exactly which pages search engine and AI crawlers visit, how often, and which they ignore.

Work with us

Ready for your next stage of growth?

Tell us where you want to take your brand. Our team will come back within one working day with next steps.

Your privacy

We use cookies to run this site and, with your consent, to understand how it's used and to measure our marketing. Read our cookie policy.

↑↓ to moveEnter to openEsc to closeFuzzy search across every page

Region

We work with clients across the UK and beyond. Prices are in pounds (GBP) and exclude VAT. The site is in English (UK).