Technical SEO · Beginner

Indexing

Indexing is when a search engine stores a crawled page in its index, the database it ranks results from. Only indexed pages can appear in search results and in AI answers built on them.

By Thryv StudioUpdated

Level
Beginner
Check in
Search Console's Pages report and URL Inspection
Blocked by
noindex, errors, duplicates, low quality

What is indexing?

After crawling a page, the search engine processes it: renders it, understands its content, picks a canonical version among duplicates, and decides whether to keep it. Kept pages go into the index. Search results, and AI features that use search, only draw on indexed pages.

Why pages don't get indexed

  • A noindex rule in a meta tag or HTTP header.
  • The page is a duplicate, and another URL was chosen as canonical.
  • Thin or low-value content the engine chose not to keep.
  • Errors, redirects or soft 404s.
  • The page hasn't been discovered or crawled yet.

How to check

Use URL Inspection in Search Console for a single page, and the Pages report for the whole site, which lists excluded pages with reasons.

Frequently asked questions

Can I force Google to index a page?

You can request indexing in Search Console, which speeds up crawling, but Google still decides whether to index it.

Browse the glossary

Chat on WhatsApp