Indexing

The process by which a search engine stores and organizes a crawled page so it can appear in results.

Indexing is the step after crawling where a search engine analyzes a fetched page and stores it in its index — the database it queries to build search results. A page can be crawled but not indexed if the engine judges it low-value, duplicative, or explicitly excluded with noindex or a canonical pointing elsewhere.

Indexing is not guaranteed. Google decides what to keep based on content quality, uniqueness, and demand. This is why "submitted" in a sitemap does not mean "indexed" — the sitemap only helps with discovery.

Common reasons pages stay unindexed include thin or duplicate content, soft 404s, canonicalization to another URL, and crawl issues. To diagnose a specific page, use the URL Inspection tool in Search Console, which reports its exact index status and why.

Stop worrying about your sitemap.

Indexly crawls your site, builds the sitemap, hosts it, and keeps it current — automatically.

Get started free