Part of the SiteMap Series
Search Console shows fewer URLs than your sitemap submitted because Google does not index every URL it finds in a sitemap. The sitemap signals which URLs you consider canonical; Google decides what actually enters the index based on duplicate content, canonicalisation, quality signals, robots.txt blocks, noindex tags, and soft 404s. A gap of 10 to 30 percent between submitted and indexed URLs is normal for healthy sites; gaps larger than 40 percent are worth investigating.
The instinct when you first see the gap is to panic. You open Search Console, navigate to the Sitemaps report, see “Submitted: 500” next to “Discovered: 380,” and wonder where 120 URLs went. The answer is nowhere; the funnel from submitted to indexed naturally narrows because Google applies its own filtering at each stage.
This FAQ covers what the three counts in Search Console actually mean, the six common reasons Google excludes sitemap URLs from indexing, when the gap is operationally normal versus when it is worth investigating, and how to diagnose what is going on when the numbers feel off.
What the three Search Console counts actually mean
The Sitemaps report in Search Console shows three different numbers for each sitemap. They are not interchangeable.
- Submitted. The number of URLs Google found in your sitemap file when it last fetched it. This is essentially a count of
<loc>entries in the XML. It reflects what you told Google, not what Google did with it. - Discovered. The number of URLs Google has crawled at least once from your sitemap. A URL is considered discovered when Googlebot has actually fetched it. This number will be lower than submitted if Google has not yet had time to crawl every URL, or if some URLs return errors that stop Google from completing the fetch.
- Indexed. This appears in the Pages report (formerly Coverage) rather than the Sitemaps report directly. It reflects the number of URLs Google has actually added to its index. A URL is indexed only when Google has crawled it, processed the content, and decided to keep it.
These three numbers are progressively smaller for almost every site. Submitted is the publisher’s intent; Discovered is what Google has fetched; Indexed is what Google has kept. The funnel narrows as Google applies its own filtering.
Six reasons sitemap URLs do not get indexed
When a URL is in your sitemap but absent from the index, one of these reasons usually explains it.
- Duplicate content. Google often finds multiple URLs serving the same or nearly identical content. It picks one canonical version to index and drops the rest. The dropped URLs may still be in your sitemap but will not appear in the index.
- Non-canonical URLs. If your sitemap contains URLs whose canonical tags point elsewhere, Google indexes the canonical version instead. The non-canonical URLs in your sitemap are effectively ignored.
- Low quality signals. Google’s quality assessment can exclude URLs from the index even when they are technically valid. Thin content, near-empty pages, low-value variants, and pages without unique value tend to be excluded.
- Noindex meta tags. A URL with a
<meta name="robots" content="noindex">tag (or equivalent HTTP header) will not be indexed, regardless of being in the sitemap. Including such URLs in the sitemap creates conflicting signals. - Robots.txt blocks. URLs blocked from crawling in robots.txt cannot be indexed because Google cannot fetch them to evaluate content. Including blocked URLs in the sitemap is a common but inert error.
- Soft 404s. Pages that technically return 200 OK but display content like “page not found” or empty templates get classified as soft 404s. Google does not index these even when they are submitted.
The most common combination on real sites is non-canonical URLs (faceted navigation, sorted variants, paginated lists) being included in sitemaps when they should not be. This single issue accounts for the majority of large submitted-vs-indexed gaps.
When the gap is normal versus concerning
A perfectly healthy site rarely has 100% of its sitemap URLs indexed. The realistic baseline depends on site type.
Normal range: Most sites see 70 to 90 percent of submitted URLs indexed. A small site with clean canonicalisation might reach 95 percent. A large site with some duplicate content might sit at 75 percent and still be operating well.
Worth investigating: If you see under 60 percent indexed, or if the number suddenly drops, that is worth a closer look. The same applies if the “Discovered, currently not indexed” count grows over time without explanation.
Concerning: Sudden large drops, indexed counts going to near zero, or specific URL patterns disappearing entirely. These usually indicate a structural change (robots.txt block, canonical tag change, accidental noindex deployment) rather than normal Google behaviour.
The headline: do not chase 100 percent. Chase clean signals. A site where every sitemap URL is canonical, fast, and high quality will reach the highest realistic indexation rate. Beyond that, Google’s judgement applies.
How to diagnose the gap
If you want to understand the gap rather than just accept it, three checks help.
Open the Pages report in Search Console. The “Why pages aren’t indexed” section breaks down exclusion reasons (duplicate without user-selected canonical, alternate page with proper canonical tag, crawled but not indexed, blocked by robots.txt, and so on). The exclusion reasons tell you which of the six categories above are accounting for your gap.
Inspect individual URLs. Use the URL Inspection tool on URLs you expect to be indexed but cannot find in Search. The inspection shows you Google’s current view: whether the URL is indexed, what the canonical is, what the indexing status is, and why if not.
Cross-reference with a fresh site crawl. Run Screaming Frog or similar against your site and compare the canonical URLs found to the URLs in your sitemap. Discrepancies (canonical URLs missing from sitemap, sitemap URLs with no canonical match) point at where the gap originates.
The patterns you find determine the fix.
What to do about it
The fixes follow the diagnosis.
For non-canonical URLs in the sitemap: Remove them. Sitemaps should only contain canonical URLs. The faceted, sorted, paginated variants belong elsewhere (robots.txt blocks or canonical tags pointing back to the canonical), not in the sitemap.
For duplicate content: Consolidate canonicals. Make sure the duplicate URLs have canonical tags pointing to the version you want indexed. Then keep only the canonical version in the sitemap.
For low quality signals: Improve the content. Thin pages, near-empty templates, and low-value variants need more depth or should be merged with related content. No sitemap configuration fixes a content quality problem.
For noindex tags: Decide which signal is correct. If you want the URL indexed, remove the noindex tag and keep it in the sitemap. If you do not want it indexed, remove it from the sitemap. Conflicting signals always lose to the more restrictive interpretation.
For robots.txt blocks: Same logic. Either unblock and keep in sitemap, or remove from sitemap.
For soft 404s: Fix the underlying page so it returns proper content, or remove the URL entirely and let it return a real 404.
Where this leaves us
The gap between submitted and indexed URLs is usually normal and worth diagnosing rather than panicking about. The diagnosis tells you which of the six common reasons applies to your site, and the fix follows from there.
For deeper treatment of common sitemap errors (including the validation patterns that prevent many indexation gaps in the first place), see Lesson 11 of Module 2: How to Fix Common Sitemap Errors. For the broader audit framework that catches sitemap quality issues systematically, see Lesson 8 of Module 4: How to Audit Your Website Sitemap.
This is an entry in Module 5: Sitemap FAQs, part of The Sitemap Series, a Technical SEO series on sitemaps from first principles, built for the AI Search era.