Module Four

Sitemaps in Practice

Eight lessons on applying sitemap setup to real sites. E-commerce, JavaScript single-page apps, migrations, multi-region architectures, crawl budget at scale, AI crawlers, and the audit framework that closes the structured course.

The Curriculum

Eight Lessons

Lesson One frames why site type changes sitemap decisions. Lessons Two to Seven cover specific applied scenarios. Lesson Eight closes the structured course with the four-layer audit framework that brings the entire series together.

8 lessons
Module 04 01 Sitemap Series

Why Sitemap Setup Depends on Your Site Type

The framing lesson. Three concrete examples showing how the same principle creates different decisions across site types, and the three meta-questions every applied lesson returns to.

10 min read Read article →
Module 04 02 Sitemap Series

Sitemaps for E-commerce Sites

Five URL categories to include. Three approaches to out-of-stock handling. Faceted navigation rules. Sale and seasonal collections. Implementations across Shopify, WooCommerce, Magento, and headless platforms.

14 min read Read article →
Module 04 03 Sitemap Series

Sitemaps for JavaScript Sites and SPAs

URL discovery for rendered routes. Build-time, on-demand, and database-driven patterns. Framework implementations across Next.js, Astro, Gatsby, Vue/Nuxt, and pure SPAs.

13 min read Read article →
Module 04 04 Sitemap Series

Sitemaps During Website Migrations

Five migration scenarios. The three-phase pattern: pre-migration, cutover, and post-migration. Sitemap, redirect, and canonical alignment. When to retire the old sitemap.

13 min read Read article →
Module 04 05 Sitemap Series

Sitemaps for Multi-region and Subdomain Sites

The cross-domain rule as load-bearing concept. Three multi-region patterns: ccTLDs, subdomains, and subdirectories. Subdomain architecture beyond regions. Where hreflang sits.

13 min read Read article →
Module 04 06 Sitemap Series

Sitemaps and Crawl Budget at Scale

When crawl budget actually matters. Three mechanisms by which the sitemap shapes it. Lastmod trust-building. Structure choices at scale. What to exclude, how to generate, deliver, and monitor.

14 min read Read article →
Module 04 07 Sitemap Series

How AI Crawlers Read Your Sitemap

The four categories of AI crawlers: training, search-focused, browsing agents, and opt-out tokens. What they use, what they ignore. Controlling access through robots.txt. Where llms.txt fits.

13 min read Read article →
Module 04 08 Sitemap Series

How to Audit Your Website Sitemap

The four-layer audit framework that closes the structured course. Foundations, workflow, specialised types, and application checks. Thirty-seven specific checks across the four layers.

17 min read Read article →
Questions

Frequently Asked

The questions that come up most often from readers working through the applied lessons.

Do I need to complete Modules One, Two, and Three first?
Recommended, since Module Four assumes the foundations from Module One, the workflow from Module Two, and the specialised types from Module Three. That said, if you already understand how sitemaps work and how to build, maintain, and specialise them, you can jump straight into the applied scenarios here without losing the thread.
How long does Module Four take to complete?
Around one hour and forty-five minutes of focused reading across all eight lessons. Most readers spread this across several sessions over a week or two, especially the longer lessons on crawl budget at scale and the audit framework that closes the structured course.
Which site types are covered in detail?
E-commerce platforms with faceted navigation, JavaScript single-page applications across Next.js, Astro, Gatsby, Vue/Nuxt and pure SPAs, website migrations across five scenarios, multi-region setups across ccTLDs, subdomains and subdirectories, and large-scale sites where crawl budget management matters. The framing lesson and the audit framework apply to any site type.
Do I need a paid SEO tool to follow along?
No. The lessons reference Screaming Frog (the free tier handles small sites), Google Search Console, and Bing Webmaster Tools, all free. Log file analysis tools like Botify and Lumar are mentioned but optional, used only when sites exceed the scale where Search Console alone falls short.
Is this the right module if I am new to the AI Search era?
Yes. Lesson Seven covers AI crawlers (GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot) and the opt-out tokens (Google-Extended, Applebot-Extended), and how they read your sitemap. The framing throughout the series treats AI Search as the modern application of Technical SEO foundations, not as a separate discipline.
Why is there an AI crawler lesson in a sitemap series?
Because AI crawlers read your sitemap. Setting up sitemaps in the AI Search era means understanding what GPTBot, ClaudeBot, PerplexityBot, and the rest actually do with the file, what they ignore, and how robots.txt access controls interact with sitemap discovery. The sitemap remains the canonical URL discovery mechanism for both search engines and AI crawlers.
What if my site does not match any of the types covered?
The framing lesson and the audit framework apply to any site type. The applied lessons demonstrate the principle that sitemap setup follows site type. If your site is not directly covered, the audit framework still gives you a structured way to evaluate what you have and find the gaps that matter.
What is covered in Module Five?
Module Five is the living section of the series. It is an ongoing collection of focused answers to specific sitemap questions that surface from real-world work. Whenever a new sitemap question comes up that deserves a focused answer rather than a fresh module lesson, it joins Module Five.
Test Your Knowledge

Module Four Quiz

Eight lessons of applied sitemap work behind you. The quiz checks your grasp of e-commerce facets, JS site URL discovery, migration patterns, crawl budget signals, AI crawler categories, and the four-layer audit framework that closes the structured course.

Attempt the quiz →
What's Next

The Series Continues

Module Four closes the structured course. From here, the Sitemap Series continues as an ongoing FAQ vault where new sitemap questions get focused answers as they surface from real-world work.

05
Module Five

Sitemap FAQs

The living section of the Sitemap Series. Whenever a new sitemap question surfaces from real-world work, it joins Module Five with a focused, citable answer. The course closes; the conversation continues.

Explore Module 5 →

Module Four closes the structured course. Thirty-seven lessons across four modules, taking the sitemap topic from first principles through to applied audit for the AI Search era.