Technical SEO

How to find orphan pages on your site

Crawl your site starting from the home page, list every URL the crawl reached, and compare that against your sitemap. Anything in the sitemap the crawl never reached has no internal links pointing at it, which is why it is probably not indexed.

Written by Anas Bin Masud 6 steps About 30 minutes 315 words

Before you start

  • A crawler, or a build script
  • Your XML sitemap

The steps

  1. Step 1: Crawl from the home page

    Follow internal links only. Record every URL reached.

  2. Step 2: Export your sitemap URLs

    Every loc entry from sitemap-0.xml, or from each child of the index.

  3. Step 3: Compare the two lists

    Sitemap URLs not present in the crawl are orphans.

  4. Step 4: Check Search Console

    Orphans commonly appear as "Discovered — currently not indexed", which confirms the diagnosis.

  5. Step 5: Decide page by page

    Either link the page from somewhere genuinely relevant, or remove it if nothing needs it.

  6. Step 6: Automate the check

    Put it in your build so the problem cannot silently return — a page nothing links to should fail the build, not be discovered a year later.

Why an orphan usually stays unindexed

A sitemap entry is a suggestion; an internal link is a signal of importance. A page with no inbound links reads as unimportant regardless of what the sitemap says, and search engines act accordingly.

The worst of both outcomes

Leaving an orphan in the sitemap means it is crawled, judged, and counted toward the site’s overall quality assessment without ever being useful. Either link it or remove it — leaving it is the only genuinely wrong option.

Orphans that should simply be deleted

An old landing page from a campaign that ended, a duplicate created during a migration, a tag archive with one entry. If nothing links to it and nothing needs it, removing it is better than manufacturing a link. Return a 410 rather than a 404 where you are certain it is permanent, and remove it from the sitemap in the same change so the two never disagree.

The background behind this

Technical SEO, in the order the problems actually block you covers the reasoning in about 4 minutes — free, ungated, written from client work.

Who wrote this

Anas Bin Masud builds e-commerce sites and does technical SEO for businesses in the UK, Canada, Ireland and Pakistan. These procedures are the ones I run on client work, written down rather than invented — including the ones where the honest answer is that the fix is not available on your current hosting.

Related procedures

All 64 how-to guides →

Want this done rather than done yourself?

Send the brief and you get a reply within one business day — either questions, or a scoping call. If your project is not something I should take on, I will say so then.

Response
Replies within 1 business day
Hours
Mon–Fri, 09:00–18:00 PKT — overlaps 05:00–14:00 UK, 00:00–09:00 US Eastern
Booking
Booking projects from October 2026
WhatsApp — opens a chat with +92 346 5348466 in a new tab