Technical SEO
How to find orphan pages on your site
Crawl your site starting from the home page, list every URL the crawl reached, and compare that against your sitemap. Anything in the sitemap the crawl never reached has no internal links pointing at it, which is why it is probably not indexed.
Before you start
- A crawler, or a build script
- Your XML sitemap
The steps
-
Step 1: Crawl from the home page
Follow internal links only. Record every URL reached.
-
Step 2: Export your sitemap URLs
Every loc entry from sitemap-0.xml, or from each child of the index.
-
Step 3: Compare the two lists
Sitemap URLs not present in the crawl are orphans.
-
Step 4: Check Search Console
Orphans commonly appear as "Discovered — currently not indexed", which confirms the diagnosis.
-
Step 5: Decide page by page
Either link the page from somewhere genuinely relevant, or remove it if nothing needs it.
-
Step 6: Automate the check
Put it in your build so the problem cannot silently return — a page nothing links to should fail the build, not be discovered a year later.
Why an orphan usually stays unindexed
A sitemap entry is a suggestion; an internal link is a signal of importance. A page with no inbound links reads as unimportant regardless of what the sitemap says, and search engines act accordingly.
The worst of both outcomes
Leaving an orphan in the sitemap means it is crawled, judged, and counted toward the site’s overall quality assessment without ever being useful. Either link it or remove it — leaving it is the only genuinely wrong option.
Orphans that should simply be deleted
An old landing page from a campaign that ended, a duplicate created during a migration, a tag archive with one entry. If nothing links to it and nothing needs it, removing it is better than manufacturing a link. Return a 410 rather than a 404 where you are certain it is permanent, and remove it from the sitemap in the same change so the two never disagree.
The background behind this
Technical SEO, in the order the problems actually block you covers the reasoning in about 4 minutes — free, ungated, written from client work.
Who wrote this
Anas Bin Masud builds e-commerce sites and does technical SEO for businesses in the UK, Canada, Ireland and Pakistan. These procedures are the ones I run on client work, written down rather than invented — including the ones where the honest answer is that the fix is not available on your current hosting.