What Should Not Be Included in a Sitemap?

A sitemap is your list of URLs you’d like indexed. Each URL that doesn’t belong makes that list less trustworthy and makes your reports harder to read.

1. Duplicate and non-canonical URLs

List only the canonical version of each page. Leave out parameter variations, print versions and anything whose canonical tag points elsewhere. Duplicates usually don’t lead to a penalty, but they do send search engines mixed signals about which URL you prefer.

2. Private pages

Leave out login pages, account areas and anything behind a password. Sitemaps are public, so listing a URL reveals that it exists. A sitemap entry doesn’t expose what’s behind a login, but it’s still a list you’re publishing for anyone to read.

3. Pages with little value

Thank-you pages, internal search results and empty archives add nothing to search results, so there’s no reason to ask for them to be indexed.

4. Pages marked noindex

A sitemap says “please index this” and noindex says “don’t”. Conflicts like that appear as errors in your Search Console reports.

5. Redirects and errors

Only list URLs that return a 200 status. Redirecting and broken URLs waste crawls, so keep them out and list the final destination instead.

6. URLs blocked by robots.txt

If crawlers aren’t allowed to fetch a URL, there’s no point listing it.

How to keep these out on WordPress

Our plugin lets you choose which content types are listed and exclude specific posts and pages. In version 5, posts you’ve marked noindex in your SEO plugin are left out automatically, and each post’s editor screen shows whether it’s listed.


Posted

in

by