Your prompt

Check that my sitemap, robots settings and canonical URLs are correct, and fix anything that blocks indexing.

What this prompt does

Three things decide whether search engines can find and index your pages: a sitemap listing your URLs, robots rules saying what crawlers may fetch, and canonical URLs naming the preferred address of each page. This prompt asks your AI assistant to check all three and fix whatever blocks indexing.

WordPress generates a basic sitemap by itself, and SEO plugins can replace it with their own. Problems usually come from conflicts, such as two sitemaps, or a setting left on from development.

Fixing these settings is mostly about removing mistakes, not adding clever configuration. The goal is a plain, consistent set of signals: one sitemap, sensible robots rules and one preferred URL per page.

Before you run it

  • Know whether your site is meant to be indexed. If it is a staging copy, blocking is correct.
  • Look at Settings, then Reading, for the option that discourages search engines. A leftover tick here is a common cause.
  • Have your SEO plugin name and Search Console access ready if you use them.
  • Back up your settings. Changing robots rules wrongly can hide your whole site.
  • Tell the assistant which pages you intentionally keep out of search, such as account or cart pages, so it does not open them up.

What to check afterwards

  • Open your sitemap address and confirm it lists your real pages and not junk.
  • Open yoursite.com/robots.txt and read it. Nothing should block the whole site.
  • View the source of a few pages and look for a noindex tag you did not intend.
  • Check each page’s canonical points to its own correct URL.
  • Submit or resubmit the sitemap in Google Search Console.
  • Search for your domain’s own address in a browser using http and without www, and confirm it redirects to the one you prefer.

Ways to adapt it

  • Report only: “Do not change anything. List problems in order of severity.”
  • Add a scope: “Also check that my WooCommerce cart and checkout pages are not indexed.”
  • Check the www and https versions: “Confirm all versions redirect to one address.”

If it goes wrong

  • Pages stay out of Google after the fix. Indexing takes time, so request a recrawl in Search Console and check again later.
  • Two sitemaps exist. Turn one off, usually the one from the plugin you are not using.
  • The robots file keeps resetting. A plugin may be writing it, so change it there.

Read our XML sitemap guide and the Search Console guide, and use the launch checklist to confirm the rest.

← Every prompt on WPMusk

SponsoredNibWP

Stop clicking. Start telling.

Ask your AI to build pages, fix speed and nail SEO, and NibWP does it on your WordPress site in minutes.

Try NibWP.com

Get the WPMusk Sunday brief

One email a week with our newest tutorials, honest tool reviews and resources you won’t find on the blog. No spam, unsubscribe in one click.

Newsletter (Sunday brief)