Skip to main content

SEO

Why is Google not indexing my website?

A practical troubleshooting guide for pages and websites that are not appearing in Google, covering discovery, crawl access, noindex, canonicals, quality and Search Console diagnostics.

By Simon Jones · Author, EasyClickSEOUpdated 21/09/2026

First: check the exact Search Console status

Common Page Indexing statuses

FeatureWhat it meansWhat to check
Discovered – currently not indexedGoogle knows the URL but has not crawled it yet.Internal links, sitemap inclusion, server performance, crawl demand, site quality and whether the page is genuinely important.
Crawled – currently not indexedGoogle fetched the page but has not chosen to index it.Content value, duplication, intent overlap, canonical signals, thin/commodity content and whether the page adds something distinct.
Excluded by noindexGoogle found a noindex directive.Whether noindex is intentional; remove it only if the page should appear in Search.
Duplicate / alternate canonicalGoogle believes another URL should represent the content.Canonical tags, redirects, internal links, sitemap URLs and duplicated page variants.
Soft 404The URL returns a normal response but appears to have little or no useful content.Whether the page should contain real content, redirect to a true replacement or return a genuine 404/410.
Blocked by robots.txtGooglebot is not allowed to crawl the URL.robots.txt rules and whether blocking is compatible with the indexation outcome you actually want.

1. Google has discovered the page but not crawled it yet

Discovered – currently not indexed means Google knows the URL exists but has not fetched it yet. This is not the same as Google rejecting the content after evaluation.

Make sure the page is linked from relevant internal pages, appears in the XML sitemap if it is an intended canonical URL, and is not buried inside a weak or repetitive section. New sites and large batches of newly published URLs can take time to be processed.

Do not create dozens more pages to solve a discovery backlog. Improve the importance and usefulness of the existing URLs first.

2. Google crawled the page but chose not to index it

Crawled – currently not indexed deserves a different response. Google has already fetched the page, so repeatedly requesting indexing without improving anything is unlikely to solve the underlying issue.

Check whether another page already satisfies the same intent, whether the content is thin or generic, whether most of the page is boilerplate, and whether the page has meaningful internal links. For commercial sites, doorway-style location or service variants are a common risk when only the city or keyword changes.

Strengthen the page around a distinct user need, real expertise, useful detail and supporting evidence. If two pages genuinely overlap, consolidation may be better than trying to force both into the index.

3. Check robots.txt and noindex separately

robots.txt controls crawling; a robots meta tag controls whether an accessible page should be indexed. They are not interchangeable.

If a page is blocked in robots.txt, Google may be unable to crawl it and therefore unable to read a page-level noindex directive. If the objective is to remove a page from the index, allow Google to crawl it and expose the appropriate noindex directive rather than relying on a robots block alone.

For pages that should rank, confirm both that crawling is allowed and that the rendered page does not contain noindex.

4. Check canonical signals for contradictions

Canonical consistency checklist

01

Self-canonical the preferred page

The indexable version should normally declare its own preferred canonical URL unless another page genuinely represents the content.

02

Use the same URL internally

Navigation and contextual links should point to the preferred URL, not parameters or duplicate variants.

03

Keep the sitemap clean

Include preferred canonical URLs, not redirects, noindex pages or duplicate states.

04

Redirect obsolete versions

HTTP/non-www/legacy paths and moved pages should resolve consistently to the intended permanent destination.

05

Inspect Google-selected canonical

Search Console can show when Google chose a different canonical from the one you declared.

5. Check the page response and rendered content

A page should return the correct HTTP status and meaningful content. JavaScript applications can create confusing states where every route returns HTTP 200 even when the user sees a not-found page, or where the initial HTML contains very little useful content.

Use URL Inspection's live test to see whether Google can access the page and render the important content. Check server responses, redirects, authentication, JavaScript errors and whether critical information depends on interactions a crawler will not perform. If crawl, rendering or canonical issues need implementation, our technical SEO services help diagnose the cause and prioritise the fixes.

6. Improve internal discovery and page importance

Google primarily discovers URLs through links. Important commercial pages should be reachable from navigation, hubs or relevant contextual links rather than existing only in a sitemap.

Internal linking also communicates relationships. An SEO service page linked from the homepage, services hub and relevant guides has a clearer role than an orphan page created in the CMS and never referenced elsewhere.

Use descriptive anchor text and avoid creating hundreds of repetitive footer links solely to force crawling.

When should you request indexing?

Use Request Indexing after you have fixed a meaningful issue or published an important new page. It is useful for priority URLs, but repeatedly submitting the same unchanged page does not create a ranking advantage.

For groups of URLs, maintain a clean XML sitemap and strong internal linking. Search engines still decide when and whether to crawl and index each page.

Google indexing questions

How long does Google take to index a new page?

There is no guaranteed timeframe. Google says crawling and indexing depend on many factors, and new sites or pages can take time to be discovered and processed.

Does submitting a sitemap guarantee indexing?

No. A sitemap helps Google learn about preferred URLs, but Google explicitly says it does not guarantee crawling, indexing or ranking.

Should I request indexing every day?

No. Use URL Inspection for important new or materially fixed URLs. Repeated requests without changes do not solve quality or canonical problems.

Can a page rank if it is blocked by robots.txt?

A blocked URL can sometimes still appear as a URL-only result if Google discovers it elsewhere, but Google cannot properly crawl and evaluate the content while blocked.

What is the difference between discovered and crawled currently not indexed?

Discovered means Google knows the URL but has not fetched it yet. Crawled means Google fetched it but did not select it for indexing at that time.

Sources & references

  1. 01Google Search Central — Crawling and indexing FAQ
  2. 02Google Search Central — Search Essentials
  3. 03Google Search Central — Canonicalisation
  4. 04Google Search Central — Robots meta tag

Related EasyClickSEO services

Got pages stuck outside Google's index?

The Free Growth Review separates discovery, technical, canonical and content-quality issues so the right fix is applied to the right URL group.

Get Your Free Growth Review

Apply the thinking

Turn insight into a prioritised growth plan.