Technical SEO

How to Find Pages Hurting Your Website SEO (and Fix Them)

To find pages hurting your SEO, compare a full crawl with Search Console's Page indexing and Performance reports, then flag thin, duplicate, broken, cannibalizing and never-visited URLs.

By SEORecheck Research Team, SEO auditorsPublished 9 min read

A cyan scan highlights faulty amber pages, illustrating how to find pages hurting website SEO.
Isolating pages that hurt website SEO

To find pages hurting your website's SEO, put three lists side by side: every URL a crawler finds, Search Console's Page indexing report, and 12 months of Performance data. Then flag the pages that are thin, duplicated, broken, competing with each other or never shown in search. Each flagged page gets one of four fixes: improve, merge, noindex or remove.

Most sites don't need to delete half their pages. What they need is a list of the specific URLs causing problems, plus the reason each one is on the list. This guide shows how to build that list.

What does it mean when a page "hurts" SEO?

A page hurts SEO in one of two ways. It can fail on its own: it's broken, slow, blocked or never indexed. Or it can drag other pages down by wasting crawling, splitting relevance between near-duplicates, or adding to a pile of unhelpful content that makes the whole site look weaker.

The second kind is easy to miss, and Google talks about it openly. Its core updates guidance says that deleting unhelpful content "can help the good content on your site perform better." It also calls deletion "a last resort," only for content that "can't be salvaged."

Crawling works the same way. Google's crawl budget guide warns that when many URLs are duplicates or unimportant, this "wastes a lot of Google crawling time on your site." The same guide says this mostly matters for large sites (about 10,000+ pages that change daily, or 1M+ pages) and for sites with many URLs marked "Discovered – currently not indexed." On a 40-page site, crawl budget is rarely the issue. Thin pages and duplicates can still be.

Which kinds of pages hurt website SEO?

Most problem pages fall into a few repeating types. The table shows each type, what you'll notice, where to find it and the usual fix.

Page type Typical symptom Where you find it Usual fix
Thin or empty pages (tag archives, stub posts, empty categories) Indexed but zero impressions, or "Crawled – currently not indexed" Performance report + crawler word count Improve, merge or noindex
Near-duplicates (URL parameters, print versions, variants) "Duplicate without user-selected canonical" Page indexing report, crawler duplicate titles Canonical tag or consolidate
Soft 404s (a "not found" message sent with a 200 status code) Listed as soft 404 Page indexing report Return a real 404/410 or add content
Cannibalizing pages Two URLs swapping positions for the same query Performance report, Queries → Pages Merge and 301 redirect
Broken and redirected internal targets 4xx errors, redirect chains Crawler status codes Update links to the final URL
Orphan pages In the sitemap but no internal links point to them Crawl compared with sitemap Link them or remove them
Slow or unstable templates "Poor" URL groups Core Web Vitals report Fix the template, not single pages
Mass-produced or copied pages Low engagement, no rankings, possible manual action Manual review, Manual actions report Rewrite properly or remove

The last row matters most. Google's spam policies define scaled content abuse as "many pages are generated for the primary purpose of manipulating search rankings and not helping users." Thin affiliate pages that copy merchant descriptions "without any original content or added value" are named separately. City-by-city doorway pages, auto-generated product descriptions and scraped glossaries belong here.

How to find pages hurting website SEO, step by step

The method below works on any CMS. You need Search Console access, a crawler (any desktop or cloud crawler will do) and a spreadsheet.

Step 1: Build one URL inventory

Combine three sources into one sheet, with one row per URL:

  • Crawl export: status code, indexability, canonical, title, word count, number of incoming internal links.
  • XML sitemap URLs: the pages you're telling Google matter.
  • Search Console Performance → Pages: clicks and impressions for the last 12 months.

Then match the rows across sources. A URL that is in the sitemap but missing from the crawl is an orphan. A URL that the crawl finds but that has no Search Console data has never been shown in search. A URL in Search Console that the crawler can't reach is often an old page that still gets traffic and needs a redirect.

Step 2: Read the Page indexing report correctly

Open Indexing → Pages and look at the reasons pages aren't indexed. Don't aim for 100% indexing. Google's Page indexing report documentation says you "should not expect all URLs on your site to be indexed, only the canonical pages." It also says "Duplicate without user-selected canonical" is "not an error."

What to export and check:

  • Soft 404: pages that show a "not found" style message but return status 200. These waste crawling until you fix them.
  • Crawled – currently not indexed: Google read the page and chose not to index it. This is often the clearest sign of thin or near-duplicate content. Our guide to crawled – currently not indexed covers each cause.
  • Duplicate, Google chose different canonical than user: your canonical signals contradict each other.
  • Excluded by 'noindex' tag: confirm none of these are pages you actually want to rank.

Step 3: Find pages with no search value

In the Performance report, set the date range to the last 12 months and export the Pages tab. Sort by impressions. Pages with zero or almost zero impressions over a full year are your "zombie" candidates. For each one, ask:

  1. Does it target a query anyone searches for?
  2. Is another page on the site already a better answer?
  3. Does it serve a non-search purpose, such as a login, legal, campaign landing page or support doc?

Pages that serve a real non-search purpose stay as they are. If a page fails questions 1 and 2, flag it.

Also flag pages with many impressions but a very low CTR at positions 1–5. These pages are visible, but their titles or snippets aren't earning the click.

Step 4: Check for cannibalization

In Performance, open the Queries tab, click an important query, then switch to Pages. If two or more of your URLs share impressions for the same query and their positions swap back and forth over time, they are splitting relevance. A common example is a "best running shoes 2025" post and a "best running shoes 2026" post that both still rank. Pick the stronger URL, merge the useful content into it and 301-redirect the weaker one. If rankings are already sliding, why pages lose Google rankings helps separate cannibalization from other causes.

Step 5: Run the technical sweep in the crawler

Filter the crawl export for:

  • 4xx and 5xx URLs that still receive internal links
  • Redirect chains (A → B → C) and internal links that point to redirects
  • Canonical tags pointing to non-200 or noindexed URLs
  • Duplicate titles and meta descriptions, which usually point to duplicate templates
  • Pages with fewer than about 1–2 incoming internal links (see internal linking for SEO)
  • Noindexed or redirected URLs listed in the sitemap

Step 6: Check performance by template

Open the Core Web Vitals report and look at the URL groups rated "Poor." These groups almost always share one template, such as product pages, blog posts or listing pages. The thresholds are LCP ≤ 2.5 s, INP ≤ 200 ms and CLS ≤ 0.1 at the 75th percentile. Fix the template once and every page using it improves. The Core Web Vitals guide explains each metric.

If you'd rather not assemble all of this by hand, a free SEORecheck audit crawls your site in a real browser and lists the affected URLs for broken links, redirect chains, duplicate and thin pages, canonical conflicts and slow templates, with examples from your own pages.

Should you delete pages that hurt SEO?

Usually you shouldn't, at least not first. Google's own advice is that deletion is a last resort for content that can't be salvaged. Most flagged pages should be improved, merged or kept out of the index instead. Choose the action based on whether the page has value for people, backlinks or traffic.

Situation Action
Useful topic, weak execution Improve: add depth, examples, updated facts
Two or more pages on the same intent Merge into the strongest one, 301 the others
Needed by users but not by search (filters, internal search, thank-you pages) Keep, add noindex
Duplicate URL variants Canonical tag to the main version (canonical tag guide)
No value, no traffic, no links Remove with 404 or 410, and remove internal links and sitemap entries
Removed page that has backlinks 301 to the closest relevant page, not the homepage

Some practical rules:

  • Check backlinks before removing anything. A page with zero traffic but good external links should be redirected, not deleted.
  • Don't block pages in robots.txt to "remove" them. Robots.txt stops crawling but doesn't remove a page from the index. Google then can't see a noindex tag on it either.
  • Clean up after yourself. Update internal links to point at the final URLs and remove dead URLs from the sitemap.
  • Watch for the warning sign Google describes. If you're thinking about deleting entire sections, Google's core updates page says that's "likely a sign those sections were created for search engines first."

A worked example

Take a services business blog with 220 posts. The crawl and Performance data show:

  • 60 tag archive pages with one or two posts each and no impressions → noindex, then remove them from the sitemap
  • 14 pairs of yearly "price guide" and "tips" posts competing with each other → merge each pair, 301 the older one
  • 9 posts listed as soft 404s because a plugin emptied them → restore the content or return 410
  • 25 thin posts on real topics with some impressions → rewrite with concrete examples

Only about 10 URLs are actually deleted. The rest are improved, merged or kept out of the index.

How do you know if fixing those pages helped?

Track the same URL list before and after. Record the indexing status, impressions, clicks and average position for the pages you kept and the pages you merged into. Then compare them again 30–60 days later. Expect technical fixes like redirects, soft 404s and canonicals to show up in Search Console within a few weeks as Google recrawls. Content quality changes often take longer. Google's core updates page notes that some improvements may not be reflected until a later update.

What success looks like:

  • Fewer "Crawled – currently not indexed" and soft 404 URLs
  • Merged target pages gaining impressions and holding stable positions
  • Crawl stats showing more requests to the pages you care about
  • No new broken links or redirect chains introduced by the cleanup

A before/after comparison is easier when every issue is tracked by status. The sample comparison report shows issues marked as fixed, improved, unresolved or new, and the sample report shows how affected URLs are listed for each finding.

Key takeaways

  • Pages hurt SEO either on their own (broken, slow, unindexed) or by dragging others down (duplicates, cannibalization, crawl waste, unhelpful content).
  • Combine a crawl, the Page indexing report and 12 months of Performance data into one URL inventory.
  • Zero-impression pages, soft 404s, "Crawled – currently not indexed" and query overlaps are the clearest signals.
  • Improve or merge first. Use noindex for pages people need but search doesn't. Delete only what has no value, traffic or links.
  • Recheck the same URL list 30–60 days later to confirm the fixes worked.
All articles
A layered landscape tile connects to search nodes with a speed trail, illustrating image SEO best practices.

Technical SEO

Image SEO Best Practices: Alt Text, Formats, Speed (2026)

Image SEO means making images discoverable and understandable to Google with HTML img tags, descriptive alt text and file names, then keeping them fast with modern formats, correct sizing and smart lazy loading.

10 min read

Duplicate content SEO visualized as matching content nodes grouped in amber, with one preferred version highlighted.

Technical SEO

Duplicate Content SEO: How to Detect and Fix It

Duplicate content is the same or nearly the same content on more than one URL. It isn't a penalty, but it splits signals and wastes crawls. Find it in Search Console and a crawl, then redirect, canonicalize or rewrite.

8 min read

Server log analysis for SEO: cyan crawl traces connect web pages to a server and glowing request records.

Technical SEO

Server Log Analysis for SEO: What Bots Really Crawl

Server log analysis for SEO means reading your web server's access logs to see which URLs Googlebot and other crawlers actually request, how often, and what status codes they get back.

10 min read