Skip to main content Technical SEO Case Study
Not-indexed URLs dropped from 405,162 to 31,423 — recovering crawl budget and refocusing Google on the pages that convert.
The Results
When a single chart tells the whole story, we show it large with one clear stat rather than padding the page with weak filler. The grey line is the count of URLs Google was crawling but not indexing — and the sharp drop is the cleanup taking effect.
405,162
Not-indexed URLs cleaned up
31,423
Not-indexed URLs (after)
−92%
Reduction in crawl bloat
2,180
Clean indexed pages retained
What's next: we're monitoring crawl stats in Search Console to confirm the recovered budget is being spent on priority pages, and tracking indexed-page growth for the content that should rank.
The Situation
The site had ballooned to over 400,000 URLs that Google had crawled but chosen not to index — auto-generated parameter pages, duplicates, and thin or low-value URLs. This bloat wastes crawl budget: Google spends its time re-crawling junk instead of the pages that actually earn rankings and leads.
A "not indexed" count this high is a red flag, not a goal to fix by forcing pages in. The right move is the opposite — clean up the URLs that shouldn't exist so the index reflects only pages worth ranking.
We cut not-indexed URLs from 405,162 to 31,423 — a 92% reduction — concentrating Google's crawl on the pages that drive real traffic.
405K
31K
Not-indexed URLs cleaned up
The Challenge
Search Console reported more than 400,000 URLs in a "not indexed" state across a dozen different reasons — parameter variations, duplicates without canonicals, soft 404s, and thin auto-generated pages. At that scale, Google's crawler wastes its limited budget revisiting URLs that will never rank, slowing the discovery and refresh of the pages that actually drive traffic and leads. The goal wasn't to index more pages — it was to remove the noise so the index reflected only valuable, rankable content.
The Execution
Diagnosed Every "Not Indexed" Reason
We worked through all 12 "not indexed" reasons reported in Search Console, auditing each one to understand why those URLs were being excluded. This let us separate the URLs that should never be indexed — parameter variations, duplicates, soft 404s, and thin auto-generated pages — from genuine, valuable content that was being missed and needed to be recovered.
Removed & Consolidated Junk URLs
We applied canonicals, no-index directives, and redirects, and pruned auto-generated parameter pages, collapsing hundreds of thousands of low-value variations into the canonical pages that matter. We also filtered out URLs that should not be crawled and blocked them in the robots.txt file, ensuring that search engines focus only on the URLs that need to be crawled and indexed.
Rebuilt a Clean Sitemap
We rebuilt and submitted a tightened XML sitemap that contained only valuable, indexable URLs, giving Google a clear and accurate map of what's actually worth crawling. By removing the noise from the sitemap itself, we made sure every URL we asked Google to discover was one that genuinely deserved a place in the index.
Recovered Crawl Budget
With the bloat removed and the index streamlined, Google's crawler no longer wastes its limited budget revisiting pages that will never rank. Instead, it refocuses on real, high-value content, improving how quickly new and updated pages are discovered, indexed, and refreshed in search results, so the pages that drive traffic and leads get the attention they deserve.
The Results
405,162
Not-indexed URLs cleaned up
31,423
Not-indexed URLs (after)
−92%
Reduction in crawl bloat
2,180
Clean indexed pages retained
A leaner index means Google's crawler spends its budget on pages that matter — improving how quickly real content is discovered and refreshed.
Confirm framing: these 374K URLs were intentionally removed (junk/duplicate), not failed-to-index pages.
What We Did
Let's Work Together
Book your strategy call and get a free technical SEO audit of your index health.
Discover Your Gaps & How We Can Help You Grow
