Soft 404s Bleed Traffic Slowly — Fix Them First

TL;DR: A multinational crypto news site lost 90% of organic traffic after a domain migration, driven by soft 404 errors and a crawl budget crisis that compounded silently for 14 months. Fixing HTTP status codes and removing thin auto-generated pages restored indexed page counts by over 57% within weeks. Technical debt doesn’t plateau — it compounds, and high-volume operators cannot afford to find that out the hard way.

The Migration That Never Recovered

In January 2022, the Brazilian localization of a cryptocurrency news website completed a domain migration from xx.com.br to a new subdomain structure. Before the move, the site was pulling between 15,000 and 25,000 clicks per day in Google Search Console. After migration, it stabilized at 2,000 to 4,000 daily clicks — and stayed there for over a year.

That’s not a dip. That’s a sustained 87% collapse that outlasted three Google algorithm updates, including the June 2021 core update, spam update, and page experience update. None of them caused the problem. The problem was internal: the old domain kept getting crawled by Google alongside the new one, splitting crawl budget between two properties instead of consolidating authority on the new domain.

The first signal of recovery came in late August 2022 — a peak of 12 clicks and 37 impressions on a single day. By January 2023, the team had confirmed the full scope: 513,369 pages crawled but not indexed in Brazil alone, 1,193 soft 404 errors growing rapidly, and 2,532 pages flagged for canonical tag conflicts. Using Facebook Prophet forecasting on pre-migration data, analysts estimated the site should have been generating over 2 million monthly clicks by early 2022. It was achieving a fraction of that.

What a Soft 404 Actually Does to Your Site

A soft 404 is a page that returns an HTTP 200 status code — telling search engines “this page is fine” — while actually containing no meaningful content. Unlike a hard 404, which clearly signals that a page is gone, a soft 404 confuses crawlers and forces them to waste resources on empty pages.

For a site publishing time-sensitive content, this is a compounding problem. The site in this case study was averaging 2 minutes for Google to crawl new articles — acceptable for a news publisher. But indexing those articles was taking 24 hours. By the time a piece of crypto news was indexed, the news cycle had already moved on. Competitors with clean technical foundations had already captured the clicks.

The soft 404 infection wasn’t limited to Brazil. By early 2023, the main domain had 90,400 affected pages. Spain had 17,700. Korea had 15,400. France had 15,100. Germany had 8,010. In France specifically, as soft 404s accumulated starting October 2022, Google’s total daily crawl requests dropped from 60,000–70,000 to just 20,000–30,000. Google wasn’t penalizing the site — it was simply allocating its crawl resources elsewhere.

Operators running high-volume content across multiple regional domains should treat this as a structural risk. If you’re operating a crypto content acquisition funnel across multiple country properties, soft 404s on any one domain can depress crawl rates site-wide.

Crawl Budget Is Not a Theoretical Concern

The crawl budget debate has been going on for years. Some SEOs treat it as relevant only for very large sites. This case study settles the argument for any operator publishing at scale across multiple domains: crawl budget is real, measurable, and consequential.

The root cause of the crawl budget crisis here was auto-generated pages. The site was creating URL patterns like /usd-to-thor?amount=250 and /eur-to-signaturechain?amount=1000 at scale — thin currency converter pages with no substantive content. These pages consumed crawl resources that Google could have spent indexing actual editorial content. The fix required removing or noindexing these pages, implementing stricter URL parameter handling, and using robots.txt to block low-value URL patterns.

This isn’t exclusive to crypto news sites. Any operator in a high-CAC vertical — forex, iGaming, legal — running programmatic landing pages or dynamic URL structures faces the same exposure. A technical SEO audit that maps crawl budget consumption by URL type is the first step to identifying where Google is being sent on dead ends.

The Remediation Plan: Prioritized, Not Uniform

Starting January 31, 2023, the team executed a structured remediation plan across three priority tiers:

Urgent — Soft 404 Resolution: Pages returning 200 codes with no content were corrected to return proper 404 or 410 status codes. Pages with actual content were fixed to render correctly. This was the highest-leverage intervention available.

High Priority — Crawl Budget Optimization: Auto-generated pages were removed or noindexed. Canonical tags were audited and corrected. Internal linking was strengthened to surface authoritative pages.

Medium Priority — Core Web Vitals: The team made a deliberate call not to let Core Web Vitals optimization crowd out indexing work. This was the right call. CWV improvements showed mixed results across regions anyway — Brazil, Argentina, and Thailand showed zero improvement despite technical interventions, because the real constraints were infrastructure-level: CDN proximity, server location, and device quality in those markets.

The insight here matters for operators using paid media alongside organic: chasing page speed scores in markets where mobile infrastructure is the limiting factor is a misallocation of engineering resources. Fix the indexing floor first.

The Results: Indexed Pages and Traffic, Not Just Rankings

Within weeks of implementation, every domain showed measurable improvement:

• Brazil: Crawled-but-not-indexed pages dropped from 513,000 to 220,000 (57% reduction). Soft 404s fell from 1,193 to 370 (69% reduction).
• Germany: Indexed pages increased from roughly 150,000 to 370,748. Daily clicks rose from ~8,000 to a sustained 12,000–15,000. Google Discover traffic share jumped from 42% to 58%.
• Poland: Indexed pages grew from ~100,000 to 135,556. Multiple daily traffic spikes above 30,000 clicks. Discover share rose from 15% to 86%.
• Spain: Google Discover clicks increased from ~450,000 to 912,721 total. Discover now represents 65% of all traffic.
• All domains combined: Soft 404 errors across all properties dropped from a peak of ~120,000 pages to under 20,000 — an 83% reduction by late April 2023.

The Google Discover gains are particularly instructive. Discover doesn’t promote content from sites Google doesn’t trust. As indexing health improved, Google began recommending content from these domains more aggressively. Technical credibility unlocked distribution. No content refresh, no link-building campaign — just clean signals.

What This Means for High-CAC Vertical Operators

Operators in forex, iGaming, legal, and crypto spend significant budget acquiring traffic through paid channels. But organic search is the compounding asset that reduces blended CAC over time. If your technical foundation is leaking crawl budget, that compounding never happens.

Consider the math from this case study: across 13 domains, soft 404 and indexing issues prevented approximately 500,000 pages from being indexed. At average click-through rates for indexed pages, that represents millions of potential monthly impressions left unrealized. For a regulated iGaming operator or a forex broker paying $40–$120 CPL through paid channels, that suppressed organic volume has direct revenue implications.

The same applies to law firms and legal marketing operations. If your law firm content strategy is producing intake-focused pages that return soft 404s or sit in a crawl queue for 24 hours, your SEO investment is structurally capped. And for CDL recruitment operators running driver acquisition campaigns with geo-targeted landing pages, auto-generated URL patterns are a real crawl budget risk — especially if those pages vary only by city or job category parameter.

The systematic fix framework from this case study translates cleanly to any high-volume operator site: audit Google Search Console page indexing reports across all properties, identify soft 404 patterns, implement correct HTTP status codes, remove or noindex thin programmatic pages, and monitor crawl rate recovery weekly. If you want to layer in precision targeting on top of organic, the organic foundation needs to be structurally sound first.

Technical Debt Compounds — Act Before It Becomes a Crisis

The most operationally important takeaway from this case study is the timeline. The Brazilian site’s migration happened in January 2022. The full remediation didn’t begin until January 2023. That’s 12 months of compounding degradation: crawl budget eroding, competitors filling vacated rankings, topical authority decaying. Recovery was measurable within 12 weeks of fixing the right things — but the opportunity cost of 12 months cannot be recovered.

Google does not send a notification when it begins deprioritizing your content. Traffic doesn’t collapse overnight. It bleeds — slowly, by page, by domain, by market. By the time the drop is obvious in a weekly report, the technical problem has often been running for months.

Routine monitoring of Google Search Console’s Pages report — specifically the “Crawled but not indexed” and “Soft 404” categories — is the minimum operational standard for any site publishing at volume. For operators managing multiple regional domains or large programmatic page libraries, that monitoring should be weekly, not quarterly. Technical SEO is not a one-time project. It is ongoing infrastructure maintenance, and ignoring it has a measurable cost.

Originally reported by Search Engine Land, May 2026.