X-Robots-Tag noindex in HTTP header
This is the noindex I miss most often, because it lives in the HTTP header and never appears in the HTML. The page looks perfectly indexable in view-source while quietly being told to disappear.
A noindex delivered via HTTP header (not visible in HTML).
Why it matters
Easily overlooked because it’s not in the markup, yet fully effective at deindexing, a common hidden cause of lost visibility.
How to fix it
Inspect response headers; remove the header at server/CDN level.
How to find it on your site
- Run curl -I https://yourdomain.com/your-page and read every X-Robots-Tag line.
- Look for noindex or none in the header value.
- Confirm in Search Console URL Inspection, which reports header directives.
- Trace the header to your server, CDN or framework config and remove it.
Cross-reference to ranking and citation factors
A header noindex is as absolute as an HTML one. Because it is invisible in the markup, it can suppress a page for months before anyone checks the headers.
Impact
Severe/blocking. Direct; especially insidious because invisible in source.
Evidence
X-Robots-Tag applies the same directives via HTTP header. Google Search Central, Robots Meta Tags Specifications; Google Search Central, Block Search indexing with noindex
Sources