1.1 Robots & directives (HTTP + HTML)HighVerified

Meta robots and X-Robots-Tag conflict

When the HTML tag and the HTTP header disagree, Google applies the most restrictive instruction. So a permissive meta tag does not save a page if the header says noindex.

What it is

HTML and header directives disagree.

Why it matters

Google applies the most restrictive, so an unintended noindex/nosnippet can win.

How to fix it

Reconcile the two sources to a single intended directive.

How to find it on your site

  1. Read both the meta robots tag in the HTML and the X-Robots-Tag header with curl -I.
  2. Write down each directive side by side.
  3. Remember the most restrictive directive wins, not the one you prefer.
  4. Make the two agree, and set the intended behaviour in one place.

Cross-reference to ranking and citation factors

Because the restrictive side wins, conflicts almost always resolve against visibility. I reconcile them so nothing is suppressed by accident.

Impact

High, restrictive rule may suppress a wanted page. Direct (documented precedence).

Evidence

With conflicting robots rules, the most restrictive applies. Google Search Central, Robots Meta Tags Specifications