1.1 Robots & directives (HTTP + HTML)LowInferred

Sitemap not declared in robots.txt

Declaring my sitemap in robots.txt is a cheap win. It is not required, but it gives every crawler a reliable pointer to my URL inventory without depending on submission.

What it is

No Sitemap: directive in robots.txt.

Why it matters

A declared sitemap speeds discovery; absence is a minor missed efficiency, not an error.

How to fix it

Add `Sitemap: https://…/sitemap.xml`.

How to find it on your site

  1. Open /robots.txt and look for a line beginning Sitemap: with an absolute URL.
  2. Confirm the sitemap URL it points to actually loads and returns 200.
  3. If absent, add Sitemap: https://yourdomain.com/sitemap.xml on its own line.
  4. Still submit the sitemap in Search Console, since the two are complementary.

Cross-reference to ranking and citation factors

Faster, more reliable discovery supports indexing coverage and freshness, both of which sit upstream of ranking. The effect is indirect.

Impact

Low. Marginal crawl-efficiency gain. Estimate.

Evidence

Declaring the sitemap in robots.txt aids discovery. Google Search Central, Build and submit a sitemap; Google Search Central, Intro to robots.txt