Internet protocols

IETF with Sitemaps.org

The robots-exclusion protocol (RFC 9309) at the IETF together with the Sitemaps.org collaboration between Google, Yahoo, and Microsoft that defines the XML sitemap format.

Short name: IETF / Sitemaps.org
Scope: Internet protocols
Homepage: sitemaps.org
Standards governed: 1

Standards governed by IETF / Sitemaps.org

robots.txt + sitemap.xml RFC 9309 / sitemaps.org global SEO Tell crawlers what to index and what to skip. The most basic site-discoverability hygiene.