Readiness

Agent Standards

Track adoption of agent-readiness checks such as machine-readable docs, API discovery, and content negotiation.

Current Signal7d
robotsTxt90,723
sitemap75,013
linkHeaders10,681
dnsAid477

Agent readiness checks

Updated: 2026-10-12

Use this to: prioritize machine-readable signals that make the site easier for agents.

robotsTxt90,723
robotsTxtAiRules87,515
sitemap75,013
linkHeaders10,681
oauthDiscovery7,079
markdownNegotiation3,907
ucp3,681
oauthProtectedResource3,099
webMcp2,853
contentSignals2,679
apiCatalog672
agentSkills564
mcpServerCard554
dnsAid477
ard199

Country activity

Use geography as a planning signal before changing crawl policy or regional infrastructure.

Why This Matters

Agent standards make sites easier for AI systems to navigate without scraping brittle UI assumptions.

What To Do

  • Start with robots.txt, sitemap, and API docs.
  • Add markdown negotiation where it preserves meaning.
  • Expose machine-readable service descriptions for repeatable agent use.
Data source: Cloudflare Radar. Processed by LLMBase for publisher and agent-readiness workflows.