Browse by Surface

Bottom line

Browse by surface when you already know which agent-facing artifact you want to compare.

Is this relevant?

This page is useful for comparing crawler policy, sitemap discovery, LLM text files, Markdown alternatives, agent skills, and redirect traps across sites.

Use these pages to compare how different sites expose common agent-facing surfaces.

Robots.txt - Crawler policy surfaces that tell crawlers which paths and user agents are allowed.
Sitemaps - Discovery surfaces that expose URLs and content structure to crawlers.
LLM text files - Text or Markdown bundles such as llms.txt and llms-full.txt intended for LLM or agent consumption.
Markdown alternatives - Clean Markdown or API body alternatives that reduce extraction noise compared with full HTML pages.
Agent skills indexes - Capability-discovery files under .well-known/agent-skills/.
Redirect and status traps - Successful-looking responses that need deeper inspection before counting as usable agent surfaces.