Serving Markdown via Accept Headers Optimizes AI Agent Crawling

Websites can improve AI agent performance by serving Markdown content through the Accept: text/markdown header. This reduces token consumption, improves RAG retrieval signal-to-noise ratios, and lowers latency by stripping away DOM overhead.