Anything Engine Optimization The rolling record of the AI-search industry.
Beam of warm light coming through doorway with closed door into dark room
Photo by Sam J on Pexels
Search Engine Journal · Aug 31 Google SearchAEO

Google's Mueller: AI crawlers aren't requesting markdown

What this answers

Do AI crawlers request markdown versions of web pages?
On Google's John Mueller's own test sites, no major AI bot requested markdown — only SEO tools claimed to accept it, per Search Engine Journal.
What did Google recommend checking before building a markdown version of a site for AI crawlers?
Mueller recommended logging the accept header on incoming requests to see whether crawlers actually ask for markdown before investing in building it, per Search Engine Journal.

Responding to a r/TechSEO question about whether markdown files ease AI bot load, Google’s John Mueller said that on his own test sites, “the only crawlers who claim to accept markdown are SEO tools” — not major AI bots — per Search Engine Journal. Mueller advised site owners to log crawler accept headers and check the metrics before building markdown versions of their pages on the assumption AI crawlers want them.

Why it matters: It's data-backed pushback against markdown-for-AI as a default AEO tactic, arriving while llms.txt's spec formalizes markdown discovery and a publisher is already selling ads inside its markdown pages.

The record: Google

Glossary: SEOAI crawlers

Via Search Engine Journal ↗

Posted to the wire August 31, 2026. Edited by Joe Balewski.