Anything Engine Optimization The rolling record of the AI-search industry.
A pale circuit glyph on a deep slate field
Illustration: AEO Wire
Search Engine Land · Aug 19 ResearchAEOTools & Vendors

41-day test finds AI crawlers miss JavaScript-only links entirely

What this answers

Can AI crawlers like GPTBot read JavaScript-rendered links?
In a 41-day experiment, GPTBot, ClaudeBot and Bingbot found zero of the JavaScript-linked pages tested, while Googlebot reached only 2% of them, per Search Engine Land.
Does converting JavaScript links to HTML fix AI crawler discovery?
Yes — after the test site's JavaScript links were converted to plain HTML, GPTBot recovered 250 previously unreachable pages within 48 hours, per the same experiment.

An SEO tested crawler discovery on a 2,400-page site by splitting internal links between hard-coded HTML and JavaScript-injected versions, then logging bot requests for 41 days, per Search Engine Land. GPTBot, ClaudeBot and Bingbot found none of the JavaScript-linked pages, while Googlebot reached just 2% of them versus 48% for Google’s separate GoogleOther crawler. After the links were converted to HTML, GPTBot recovered 250 of the previously unreachable pages within 48 hours.

Why it matters: Sitemaps and internal-link audits are usually judged by Googlebot's behavior, but this experiment shows the AI crawlers publishers now court most — GPTBot, ClaudeBot — can behave more strictly than Googlebot itself, silently excluding JavaScript-linked content from citation eligibility.

The record: GoogleOpenAI

Glossary: SEOAI crawlers

Via Search Engine Land ↗

Posted to the wire August 19, 2026. Edited by Joe Balewski.