Check what AI crawlers read on your product site and fix the mismatches

A solo Mac app maker had Claude verify a Grok audit of two product sites, fetch all 71 pages the way GPTBot does, and fix eight stale or wrong facts the same day.

Done withClaude· Nov 9, 2026

What they did

Otabek Abdiraimov sells two small Mac apps, Halo and Shedi, and noticed a few buyers arriving from ChatGPT and a company's internal AI chat. Abdiraimov wanted to know what AI crawlers actually see on the two hand-deployed sites. Abdiraimov first had Grok audit both sites as a crawler for ChatGPT, Claude or Perplexity would, then had Claude check each finding against the live pages and make the fixes. Abdiraimov also had Claude fetch every URL in both sitemaps without running JavaScript, as GPTBot does, then load the top pages in a real browser and compare the two versions.

How it went

Claude confirmed seven of the audit's findings: a press kit two versions behind, a homepage claiming no cookies while an A/B test set one, a download size that differed between page text and structured data, Buy links that only worked after JavaScript ran, seven translations marked as English, and overlong titles. While fixing the file size it found an eighth problem the audit missed: six of eight translated homepages gave an old version number. All of it went live the same day. The no-JavaScript crawl showed every key fact was in the raw HTML. Bing's AI report later showed six Copilot citations for Halo, up from zero for most of October.

Worth knowing

Abdiraimov used a second model to check the first one's audit because an AI audit can be wrong too. The harness Claude ran in is not named. Cloudflare's email hiding makes the support address unreadable to bots; Abdiraimov kept it on to avoid spam.

Try it

With Claude· 3 parts to fill in

Audit [my website] the way an AI crawler that does not run JavaScript would see it. Fetch every URL in [my sitemap URL], then open the [number] most important pages in a real browser and compare the two. List every place where the version, price, file size, dates, language tags, privacy claims or Buy links differ between the visible page, the raw HTML, the structured data and each translation. Check each finding against the live page before reporting it. Show me the list and wait for my approval before changing any file.

Square brackets are the parts to fill in. The prompt is ours; the story is theirs.

Where they said it

Related