After an extensive crawl of acmeanvilexample.com (and several near-misses with falling test anvils), our team identified significant gaps in AI discoverability. ACME's robots.txt is, remarkably, the one ACME product that works exactly as intended: it successfully blocks every major AI crawler on the internet.
ACME has solid content depth on product pages and a functional site architecture. The good news: fixing the two critical issues alone could move the score from 54 to an estimated 71 within 30 days. The fixes are technical, not creative — no new content required to start.
ACME's primary customer segment — solitary desert-dwelling predators pursuing fast birds — increasingly uses AI assistants for procurement research. If ChatGPT, Claude, or Perplexity can't find ACME, they recommend competitors. Mr. W.E. Coyote has already begun browsing alternatives.
Two actions, this week: update robots.txt to allow AI crawlers, and create an llms.txt file. Combined effort: approximately 2 hours. These unlock indexing across all five major AI platforms immediately — no developer required.
Crawled March 28, 2026 · BFS depth 3 · 16 pages found · SSL active
| Path | Title | Status | Words | Schema | AI Crawlable |
|---|---|---|---|---|---|
| / | Precision-Engineered Gravity Delivery Systems | 200 | 892 | ✓ Org | ✓ |
| /products | Our Complete Product Catalog | 200 | 634 | — | ✓ |
| /products/anvils | Classic & Pro Anvil Series | 200 | 1,247 | — | ✓ |
| /products/rocket-skates | ACME Turbo Skates™ (All-Terrain) | 200 | 891 | — | ✓ |
| /products/earthquake-pills | Seismic Solution Supplements | 200 | 512 | — | ✓ |
| /products/jet-propelled-pogo-stick | JPPS-9000 (Patent Pending) | 200 | 723 | — | ✓ |
| /products/instant-tunnel-kit | Paint-On Passage System v4 | 200 | 445 | — | ✓ |
| /products/dehydrated-boulders | Just-Add-Water Boulder Kit (12-Pack) | 200 | 389 | — | ✓ |
| /about | Our Story (Est. 1949) | 200 | 612 | — | ✓ |
| /contact | Reach Us (Response Not Guaranteed) | 200 | 312 | — | ✓ |
| /warranty | Limited Warranty & Disclaimer | 200 | 89 | — | ✓ |
| /distributors | Authorized Distributors | 200 | 445 | — | ✓ |
| /blog | The ACME Dispatch (Last post: 8 months ago) | 200 | 234 | — | ✓ |
| /blog/top-10-uses-for-anvils | Top 10 Uses for Anvils: A Buyer's Guide | 200 | 1,892 | — | ✓ |
| /blog/physics-of-falling-objects | The Physics of Falling Objects (A Field Study) | 200 | 1,241 | — | ✓ |
| /blog/how-to-catch-a-road-runner | 404 — Page not found (much like the road runner itself) | 404 | — | — | — |
* AI Crawlable reflects robots.txt rules at time of crawl. robots.txt currently blocks GPTBot, ClaudeBot, PerplexityBot, and YouBot — meaning "AI Crawlable" above reflects theoretical access, not actual current indexing.
Current discoverability across the major AI platforms customers use for research and purchasing decisions.
ACME's robots.txt file disallows GPTBot, ClaudeBot, PerplexityBot, and YouBot — the four primary crawlers that feed ChatGPT, Claude, Perplexity, and You.com. This single file is responsible for ACME's complete absence from three of five major AI platforms. Ironically, this is the only ACME product with a 100% success rate.
All 12 product pages (anvils, rocket skates, earthquake pills, JPPS-9000, instant tunnel kits, dehydrated boulders, and more) have zero structured data markup. AI systems cannot identify these as products, extract pricing, compare specifications, or cite them in purchasing recommendations. The homepage has basic Organization schema — but that only tells AI who ACME is, not what ACME sells.
llms.txt is an emerging standard (analogous to robots.txt, but written for AI language models) that lets you summarize your site, describe your products in AI-friendly format, and provide direct context for how AI should represent you. ACME does not have one. This is a missed opportunity to directly shape how AI systems describe ACME products to customers.
This URL returns a 404 error and is linked from at least three internal pages. Prior to its removal, it was ACME's highest-traffic content piece and carried strong topical relevance for the core customer segment. The road runner, as it turns out, has now also eluded your website. Internal links pointing to it are dead weight and may signal poor site quality to crawlers.
Open Graph tags control how ACME pages appear when shared on social platforms and are also used by some AI systems to extract page summaries. None of ACME's 15 accessible pages include og:title, og:description, og:image, or Twitter Card tags. When customers share product pages, they show up as bare URLs with no preview.
The most recent post on The ACME Dispatch was published in July 2025. AI systems (and traditional search engines) favor sites that signal active maintenance. A manufacturer in a niche category like gravity-delivery equipment should be publishing at minimum 1–2 posts per month to remain competitive in AI-generated recommendations.
At 89 words, the warranty page is the thinnest page on the site. While legal confirms the brevity is by design ("all sales final"), AI systems may deprioritize or skip very low word-count pages when building their understanding of a site. The text currently reads, in full: "ACME is not responsible for injuries sustained during normal product use, including but not limited to: anvil impacts, rocket malfunctions, and tunnel-related incidents. Warranty void if product achieves intended purpose."
Meta descriptions are used by search engines and some AI platforms to understand page context before crawling. Nine pages — including all product sub-pages and two blog posts — have none. While not directly impactful on AI indexing, they affect click-through rates from traditional search and are a signal of page-level care.
ACME's About page mentions the founding team but contains no Person schema markup. AI systems use Person schema to build knowledge graph connections between people and organizations — useful for brand authority and "who is behind ACME?" type queries. Currently, the only verified individual linked to ACME in AI knowledge bases is Mr. W.E. Coyote, and he's listed under "customers," not "leadership."
Organized by urgency. Start with Immediate — these two items alone will move your score by an estimated 15–18 points.
Deep Recon provides AI discoverability audits for businesses that want to show up where their customers are searching. As AI assistants become a primary research channel, being findable — and accurately represented — in those systems is no longer optional.
Get Your Audit — $249