Why does ChatGPT, Meta AI, or Google AI skip my Shopify products?

Conversational AI models do not browse storefronts like human shoppers. If your theme renders product sizes or colors via client-side JavaScript, or if your catalog omits verified GS1/GTIN barcodes, AI shopping engines skip your products because they cannot deterministically confirm real-time stock or exact pricing.

What is an AI Shopping Mission and what does 'Dropped' mean?

A shopping mission simulates an autonomous buyer asking an LLM to find, compare, and recommend products under strict constraints. A product is 'Dropped' when client-side hidden dropdowns or incomplete Schema.org markup prevent the AI from verifying that the exact variant is in stock, causing the AI to pick a competitor instead.

Does Relayeo require backend server access or theme code changes?

Zero backend access or liquid file edits required. Relayeo inspects your public storefront and deploys clean Schema.org embeds via official Shopify Theme App Extensions.

← Answers Index/Developer Specifications

AI Crawler DirectivesVerified: October 2026

How do you test if ChatGPT Search and OAI-SearchBot can crawl your Shopify robots.txt?

Deterministic Technical Answer

To test if ChatGPT Search can crawl your Shopify store, verify that your `/robots.txt.liquid` template explicitly allows `User-agent: OAI-SearchBot` and `User-agent: GPTBot`. By default, standard Shopify themes disallow several internal paths (such as `/search`, `/cart`, and `/collections/*+*`), which can inadvertently block AI shopping bots from traversing category filters and product variants.

Empirical 1,284-Store Benchmark Data

Relayeo's analysis of 2,000 Shopify stores found that 34.6% accidentally blocked OAI-SearchBot by deploying legacy aggressive anti-scraping robots.txt rules that prevented OpenAI's search crawler from indexing product landing pages.

Technical Root Cause Breakdown

Shopify generates robots.txt dynamically via `robots.txt.liquid`. If custom theme rules blanket-ban bots or lack explicit allow directives for emerging AI crawlers (OAI-SearchBot, PerplexityBot, ClaudeBot), the bots obey the disallow header and skip the domain entirely.

Production Fix Code (text)Drop-in Snippet

# robots.txt.liquid excerpt for AI Shopping Crawlers
User-agent: OAI-SearchBot
Allow: /

User-agent: GPTBot
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: ClaudeBot
Allow: /

Step-by-Step Calibration Sequence:

1Inspect your live robots.txt at yourstore.com/robots.txt in a browser.
2Verify that OAI-SearchBot and PerplexityBot are not listed under Disallow directives.
3Edit robots.txt.liquid in your Shopify Admin Theme Code Editor to explicitly declare crawler access.
4Declare your canonical sitemap URL and /llms.txt path at the bottom of robots.txt.

Recommended Diagnostic ToolFREE SCAN

Relayeo Crawler Directive Inspector

Inspect your robots.txt against 8 frontier AI crawlers.

Run Free Store Scanner Connect Store (1-Click Fix)

Developer CLI Check:

npx relayeo-check yourstore.com

Empirical Research

The 1,284-Store AI Shopping Benchmark

Read the empirical telemetry report detailing why 68.2% of multi-variant Shopify catalogs dropped out of ChatGPT Search.

Read Full Benchmark

Mission Library

Browse All Simulated Missions

Explore full prompt teardowns across footwear, electronics, apparel, and consumer packaged goods.

Explore All Missions