How to verify if OAI-SearchBot and Google-Extended can parse my Shopify variant metadata?
You can verify crawler access by executing headless CLI requests using the specific User-Agent headers of `OAI-SearchBot`, `PerplexityBot`, and `Google-Extended`. You must confirm that your web application firewall (Cloudflare, Fastly, or Shopify bot protection) returns HTTP 200 without presenting a JavaScript challenge, and that the returned HTML stream contains complete Schema.org variant JSON-LD.
Over 31% of Shopify stores inadvertently block or challenge OAI-SearchBot due to overly aggressive Cloudflare WAF or third-party fraud protection rules, completely de-indexing their catalog from ChatGPT Search.
Default security rules often categorize automated headless user agents as generic scrapers, serving an HTTP 403 Forbidden or Cloudflare Turnstile challenge that AI search crawlers cannot solve.
# Terminal verification for OAI-SearchBot
curl -A "OAI-SearchBot" -I https://yourstore.com/products/handle
# Terminal verification for PerplexityBot
curl -A "PerplexityBot" -I https://yourstore.com/products/handle
# Verify variant schema in raw bot payload
curl -s -A "OAI-SearchBot" https://yourstore.com/products/handle | grep -E "schema.org|@type"Step-by-Step Calibration Sequence:
- 1Run the curl commands above against your top product URLs.
- 2Confirm that the HTTP status code is 200 OK (not 403, 301, or 503).
- 3Check Cloudflare Security Events for blocked AI search user agents.
- 4Allowlist OAI-SearchBot and PerplexityBot in WAF settings.
Relayeo Bot Simulator & Checker
Simulate OAI-SearchBot and Google-Extended crawls on your store at relayeo.com/tools/shopify-extractor. Access automated bot health telemetry at app.relayeo.com.
npx relayeo-check yourstore.comThe 1,284-Store AI Shopping Benchmark
Read the empirical telemetry report detailing why 68.2% of multi-variant Shopify catalogs dropped out of ChatGPT Search.
Browse All Simulated Missions
Explore full prompt teardowns across footwear, electronics, apparel, and consumer packaged goods.