Let AI answer engines in, keep training bots out
Tick the crawlers you want to allow or block, set your Content-Signal, and copy the result. Pick Shopify to get a robots.txt.liquid template that keeps Shopify's default rules for cart, checkout and account pages.
Some links may earn us a commission at no cost to you. Drafted with AI, checked by a human. How we earn.
Your file
From the guides
Related guides
FAQ
Which AI bots should an online store allow?
The ones that put you in answers: OAI-SearchBot for ChatGPT search, Claude-SearchBot, PerplexityBot, plus the user-fetch agents (ChatGPT-User, Claude-User, Perplexity-User) that open a page when a shopper asks. Blocking them can remove the store from those answers.
Does blocking GPTBot or ClaudeBot hurt my visibility?
OpenAI and Anthropic both document separate crawlers for training and for search, so blocking the training crawler is meant to keep content out of model training without removing the site from their search results.
What is Content-Signal?
A robots.txt line that states your preferences in three parts: search, ai-input (using content in AI answers) and ai-train (training models). It sits inside the User-agent: * group. It states a preference; it does not technically block anyone, which is why the generator also writes Disallow groups.
How do I edit robots.txt on Shopify?
In the theme code editor, add a robots.txt.liquid template. Adding it replaces Shopify's generated file, so the template here keeps Shopify's default rules loop and adds your lines to it. Save a copy of your current /robots.txt before you publish.
Is robots.txt enforced?
No. Reputable crawlers follow it; others may not. Use your firewall or bot-protection settings for anything that must be enforced.