🎉 v5.6.1 is live: free upgrade for every license key — same 34 tools, same price. Existing buyers get it free. Prices rise as features are added — today is the cheapest day to buy.

25 Indian D2C Sites Checked: All Have llms.txt

23 October 2026 · 7 min read · by Siva Krishna D
We checked 25 Indian D2C sites — 100% have llms.txt, almost none wrote it — GrowKitt research cover

We ran live checks on 25 real Indian D2C websites on 23 October 2026. Every single one has an llms.txt file — but on reading the files, nearly all are auto-generated Shopify boilerplate, not something the brand wrote. Meanwhile only 4% block AI crawlers, just 12% carry FAQ schema, and 64% of homepage titles overflow Google's 60-character display. Platform defaults made Indian D2C 'AI-ready' on paper; the layer that wins AI recommendations is still wide open.

Why we ran this study

Everyone talks about 'AI readiness' and almost nobody publishes checkable numbers for the Indian market. So we picked 25 well-known Indian D2C websites, verified each was live, and ran the same battery of checks our software runs — llms.txt, robots.txt AI-crawler rules, JSON-LD schema types, homepage titles and meta descriptions. Every number below is from a live HTTP check on 23 October 2026, and the raw per-site data is downloadable so you can verify any cell yourself.

Finding 1 — 100% have llms.txt. Almost none of them wrote it.

This floored us, briefly. All 25 sites serve an llms.txt file — which would make India a world leader in llms.txt adoption. Then we opened the files: nearly every one is identical 'Agent Instructions / Shop skill' boilerplate with only the brand name swapped — auto-generated by Shopify for its stores. (We ruled out false positives by checking content types and testing garbage paths on the same domains.)

The real story: Indian D2C brands became 'AI-ready' on paper without a single merchant lifting a finger. Shopify's default file tells AI agents how to browse a catalogue — it does not tell them why anyone should buy from THIS brand, what makes it trustworthy, or which pages matter. The layer that influences AI recommendations is still almost universally missing, and any brand that writes a real one today is ahead of 24 of these 25.

Finding 2 — the door is wide open: only 1 in 25 blocks AI crawlers

Just one site blocks GPTBot in robots.txt; none block PerplexityBot. Contrast with Western publishing, where blocking OpenAI's crawler became common. Indian D2C has decided — mostly by default — to be fully visible to AI engines. That means AI-visibility winners here will be decided by content quality and structured data, not by access. Which brings us to the actual gap:

Finding 3 — the real gap: FAQ schema at 12%, titles failing at 64%

92% of the sites carry some JSON-LD schema and 84% have Organization or Store markup — again, largely platform defaults doing the work. But FAQPage schema — the single strongest 'quote me' signal for AI answers — appears on just 3 of 25 sites. And 64% of homepages have title tags longer than the 60 characters Google displays. The basics are platform-handled; the layer that wins citations is almost untouched.

What this means if you run a business in India

Methodology, limitations and the raw data

Full methodology, the per-site results table and the downloadable CC-BY dataset live on the research page. Honest limitations: n=25 is a pilot and the sample is online-first D2C brands, mostly on Shopify — not representative of Indian SMBs broadly. The full two-cohort study (D2C brands vs traditional service businesses) is in progress; the gap between those two groups is the question we want answered next. Journalists and bloggers: quote any number with a link — that is what the dataset is published for. If you would rather have these exact checks run on YOUR site automatically, that is one job of the 34 tools in the GrowKitt desktop app.

Frequently asked questions

1. What did the study actually check?

Six things per site, live: llms.txt presence and content, robots.txt rules for GPTBot/Google-Extended/PerplexityBot/CCBot, JSON-LD schema types on the homepage, FAQ schema specifically, homepage title length, and meta description presence.

2. Why do all 25 sites have llms.txt?

Because Shopify auto-generates one for every store it hosts. The files are near-identical 'Agent Instructions' boilerplate — platform defaults, not deliberate AI strategy by the brands.

3. Is auto-generated llms.txt bad?

It is better than nothing — it confirms the file location works. But it describes how to browse a catalogue, not why your brand deserves recommending. A hand-written file that states your facts, strengths and key pages is what the generic version cannot do.

4. Which sites were checked?

25 well-known Indian D2C brand websites, live-verified before checking. The full list with per-site results is in the downloadable dataset on our research page — we publish names because every check is reproducible in a browser.

5. Can I verify the numbers myself?

Yes — that is the point. Visit any listed site's /llms.txt and /robots.txt in a browser, or view-source for schema. The raw JSON on the research page gives our recorded result for every site and check.

6. Does blocking GPTBot hurt or help a business?

For most businesses that want customers, blocking AI crawlers means being absent from answers customers increasingly trust. Media companies have licensing reasons to block; a D2C brand usually has every reason to be readable.

7. What is the single fastest fix from this study?

Title tags — 64% of homepages overflow the 60-character display. It takes minutes, and it changes how you appear in both Google results and AI citations. FAQ schema is the second: only 12% have it.

8. When is the full study coming?

The two-cohort version — roughly 200 sites, D2C brands versus traditional service SMBs with a documented sampling method — is in progress. Subscribe to the RSS feed or check the research page for the release.

Related reading

What is llms.txt? A Plain-Words Guide for 2026

AEO · 6 min read

How to Rank in Google AI Overviews (2026 Guide)

AI Visibility · 9 min read

How to Do SEO Yourself — No Agency Needed

SEO · 10 min read

Share:WhatsAppLinkedInX
✍️

Siva Krishna D

GrowKitt Director & Developer · Pooja Soft Solutions, Ongole · about the author

The tools behind this study

GrowKitt's Bulk Site Audit and llms.txt Generator run these checks — and write the fixes — for any site. One payment from ₹9,999, free 7-day trial.

See pricing →