What is llms.txt?
llms.txt (LLM ingestion convention)
Definition, formula, India benchmarks, and the operator-grade nuance behind it.
llms.txt is a file at /llms.txt following llmstxt.org convention — a Markdown index of a site's high-value pages, designed for LLM crawlers. Helps AI engines understand site structure and find canonical sources without scraping HTML. Frameleads ships /llms.txt + /llms-full.txt.
llms.txt = Markdown index for LLM crawlers, per llmstxt.org.
Curate top pages per topic; cap at 5,000 lines.
Frameleads ships both /llms.txt and /llms-full.txt.
llms.txt is a Markdown file at site root indexing key pages with H2 sections per topic, used by LLM crawlers to understand site structure.
/llms.txt: H1 brand + H2 sections per topic + bullet links to canonical pagesThe operator's read on llms.txt
llms.txt is the emerging standard for LLM-friendly indexing. /llms.txt is the curated index; /llms-full.txt inlines content for direct ingestion. Beyond 5,000 lines, split into per-tier sub-indices (/llms/services.txt, /llms/glossary.txt, etc.). LLM crawlers respect llms.txt voluntarily — Anthropic, Perplexity adoption growing fast in 2026. Frameleads' /llms.txt and /llms-full.txt are already shipped.
India 2026 benchmarks — llms.txt
- llms.txt cap: 5,000 lines per file
- Sub-indices recommended at 80%+ of cap
- Adoption rate (LLM crawlers respecting): 40–60% in 2026
- Frameleads /llms.txt monthly fetch count: tracked via Cloudflare logs
- Cited brands per /llms.txt index entry: typically 1–3 LLMs
Common mistakes to avoid
- Stuffing /llms.txt with low-value pages (signal dilution).
- Not maintaining freshness (stale entries).
- No /llms-full.txt to complement (loses RAG opportunity).
- Wrong character set or encoding.
Frequently asked questions
What's a typical llms.txt value in India?
India 2026 benchmarks vary by category: llms.txt cap: 5,000 lines per file; Sub-indices recommended at 80%+ of cap; Adoption rate (LLM crawlers respecting): 40–60% in 2026. Bands compress in saturated CPM regimes and widen as products move from impulse to considered. The right benchmark for your business depends on stage, gross margin, and channel mix.
What are the most common mistakes when tracking llms.txt?
Three mistakes recur most often: Stuffing /llms.txt with low-value pages (signal dilution).; Not maintaining freshness (stale entries).; No /llms-full.txt to complement (loses RAG opportunity).. The simplest defense is to define each metric explicitly in your reporting playbook and avoid mixing definitions across teams.
How does llms.txt relate to other unit-economics metrics?
llms.txt is most useful in context. Pair it with GEO and ROBOTS-TXT to build a complete picture. llms.txt alone can mislead — the relationship between metrics matters more than any single number.
Should I optimize llms.txt or accept industry-standard values?
Optimization depends on your stage. Early-stage businesses often have llms.txt values outside healthy bands and need to fix structural issues (audience, creative, retention) before chasing the metric. Established businesses can compound through marginal improvements. Frameleads' Growth System maps which lever moves which metric in your specific category.
How llms.txt behaves per industry
llms.txt is a universal metric, but its band, drivers, and optimisation levers vary by category. Drill into the industry-specific version below for the deep view.
- llms.txt for Real Estate DevelopersCAC 3,500–35,000 ₹ · CPC 40–280 ₹Open
- llms.txt for D2C BrandsCAC 250–2,200 ₹ · CPC 8–60 ₹Open
- llms.txt for B2B SaaS StartupsCAC 15,000–3,00,000 ₹ · CPC 50–1,200 ₹Open
- llms.txt for Healthcare Clinics & HospitalsCAC 500–15,000 ₹ · CPC 15–250 ₹Open
- llms.txt for Education & EdTechCAC 400–4,500 ₹ · CPC 12–160 ₹Open
- llms.txt for Financial ServicesCAC 1,500–20,000 ₹ · CPC 30–950 ₹Open
- llms.txt for Professional ServicesCAC 800–12,000 ₹ · CPC 20–500 ₹Open
- llms.txt for Restaurants, Cafes & Cloud KitchensCAC 150–2,500 ₹ · CPC 8–120 ₹Open
- llms.txt for Fashion & Apparel D2CCAC 200–1,200 ₹ · CPC 10–55 ₹Open
- llms.txt for Gyms, Studios & Fitness AppsCAC 250–1,800 ₹ · CPC 12–80 ₹Open
- llms.txt for Automotive Dealers & OEMsCAC 600–4,500 ₹ · CPC 18–120 ₹Open
- llms.txt for Manufacturing & MSMEsCAC 3,000–35,000 ₹ · CPC 25–220 ₹Open
Questions about llms.txt
Long-form guides on related topics
Pair this with
Sources & references
Cited primary and analyst sources. Independent of Frameleads' own data.
- IBEF — India Brand Equity Foundation: Indian Industry Reports — IBEF (Ministry of Commerce & Industry)
Sector-level market size, growth, and policy context for Indian industries.
- IAMAI — Internet & Mobile Association of India — IAMAI
Digital advertising industry body; reports on India internet user base, ad spend, and platform shares.
- MoSPI — Ministry of Statistics and Programme Implementation — Government of India
Primary source for India macro-economic indicators (CPI, GDP, household consumption).
- ASCI Code for Self-Regulation of Advertising in India — Advertising Standards Council of India
Mandatory baseline for all advertising claims in India — including digital, influencer, and comparative ads.
Talk to a senior Frameleads operator.
Bring your hardest growth question. We'll give you a sharp, no-pitch 30-minute consult.