llms.txt Explained: Does Your Website Need One?
What llms.txt is, what goes in the file, which AI tools read it today and whether it’s worth adding to your marketing site. Includes a template.
Key takeaways
- llms.txt is a Markdown file at your site’s root that lists your most useful pages for AI tools.
- It was proposed in 2024 and support is still uneven, so treat it as cheap insurance.
- It doesn’t replace robots.txt, your sitemap or well-structured pages.
- Generate it from the same data as your site so it never goes stale.
On this page
You may have seen /llms.txt on developer docs and wondered if your marketing site needs one too. It takes ten minutes to add, so the real question is what it does for you.
The short answer: llms.txt is a short Markdown map of your site for AI tools. Support is uneven, so it won’t change your visibility on its own. Add it if it’s cheap to keep current, and spend most of your effort on the pages themselves.
What llms.txt is
llms.txt is a plain-text file at the root of your domain, written in Markdown. It tells AI tools what your site is about and links to the pages that matter most, with a one-line description each. The format was proposed in September 2024 at llmstxt.org.
What goes in the file
The format is simple: a title, a one-paragraph summary, then sections of links.
# Example
> Example is a billing platform for usage-based AI products.
## Product
- [Pricing](https://example.com/pricing): plans, limits and FAQs
- [How it works](https://example.com/how-it-works): setup in four steps
## Guides
- [Usage-based pricing](https://example.com/guides/usage-pricing): how to price AI features
## Optional
- [Changelog](https://example.com/changelog)
This site has one at /llms.txt, generated from the same data as the pages.
Who reads it today
Some AI coding tools and developer platforms read llms.txt to find documentation. Large AI search engines haven’t committed to using it for ranking or citations. So treat it as a helpful map for the tools that look, and don’t expect it to change what ChatGPT says about you.
llms.txt, robots.txt and sitemap.xml
| File | Who it’s for | What it does |
|---|---|---|
| robots.txt | All crawlers | Says what crawlers may and may not fetch |
| sitemap.xml | Search engines | Lists every page and when it changed |
| llms.txt | AI tools | Summarizes the site and points to the best pages |
You need the first two. The third is optional.
How to add one to Next.js or Astro
Don’t write it by hand. Create a route that builds the file from your page and post data at build time: src/pages/llms.txt.ts in Astro, or a route handler at app/llms.txt/route.ts in Next.js. New articles then appear in it automatically.
For what does move AI visibility, read our guide to AI search optimization and how schema markup helps machines read your pages.
Frequently asked questions
Is llms.txt an official standard?
No. It is a community proposal published at llmstxt.org in 2024. Some AI tools and developer platforms use it, but there is no formal standard behind it.
Does llms.txt improve rankings in ChatGPT or Perplexity?
There is no public evidence that it does. Being crawlable, answering questions clearly and being mentioned on other sites matter much more today.
What is llms-full.txt?
An optional companion file that contains the full text of your key pages in one Markdown document, so a tool can read everything in one request. It’s most useful for documentation sites.
Keep reading
All resources-
AI Search Optimization: How to Get Cited by ChatGPT and Perplexity
What AI search engines look for when they pick sources, and the practical changes that make a SaaS website more likely to be cited in their answers.
-
Schema Markup for SaaS Websites: 6 Types Worth Adding
Which structured data types a SaaS marketing site should add, what each one does for search and AI answers, and JSON-LD examples you can copy.
-
Core Web Vitals for Marketers: What to Fix First
LCP, INP and CLS in plain words: what each one measures, the thresholds Google uses, and the fixes that usually move a marketing site from red to green.
Your website, 1% better every day.
Centipage’s agents find what to improve on your site, make the change and wait for your approval before it goes live.