SEO & AI search

llms.txt Explained: Does Your Website Need One?

What llms.txt is, what goes in the file, which AI tools read it today and whether it’s worth adding to your marketing site. Includes a template.

llms.txt Explained: Does Your Website Need One?

Key takeaways

  • llms.txt is a Markdown file at your site’s root that lists your most useful pages for AI tools.
  • It was proposed in 2024 and support is still uneven, so treat it as cheap insurance.
  • It doesn’t replace robots.txt, your sitemap or well-structured pages.
  • Generate it from the same data as your site so it never goes stale.
On this page
  1. What llms.txt is
  2. What goes in the file
  3. Who reads it today
  4. llms.txt, robots.txt and sitemap.xml
  5. How to add one to Next.js or Astro

You may have seen /llms.txt on developer docs and wondered if your marketing site needs one too. It takes ten minutes to add, so the real question is what it does for you.

The short answer: llms.txt is a short Markdown map of your site for AI tools. Support is uneven, so it won’t change your visibility on its own. Add it if it’s cheap to keep current, and spend most of your effort on the pages themselves.

What llms.txt is

llms.txt is a plain-text file at the root of your domain, written in Markdown. It tells AI tools what your site is about and links to the pages that matter most, with a one-line description each. The format was proposed in September 2024 at llmstxt.org.

What goes in the file

The format is simple: a title, a one-paragraph summary, then sections of links.

# Example

> Example is a billing platform for usage-based AI products.

## Product
- [Pricing](https://example.com/pricing): plans, limits and FAQs
- [How it works](https://example.com/how-it-works): setup in four steps

## Guides
- [Usage-based pricing](https://example.com/guides/usage-pricing): how to price AI features

## Optional
- [Changelog](https://example.com/changelog)

This site has one at /llms.txt, generated from the same data as the pages.

Who reads it today

Some AI coding tools and developer platforms read llms.txt to find documentation. Large AI search engines haven’t committed to using it for ranking or citations. So treat it as a helpful map for the tools that look, and don’t expect it to change what ChatGPT says about you.

llms.txt, robots.txt and sitemap.xml

File Who it’s for What it does
robots.txt All crawlers Says what crawlers may and may not fetch
sitemap.xml Search engines Lists every page and when it changed
llms.txt AI tools Summarizes the site and points to the best pages

You need the first two. The third is optional.

How to add one to Next.js or Astro

Don’t write it by hand. Create a route that builds the file from your page and post data at build time: src/pages/llms.txt.ts in Astro, or a route handler at app/llms.txt/route.ts in Next.js. New articles then appear in it automatically.

For what does move AI visibility, read our guide to AI search optimization and how schema markup helps machines read your pages.

Frequently asked questions

Is llms.txt an official standard?

No. It is a community proposal published at llmstxt.org in 2024. Some AI tools and developer platforms use it, but there is no formal standard behind it.

Does llms.txt improve rankings in ChatGPT or Perplexity?

There is no public evidence that it does. Being crawlable, answering questions clearly and being mentioned on other sites matter much more today.

What is llms-full.txt?

An optional companion file that contains the full text of your key pages in one Markdown document, so a tool can read everything in one request. It’s most useful for documentation sites.

Nik Zechner

Founder of Centipage. For 8 years he has designed and shipped websites for startups like Digimarc, Almetra AI and MarvelX. Why he’s building Centipage.

Your website, 1% better every day.

Centipage’s agents find what to improve on your site, make the change and wait for your approval before it goes live.