What is llms.txt?

By the Variask team · Updated

Definition

llms.txt is a proposed standard: a markdown file at the root of a website that gives AI models a short summary of the site and links to its most useful pages.

With Variask: The free Variask llms.txt generator builds one from your site in seconds.

What goes in it

  • A heading with your brand name and a one line summary.
  • Short sections that link to key pages, such as product, pricing, docs and policies.
  • Optionally, an llms-full.txt with the full text of those pages.

What it means for brands

  • It is cheap to add and helps assistants that read it, though not every AI engine uses it yet.
Deep dive in Variask UniversityWhat is llms.txt, and do you need one?

Questions

llms.txt:
common questions

No. It is optional and support varies. It complements, not replaces, good HTML, sitemaps and structured data.

Related terms

Keep exploring

Technical

robots.txt

robots.txt is a text file at the root of a website that tells crawlers, including AI crawlers, which parts of the site they may or may not visit.

Read

Technical

AI crawlers

AI crawlers are bots run by AI companies that visit websites to collect content, either to train models or to fetch pages live when an assistant answers a question.

Read

Technical

Structured data

Structured data is code added to a page, usually JSON-LD using the Schema.org vocabulary, that describes its content in a machine readable way, such as a product's price, an article's author or a company's logo.

Read
Full glossary