The llms.txt standard: the official specification, always current

The llms.txt standard describes a Markdown file at /llms.txt that gives AI systems a curated overview of your most important content. Without it, they have to piece the information together from crawled HTML. Below is the official specification, pulled live from the source. When the standard changes there, this section changes too.

The official specification (live)

This is the official llms.txt specification by Jeremy Howard, first published on Sep 3, 2024. It is pulled live from the canonical source and refreshes automatically, so this overview stays in sync with the standard itself.

From the specification: Agents now use websites constantly: a coding agent fetches a library’s documentation to get an API call right, and a chat assistant with search reads pages to answer questions about a product. When this proposal was first written in 2024, this was largely a prediction. Today it is routine. But web pages are built for people. An HTML page wraps its information in navigation, ads, and JavaScript, and converting it back into clean text is difficult and imprecise. Context windows, while larger than they were, are still too small for most websites in their entirety, and every wasted token costs ti…

What the standard covers:

Background  ·  Proposal  ·  Format  ·  Section name  ·  Optional  ·  Existing standards  ·  Example  ·  Docs  ·  Examples  ·  Directories  ·  Integrations  ·  Next steps

Source: the official specification at llmstxt.org, refreshed automatically · last change detected Aug 11, 2026.

Why a standard at all?

Language models draw on website content more and more often. Their context windows are limited, though, and HTML is often full of navigation, ads and JavaScript. llms.txt addresses this, much like robots.txt did for search engines: you provide a concise overview with links, and the model gets the essentials in the order you choose.

Implemented in three steps

1. Create: gather your project name, description and key links, fastest with our llms.txt generator or from ready-made templates.
2. Validate: use the validator to confirm the file is reachable and spec-compliant.
3. Publish & keep current: place the file at your domain root (https://your-domain.com/llms.txt) and update it on major changes. You can also list yourself in the directory.

On freshness: the section above comes automatically from the canonical source. When the standard changes, this page’s date changes too.