llms.txt Generator
Crawl your site, get a spec-correct llms.txt. Takes about a minute.
`llms.txt` is a proposed convention: a markdown file at your site root that tells an AI agent which of your pages matter and what each one covers. It is not a standard, it is not universally read, and publishing one is not a growth strategy.
We built the generator because the file takes a minute to produce and costs nothing to serve. We'd rather you spend the ten minutes it saves on something that moves the needle.
Where it actually stands, as of September 2026
Anthropic and Perplexity appear to read it. Google does not — Gemini and Google-Extended show no visible response, and Google's stated preference is robots.txt and structured data. OpenAI has made no public commitment. Reported citation uplift is modest, and most of the reporting comes from companies selling generative-engine-optimisation services. Including, to be fair, us.
Finds your pages the way an agent would.
Sitemap first, link crawl as a fallback. If neither works, you have a bigger problem and we'll tell you what it is.
Writes one line per page.
Pulled from your own meta descriptions and opening sentences. Where those are missing or boilerplate, we write a replacement.
Groups them into sections you can edit.
Toggle sections in or out and the file regenerates. The Optional section is for links an agent can safely skip.
Generates llms-full.txt too.
The concatenated full text of your key pages. This one is a common convention rather than part of the spec — we've labelled it as such rather than implying it's official.
llms.txt is the easy part. The things that actually block AI crawlers are harder to see.
FAQ
Will publishing llms.txt get me cited by ChatGPT?
Probably not on its own, and we're not going to tell you otherwise. If an AI crawler is blocked at your CDN, or your content only renders in JavaScript, llms.txt changes nothing at all — the crawler still can't read the pages it points at. Fix those first. Then publish this, because it costs nothing.
Is llms.txt an official standard?
No. It's a proposal that has picked up real but partial adoption. Anthropic and Perplexity appear to use it, Google doesn't, OpenAI hasn't said. Treat it as a low-cost bet, not a requirement.
What's the difference between llms.txt and llms-full.txt?
`llms.txt` is an index — links with one-line descriptions. `llms-full.txt` is the actual content of those pages concatenated into one file. Only the first is described in the proposal; the second is a convention people have converged on.
Where do I put the file?
At your root: yourdomain.com/llms.txt, served as text/plain. On WordPress this usually needs a rewrite rule or a genuinely static file — most page builders can't create root-level files for you.