What is llms.txt?
llms.txt is a markdown file placed at /llms.txt that gives AI assistants, large language models, and agentic browsers a curated map of your most useful pages. It is not a crawl-control file like robots.txt and it is not a full search index like sitemap.xml. It is a concise, human-readable guide to the content you most want AI systems to understand.
A strong llms.txt file usually includes a project title, a short summary, useful context, and grouped links to documentation, product pages, policies, articles, or support pages. The format is still an emerging convention, but it is simple to publish and easy to keep updated.
What is an llms.txt generator?
An llms.txt generator creates the /llms.txt file that large language models use to understand your website. Instead of writing it by hand, you enter your domain and the generator reads your sitemap, collects your real pages and their metadata, organizes them into sections, and produces a ready-to-use file that follows the llmstxt.org specification. A valid file is also one of the signals in Lighthouse's experimental Agentic Browsing audit for AI-agent readiness.
How to generate an llms.txt file
- Enter your domain. Type your website domain. Optionally add custom sitemap URLs.
- Generate. We crawl your sitemap, read page metadata, and group pages into sections.
- Review and edit. Edit the project name, summary, and link notes; validation updates live.
- Download llms.txt. Copy or download the file and place it at the root of your site as /llms.txt.
Why this generator is different
Grounded in real URLs
Every link comes from a page found on your site. The generator never invents URLs.
Sitemap-aware
Reads robots.txt and sitemap.xml, with custom sitemap input and homepage fallback.
English, no mixed languages
Skips localized duplicates so your llms.txt stays focused and clean.
Editable + live validation
Tune the result in the browser; it re-validates against the spec as you type.
Copy or download
Export a ready llms.txt and place it at the root of your site.
Validator included
Already have a file? Open the Validator tab to check structure and links.
llms.txt vs robots.txt vs sitemap.xml
llms.txt
A curated markdown guide for AI tools and language models.
robots.txt
Crawl access rules for bots. It controls access, not context.
sitemap.xml
A URL inventory for search engines. It lists pages, not why they matter.
Where to publish llms.txt
Publish the file at the root of your domain so it is available at https://yourdomain.com/llms.txt. For framework projects, this usually means placing llms.txt in the public/static folder and deploying it with the rest of your site.
llms.txt guides and examples
Examples
Sample llms.txt files for SaaS, ecommerce, documentation, and blogs.
Template and format
Copy a valid starter template and learn the recommended markdown structure.
llms.txt vs robots.txt
Understand how llms.txt, robots.txt, and sitemap.xml work together.
WordPress
Add llms.txt to a WordPress site and validate the final URL.
Shopify
Create llms.txt for product pages, collections, and policies.
Next.js and Vercel
Publish llms.txt from a public folder and deploy it at the root.
Validator tab
The validator follows the structure defined in the specification. Use the Validator tab above to fetch a live file by URL or paste existing content. It checks required sections, formatting, suggestions, live preview, and optional link health.
- Choose your input. Pick URL Input to fetch a live /llms.txt, or Text Input to paste your file.
- Enter your content. Type your domain or paste your llms.txt content into the validator.
- Validate. Press Validate to run the validator against the llmstxt.org specification.
- Review results. Read the per-rule checks, link statuses, and improvement suggestions.
- Fix and revalidate. Apply the suggestions and run the validator again to confirm a clean result.
Sample llms.txt template
A minimal valid file looks like this:
# Title > Optional description goes here Optional details go here ## Section name - [Link title](https://link_url): Optional link details ## Optional - [Link title](https://link_url)
Add a “valid llms.txt” badge
Show that your llms.txt is valid and link back to a live check. Paste this into your README and replace YOURDOMAIN:
[](https://llmstxtgenerator.app/llms-txt-validator)
Or as HTML:
<a href="https://llmstxtgenerator.app/llms-txt-validator"><img src="https://llmstxtgenerator.app/api/badge?url=YOURDOMAIN" alt="llms.txt"></a>
Live example:
Frequently asked questions
What is an llms.txt generator?
An llms.txt generator creates a spec-compliant llms.txt file for your website. This generator crawls your sitemap, reads your real page metadata, groups the pages into sections, and assembles a ready-to-use llms.txt.
Does the generator invent URLs?
No. Every link in the generated file comes from a page that was actually found on your site. The generator is grounded in your real sitemap and never fabricates URLs.
How does the generator find my pages?
It reads your robots.txt and sitemap.xml (and common alternate sitemap locations), falling back to links on your homepage. You can also paste one or more custom sitemap URLs.
What if my site is multilingual?
The generator keeps English pages by default and skips localized duplicates (for example /ar/ or /es/ paths), so your llms.txt stays focused and doesn't mix languages.
Can I edit the result before downloading?
Yes. The generated llms.txt is fully editable in the browser and re-validated live as you type. When you're happy, copy it or download the llms.txt file.
Is the llms.txt generator free?
Yes, it is free to use. Large sites are capped for speed and fair use.
What is an llms.txt file?
An llms.txt file is a markdown file placed at the root of your website (/llms.txt) that gives large language models a concise, curated map of your most useful content. It is an emerging standard defined at llmstxt.org.
Is llms.txt required for my website?
No. It is an optional, emerging standard. It is most useful for documentation-heavy sites, products, and any site you want LLMs and AI agents to understand accurately.
Where should the llms.txt file live?
At the root of your domain, served at /llms.txt as plain text or markdown. Subpath hosting is also allowed by the specification.