llms.txt Generator
Enter your domain. We fetch your real robots.txt and sitemap.xml server-side, show you exactly what we found, and let you review/edit it before generating a spec-compliant llms.txt file.
1. What we found
2. Site details
3. Your llms.txt
Get your full llms.txt file
Unlock the complete file with all your curated pages — copy or download instantly, no account needed.
FAQ
What does this tool actually do?
It fetches your site's real robots.txt and sitemap.xml through a server-side proxy (so your browser never sends cross-origin requests), shows you exactly what it found, and lets you review and edit that list before generating an llms.txt file. Nothing about your site is guessed or invented.
Does it crawl my whole site automatically?
No. It only reads robots.txt and sitemap.xml (following one level of sitemap-index nesting), and optionally fetches the page title and meta description for up to the first 15 URLs it finds. It never invents pages that aren't actually in your sitemap.
What is llms.txt?
llms.txt is a proposed convention (llmstxt.org) for giving AI models and agents a clean, curated Markdown summary of a site — an H1 for the site name, a short blockquote summary, and H2 sections of links. This tool generates a spec-compliant file from real data you've reviewed.
What if my site has no sitemap.xml?
The tool will honestly report that no sitemap was found rather than fabricate one. You can still add page URLs manually before generating your llms.txt.
Is this free, and do I need an account?
Yes, it's free. You can try it and review the fetched data without an account — you only need to enter an email to unlock and download the final generated file.