Updated
Updated What changed on
- Corrected the heading structure. The summary heading was an h3 sitting directly after the h1, which skipped a level and gave screen readers a broken page outline. No wording changed.
Picking an llms.txt tool depends on your stack, not on which is "best".
Quick answer: on WordPress use AIOSEO or Yoast, on hosted docs use Mintlify or Fern, on a static site use your generator's plugin, and for anything else use Firecrawl's free generator - then validate at llmstxtvalidator.dev. That covers most sites. The longer answer depends on your stack, which is why this list runs to 22 tools - WP plugins, docs platforms, static-site plugins, developer libraries and web generators - with the one detail most lists skip: whether each ships llms-full.txt as well.
- Fetched by
ChatGPT
Claude
Gemini
Perplexity
Honest framing: llms.txt is currently low-effort, low-confirmed-impact for marketing sites. Documentation, API and large content sites benefit most. Spend 30 minutes generating one, hand-edit to remove noise, validate at llmstxtvalidator.dev, ship it and move on. Do not treat it as a lever big enough to plan a quarter around - schema is the heavier extraction lever. New to the file itself? Start with what llms.txt is and how the format works.
- Yoast brought llms.txt to Shopify (March 2026) - the main SEO-suite route on Shopify, alongside standalone generator apps in the Shopify App Store. WordPress Yoast still ships it free in the regular plugin.
- Profound shared llms-full.txt fetch data - AI agents pull llms-full.txt at over 2x the rate of llms.txt, picked up by the Mintlify platforms review. Sites with only llms.txt are leaving the file AI actually wants on the table.
- Fern published their analytics - serving markdown to detected LLM bots cuts token costs ~90% versus serving HTML. Currently the only docs platform offering analytics broken down by LLM provider.
- Google has still not officially committed to using llms.txt as of mid-2026. Treat as low-cost experiment, not confirmed signal.
The 30-second pick
WordPress? AIOSEO if you already run it, otherwise Yoast. For both files, the standalone LLMs.txt and LLMs-full.txt Generator plugin. Shopify? Yoast for Shopify. Hosted docs? Mintlify if you can move, otherwise stay where you are and check the comparison table. Static site? Pick the plugin for your generator (Docusaurus, Astro, MkDocs, VitePress and Sphinx all have working ones). Custom Laravel / PHP? stolt/llms-txt-php. None of the above? Firecrawl as a starter, then hand-edit. Validate everything at llmstxtvalidator.dev.
22 tools, compared at a glance.
| Tool | Category | llms-full.txt | Pricing | Best for |
|---|---|---|---|---|
| AIOSEO llms.txt | WordPress | Manual add | Free + paid | WordPress sites already on AIOSEO |
| Yoast SEO llms.txt | WordPress | No | Free in Yoast SEO | WordPress sites already on Yoast (and Shopify, as of March 2026) |
| Rank Math llms.txt | WordPress | No | Free in Rank Math | WordPress sites on Rank Math |
| WordLift llms.txt | WordPress | No | Free generator, paid plans from $879/mo | Large content libraries that need curation, not just dump |
| LLMs.txt and LLMs-full.txt Generator (WP plugin) | WordPress | Yes | Free | WordPress sites that need both files and are not on AIOSEO / Yoast / Rank Math |
| Mintlify | Docs platform | Yes | Free tier + paid | Hosted documentation, zero-config setup |
| Fern | Docs platform | Yes | From $400/mo | API documentation where you need bot-specific delivery |
| GitBook | Docs platform | Yes | Free tier + paid | Teams already on GitBook for docs |
| ReadMe | Docs platform | No | Free + paid | Interactive API docs with basic llms.txt |
| Redocly | Docs platform | No | Paid | OpenAPI-first docs |
| Scalar | Docs platform | Manual | Free, open source + paid cloud | OpenAPI-first teams happy to wire the file up themselves |
| Fumadocs | Docs platform | Manual | Free, open source | Next.js docs where you own the code |
| Docusaurus plugin (docusaurus-plugin-llms) | Static site plugin | Yes | Free, open source | Docusaurus-based docs sites |
| Astro Starlight (starlight-llms-txt) | Static site plugin | Yes | Free, open source | Astro Starlight documentation |
| MkDocs / VitePress plugins | Static site plugin | Yes | Free, open source | Python (MkDocs) or Vue (VitePress) docs |
| Sphinx / Read the Docs (sphinx-llms-txt) | Static site plugin | Yes | Free, open source | Python projects documenting with Sphinx |
| llms-txt-php (Composer package) | Developer library | Manual | Free, MIT | Laravel and PHP apps wanting programmatic generation |
| Firecrawl llms.txt Generator | Web generator | Yes | Free | Quick one-off llms.txt from any URL |
| LLMrefs Free Generator | Web generator | No | Free | Quick browser-based draft from a URL |
| LLMTEXT (Parallel.ai) | Web generator | Not stated | Free, open source | Sitemap-driven generation with a built-in validator |
| llms.txt Validator | Validator | Validates both | Free | Catching malformed entries before you deploy |
| AI Schema Validator (Jason Burns tools) | Validator | n/a | Free | Confirming the pages your llms.txt points at are actually AI-extractable |
WordPress
Five plugins for WP sites. If you already run AIOSEO, Yoast or Rank Math, use what is in your stack. Switch generator only if you need llms-full.txt and your current SEO plugin does not ship it.
AIOSEO llms.txt Manual add
Free + paidBest for: WordPress sites already on AIOSEO
One-click llms.txt generation inside the AIOSEO plugin. The cleanest WP path for sites already on AIOSEO. Auto-respects existing noindex / nofollow settings, which most standalone WP generators do not.
Yoast SEO llms.txt llms.txt only
Free in Yoast SEOBest for: WordPress sites already on Yoast (and Shopify, as of March 2026)
Free in the regular Yoast plugin, no Premium upgrade needed. Yoast SEO for Shopify added the same toggle in March 2026 - the main SEO-suite route on Shopify, though standalone llms.txt generator apps also exist in the Shopify App Store.
Rank Math llms.txt llms.txt only
Free in Rank MathBest for: WordPress sites on Rank Math
Equivalent toggle inside the Rank Math plugin. Slightly more configurable than Yoast on which post types feed the file. If Rank Math is already installed, do not bolt on a second generator.
WordLift llms.txt llms.txt only
Free generator, paid plans from $879/moBest for: Large content libraries that need curation, not just dump
WordLift will analyse content and pick the strongest evergreen URLs rather than listing everything. Useful if your site has thousands of posts and you do not want every category page in the file. The free standalone generator is fine; the $879/mo plan is only worth it for enterprise content ops.
LLMs.txt and LLMs-full.txt Generator (WP plugin) llms-full.txt
FreeBest for: WordPress sites that need both files and are not on AIOSEO / Yoast / Rank Math
One of the few WP plugins that ships llms-full.txt as well as llms.txt. Worth knowing because most WP options skip llms-full.txt entirely and that is the file AI agents fetch more often (see Profound data below).
Docs platform
Docs platforms and frameworks. Mintlify, Fern, GitBook and ReadMe auto-generate; Scalar and Fumadocs make you build the file yourself. Pick by where the docs already live; do not switch platform just for llms.txt.
Mintlify llms-full.txt
Free tier + paidBest for: Hosted documentation, zero-config setup
Auto-generates llms.txt, llms-full.txt and a .md version of every page with no config. If your docs are already on Mintlify, there is literally nothing to do. Mintlify also publish the strongest comparison piece on the wider docs-platform landscape.
Fern llms-full.txt
From $400/moBest for: API documentation where you need bot-specific delivery
Auto-generates both files, detects LLM bot traffic, serves markdown instead of HTML to those bots (Fern claim 90%+ token reduction). Content tags like <llms-only> and <llms-ignore> give per-block control. Heavier price tag, but the only platform offering analytics by LLM provider.
GitBook llms-full.txt
Free tier + paidBest for: Teams already on GitBook for docs
One-click toggle exposes both files. No granular content controls, no LLM-specific analytics. Solid low-friction option if GitBook is where the docs already live.
ReadMe llms.txt only
Free + paidBest for: Interactive API docs with basic llms.txt
Toggle on in settings. Append .md to any page URL for a markdown version. Does NOT generate llms-full.txt and offers no AI-specific analytics. Fine if you already use ReadMe; not a reason to switch to it.
Redocly llms.txt only
PaidBest for: OpenAPI-first docs
Toggle-based llms.txt support. No llms-full.txt. Worth knowing: Redocly have publicly argued llms.txt is overhyped and are putting their effort into MCP server support instead. Picked because of OpenAPI strength, not because of AI features. If AI discoverability is your reason for choosing a docs platform, Mintlify, Fern or GitBook all do more.
Scalar Manual
Free, open source + paid cloudBest for: OpenAPI-first teams happy to wire the file up themselves
Generates interactive API references from OpenAPI specs and has tooling for converting them to LLM-readable markdown. No automatic llms.txt generation though - you configure the routes and keep the file in sync yourself. Building blocks, not a toggle.
Fumadocs Manual
Free, open sourceBest for: Next.js docs where you own the code
Docs framework for Next.js. You can add middleware that detects AI agents and serves markdown, but llms.txt and llms-full.txt need custom route handlers you build and maintain. Full control, zero automation. Fine if that trade suits your team.
Static site plugin
Build-time plugins for static-site generators. Install, configure, ship. Stable, free, low ceremony.
Docusaurus plugin (docusaurus-plugin-llms) llms-full.txt
Free, open sourceBest for: Docusaurus-based docs sites
Generates llms.txt, llms-full.txt and per-page .md files. Batch processing handles large sites. Install via npm, configure in docusaurus.config.js. The most complete of the three community plugins.
Astro Starlight (starlight-llms-txt) llms-full.txt
Free, open sourceBest for: Astro Starlight documentation
Generates llms.txt, llms-full.txt and a llms-small.txt for cheaper token contexts. Per-page .md exposure. Active, well-maintained plugin.
MkDocs / VitePress plugins llms-full.txt
Free, open sourceBest for: Python (MkDocs) or Vue (VitePress) docs
mkdocs-llmstxt and vitepress-plugin-llms both generate llms.txt and llms-full.txt during build. Hugo has no dedicated plugin but its output format system makes it a 30-minute custom config job. Eleventy (eleventy-plugin-llms-txt) and Gatsby (gatsby-plugin-llms-txt) have plugins too, but both are llms.txt only.
Sphinx / Read the Docs (sphinx-llms-txt) llms-full.txt
Free, open sourceBest for: Python projects documenting with Sphinx
sphinx-llms-txt generates llms.txt with zero configuration. If the docs are hosted on Read the Docs, the platform also serves llms.txt and llms-full.txt from your default version automatically - no plugin needed. The lowest-effort option on this whole list for Python docs.
Developer library
Programmatic generation for custom apps and CMS-driven sites where the file needs to update with content.
llms-txt-php (Composer package) Manual
Free, MITBest for: Laravel and PHP apps wanting programmatic generation
stolt/llms-txt-php. Use when llms.txt needs to update on content changes (CMS-driven sites, headless setups) rather than being a static file. Stable, well-tested, low ceremony.
Web generator
Browser-based generators for sites not on a supported platform. Use as a starter, then curate.
Firecrawl llms.txt Generator llms-full.txt
FreeBest for: Quick one-off llms.txt from any URL
Crawls a domain, uses gpt-4o-mini to extract titles and descriptions, produces both llms.txt and llms-full.txt. Best starter generator for sites not on a platform that auto-builds the file. Expect to hand-edit the output (auto-crawls always over-include).
LLMrefs Free Generator llms.txt only
FreeBest for: Quick browser-based draft from a URL
No signup, paste a URL, edit in-browser, download. Output is a starter, not a finished file. Use it the same way you would use Firecrawl - draft, then curate.
LLMTEXT (Parallel.ai) Not stated
Free, open sourceBest for: Sitemap-driven generation with a built-in validator
Generates the file from your sitemap rather than a crawl, and bundles a validator plus an MCP converter in the same toolkit. The sitemap approach means it inherits whatever curation your sitemap already has - often a better starting draft than a raw crawl.
Validator
Run any generated llms.txt through a validator before you deploy.
llms.txt Validator llms-full.txt
FreeBest for: Catching malformed entries before you deploy
Independent validator at llmstxtvalidator.dev. Flags unsupported directives, broken absolute URLs, missing required fields. Always run a generated file through this before shipping it - especially the WordPress plugin outputs, which drift on edge cases.
AI Schema Validator (Jason Burns tools) n/a
FreeBest for: Confirming the pages your llms.txt points at are actually AI-extractable
Not an llms.txt generator. Validates whether the pages your llms.txt curates have the schema and structure AI engines can extract from. Useful pair with whichever generator you pick - a tidy llms.txt pointing at extraction-hostile pages is wasted effort.
What clients ask about llms.txt.
What is llms.txt and do I actually need one?
llms.txt is a proposed markdown file at the root of your site that tells AI tools which pages matter and how to read them. Proposed by Jeremy Howard in September 2024. It is not yet an official W3C standard. Documentation sites benefit most. For a marketing site, publish one because the cost is 30 minutes - do not expect a measurable ranking lift from it alone.
What is the difference between llms.txt and llms-full.txt?
llms.txt is the index - page titles, one-line descriptions, URLs. llms-full.txt is the actual content, machine-readable, in a single file. Data shared by Profound (cited in the May 2026 Mintlify comparison) shows AI agents fetch llms-full.txt at over twice the rate of llms.txt. If your tool only ships llms.txt, you are giving AI engines the table of contents but not the book.
Does Google or ChatGPT actually use llms.txt?
Adoption is uneven. As of mid-2026, Google has not officially committed to using llms.txt as a ranking or extraction signal. Anthropic (Claude) and OpenAI (ChatGPT) do fetch it in some agentic contexts, particularly for documentation queries. Perplexity references llms.txt as part of its source ingestion. Treat it as a low-cost experiment with patchy upside, not a confirmed lever.
Where should I host llms.txt?
Always at the root of the domain - example.com/llms.txt. Some specs allow alternative paths but the root is where AI systems check first. Use absolute URLs inside the file (relative URLs break when AI tools fetch it from a different context). Keep the file under 1MB to ensure full ingestion. Same applies to llms-full.txt.
Should I generate llms.txt automatically or hand-write it?
Generate a starter version from any of the tools above, then hand-edit. Auto-generators list every page they crawl. The value of llms.txt is in curation - telling AI systems which pages actually matter. Trimming the auto-generated draft takes 30 minutes and is most of the real work. A 50-page auto-generated dump is worse than a 12-page hand-curated file.
How do I validate my llms.txt before deploying?
Run it through llmstxtvalidator.dev. It catches malformed entries, broken absolute URLs, missing required fields and unsupported directives. Especially worth doing on WordPress plugin output, which drifts on edge cases like multilingual sites and unusual permalink structures.
What is the best free llms.txt generator?
Firecrawl's generator is the best free starting point for any site - it crawls the domain and produces both llms.txt and llms-full.txt. On WordPress, the llms.txt toggles in Yoast, Rank Math and AIOSEO are free. LLMrefs and LLMTEXT are also free browser-based options. Every free generator produces a draft that needs hand-editing, so pick on convenience, not features.
What is the format of an llms.txt file?
H1 with your brand or project name (required). A blockquote one-sentence summary. Optional description paragraphs. H2 sections grouping related links (Documentation, Tools, Blog, API Reference). Bullet lists of links with titles, URLs and optional descriptions. Plain markdown, no special syntax. The llmstxt.org proposal has the canonical example.
Jason Burns
Independent UK SEO, GEO and AI consultant. 17 years in search. Portfolio includes 3M, BlackRock, Unilever and E.ON. Owner of SEO Moves Ltd since 2014.
More about Jason →Want a second opinion on whether llms.txt is worth your time?
Quick check-in if you are undecided. For some sites the answer is yes, for most it is "do it once, move on, spend the rest on schema and content". Worth knowing which before you commit a Friday afternoon.
Book a GEO call