llms.txt: what it is and why you need it in 2026

llms.txt is a standard published by Jeremy Howard in 2024 that works like “robots.txt for AI”. It’s a public file at the site root that tells Large Language Models which content on your site is authoritative, where to find it, and in what priority order.

Unlike robots.txt (which excludes crawlers) and sitemap.xml (which lists every URL), llms.txt is a curated map: you choose what to expose, with a one-line title + description optimized for AI engines.

Why it matters in 2026

In 2025 ChatGPT, Claude, Perplexity and Gemini surpassed Google on many queries. People no longer search “best SEO plugin 2026” — they ask the AI directly: “what’s the best WordPress SEO plugin in 2026?”. The AI answers citing 2-3 sources. If you’re not one of them, you’re invisible.

To be cited by AI search you need to:

• Be technically readable by AI (clean HTML, schema.org, llms.txt)
• Have authoritative, citable content (declarative sentences, concrete data, FAQs in Q&A format)
• Expose the site structure in a machine-friendly way

llms.txt covers point 3 in a standard way recognized by major LLMs.

How Orchestra implements llms.txt

When you turn on the llms.txt + llms-full.txt toggle in the Native SEO Output panel, Orchestra generates two dynamic endpoints:

• /llms.txt — curated markdown index with title + description for every published page. Auto-updated when you publish/edit content.
• /llms-full.txt — top 30 pages with the full content in markdown. This is the file AIs download to “read” your site without having to scrape HTML.

Files are cached with a 6h TTL and automatically invalidated on save_post, delete_post, edited_term. Zero manual maintenance.

Example of generated llms.txt

# AEO Orchestra — WordPress plugin

> WordPress plugin for SEO + AEO with 12 integrated AI agents.
> Replaces Yoast/RankMath, adds Brand Voice, Auto-Pilot and
> Keyword Research. For agencies and SMBs.

## Main pages
- [Home](https://aeo-orchestra.com/): AI-first SEO+AEO plugin
- [Pricing](https://aeo-orchestra.com/pricing): plans and credits

## Guides
- [Migration from Yoast](.../guide/migrazione-da-yoast)
- [Brand Voice](.../guide/brand-voice)
- [llms.txt in 2026](.../guide/llms-txt)
...

What AI engines do with llms.txt

Major AI crawlers actively read it:

• OpenAI (ChatGPT): OAI-SearchBot, ChatGPT-User
• Anthropic (Claude): ClaudeBot
• Perplexity: PerplexityBot
• Google (Gemini / SGE): Google-Extended
• You.com, Andi, etc.: smaller but growing crawlers

When a user runs a query relevant to your industry, these AIs first check their own knowledge base, then (for recent or specific queries) live-fetch llms.txt / llms-full.txt to build the answer. If you’re there, you get cited.

llms.txt vs sitemap.xml

They don’t replace each other — they complement each other. Keep sitemap.xml for Google Search; add llms.txt for AI search engines. Orchestra generates both automatically.

Differentiator: no mainstream SEO plugin (Yoast, RankMath, AIOSEO, SEOPress) supports llms.txt. Orchestra is the world’s first WordPress plugin to support it natively. For the next 12-18 months, this is a real competitive advantage.