Skip to main content
All modules

Part of Content Studio

llms.txt Generator

The file that tells LLMs what to read first on your site

What are LLMs and why do they matter for your business?

LLM stands for Large Language Model. These are the artificial intelligence systems behind tools like ChatGPT, Google Gemini, Claude, and Perplexity. They work by processing enormous amounts of text to learn human language patterns, which enables them to answer questions, generate content, and hold natural conversations.

When a user asks ChatGPT "what's the best project management tool?" or asks Perplexity "which laptop should I buy for graphic design?", the LLM analyzes everything it learned from the web and selects the sources it considers most trustworthy to build its response. If your brand, product, or website doesn't have the right signals, the model simply won't include you in that answer, and your competition will take that spot.

Google AI Overviews is Google's version of this technology: instead of showing just a list of links, it now generates a direct AI-powered answer at the top of search results. This means the first result many users see is no longer a link to your site, but an AI-generated response that may or may not mention you.

In short: LLMs are the new intermediaries between your business and your potential customers. More and more people use these tools to research, compare, and decide what to buy. AuraMetrics helps you ensure that when AI answers questions about your industry, your brand is part of the answer.

What it does

llms.txt Generator creates a ready-to-use llms.txt file from your real site. It crawls your site, classifies each page, and builds a structured llms.txt that AI agents use to discover and cite your content. It uses no templates: the result is grounded in what actually exists on your site. Page classification (allowed, disallowed, optional) is fully deterministic, with no AI model calls.

Why it matters

Sites with an llms.txt get more accurate AI citations and better agent discoverability. The file tells agents which pages to read and which to skip, similar to robots.txt but for LLMs. AuraMetrics detects and scores llms.txt as part of the Content Readiness pillar, so generating and publishing it directly improves your GEO Score.

How it works

You enter your site URL and the module crawls up to 50 pages using your sitemap.xml and robots.txt, with SSRF protection on every request. It classifies each page by its path (home, blog, docs, about, pricing) and excludes private paths like /admin, /login, /checkout, and /cart. It then generates the llms.txt in the standard format, and optionally an llms-full.txt with extended per-page descriptions, ready to copy or download.

Metrics you get

Pages analyzed
Pages allowed
Pages disallowed
llms-full.txt generated

Recommended use cases

1Create your first llms.txt without writing it by hand
2Keep your llms.txt up to date as you add pages
3Exclude private paths from AI agent consumption
4Expose your key pages to ChatGPT, Gemini, and Perplexity
5Improve your GEO Score on the Content Readiness pillar

Frequently asked questions

What is llms.txt?

A standard file that tells AI agents which pages of your site to read and which to skip, similar to robots.txt but for LLMs.

Does having llms.txt improve my GEO Score?

Yes. AuraMetrics detects and scores llms.txt as part of the Content Readiness pillar.

What is the difference between llms.txt and llms-full.txt?

llms.txt is a concise index. llms-full.txt includes extended descriptions and context for each page, giving AI agents richer information about your content.

llms.txt Generator

Available on all plans. Sign in to access your dashboard.

Start using