What is llms.txt? The file that helps AI understand your website

What is llms.txt? The file that helps AI understand your website

llms.txt is a plain text file, written in Markdown, that gives AI tools a short summary of your website and a curated list of links to your most important pages. It usually sits at the root of your site, at yourdomain.com/llms.txt. Think of it as a welcome note for large language models: who you are, what you offer and where to find the details.

Where llms.txt comes from

llms.txt is a proposal, not an official web standard. Jeremy Howard published it at llmstxt.org in September 2024. The idea is simple. Websites are built for people, with menus, scripts, pop-ups and layouts. AI tools have to dig through all of that to find the useful text. A short Markdown file gives them the key facts in a format they read easily.

The file normally lives at the root of a domain. The proposal also allows a file in a subfolder, such as /docs/llms.txt, to describe just that section of a site.

What goes in an llms.txt file

The format is ordinary Markdown with a few conventions. In order, the proposal describes:

  • An H1 heading with the name of your business or site. This is the only required part.
  • A blockquote with a short summary of what you do and the key context.
  • Optional paragraphs with more detail, such as who you serve and how to read the links that follow.
  • H2 sections with lists of links. Each item has a link in the form [name](url), optionally followed by a colon and a short note.
  • An “Optional” section for secondary links that an AI tool can skip when it needs less detail.

The proposal also suggests offering clean Markdown versions of important pages, for example by adding .md to a page URL. That step is optional, and many small business sites start with the llms.txt file alone.

An example for a small business

Here is a simple llms.txt file for an imaginary family guesthouse in Kandy. Yours would use your own name, pages and facts.

# Hillside Guesthouse Kandy

> Family-run guesthouse with six rooms near Kandy Lake, Sri Lanka. We offer bed and breakfast, airport transfers and guided day trips.

We welcome couples, families and solo travellers. Guests can book online or send an enquiry. We reply in English and German.

## Rooms and booking

- [Rooms](https://example.com/rooms/): Room types, sizes, beds and amenities
- [Book a stay](https://example.com/book/): Check availability and book online
- [Contact](https://example.com/contact/): Phone, WhatsApp, email and address

## Guides

- [Getting here](https://example.com/getting-here/): Travel times from the airport and Colombo
- [Things to do in Kandy](https://example.com/things-to-do/): Temples, walks and day trips

## Optional

- [About us](https://example.com/about/): Our family and history
- [Guest reviews](https://example.com/reviews/): What past guests say

Keep the file short and factual. Write the summary as you would answer the question “what is this business?” in two sentences. Only link to pages that are useful and up to date.

How llms.txt relates to robots.txt and sitemaps

These three files often get mixed up. They do different jobs.

  • robots.txt tells crawlers which parts of your site they may or may not access. It is about permission.
  • sitemap.xml lists the URLs on your site so search engines can discover and crawl them. It is about completeness.
  • llms.txt gives a curated, human-readable summary and the handful of pages that matter most. It is about understanding.

llms.txt does not block or allow anything. If you want to control whether AI crawlers can access your site, that still happens in robots.txt. Use all three together: robots.txt for access rules, a sitemap for full coverage and llms.txt for context.

An honest note on support

Support for llms.txt varies. Many documentation platforms and SEO plugins now generate the file, and some AI tools read it. Other AI companies have not said that they use it, and none of them promise that adding the file will change how often you appear in AI answers.

So treat llms.txt as a low-cost, sensible step, not a magic switch. It takes little time to create, it does no harm, and it forces you to write a clear summary of your business. That clear summary is useful on its own, on your About page, your Google Business Profile and anywhere else AI tools look.

How to add llms.txt on WordPress

You have several options.

Yoast SEO

Yoast SEO includes an llms.txt feature in its free version. To turn it on, go to Yoast SEO, then Settings, then Site features. Under AI tools, switch on llms.txt and save. Yoast then generates the file automatically and refreshes it, picking your key content for you. You can also choose the pages yourself.

Rank Math and other plugins

Rank Math has an LLMS Txt module that you can switch on from its dashboard. You then choose which post types and taxonomies to include. Standalone plugins such as Website LLMs.txt also exist in the WordPress plugin directory. Use only one tool to generate the file, so they do not conflict.

Upload the file yourself

If you prefer full control, write the file in a text editor, save it as llms.txt and upload it to the root folder of your site using your hosting file manager or FTP. This works on any website, not just WordPress. Remember to update it when your services or key pages change.

Whichever method you use, open yourdomain.com/llms.txt in a browser afterwards to check the file loads and the links work.

How llms.txt fits into GEO

GEO, or generative engine optimisation, is the work of helping AI tools such as ChatGPT, Gemini, Perplexity and Google’s AI features understand and mention your business. llms.txt is one small part of it. The rest matters more:

  • Clear, quotable answers. Start pages and sections with direct answers to the questions your customers ask.
  • Structured data. Schema markup tells machines your business type, address, services, prices and reviews.
  • FAQ content. Real questions with short, honest answers.
  • Consistent facts. The same name, address, phone number and services everywhere online.
  • Good SEO basics. Fast pages, sensible headings and helpful content still form the foundation.
  • Measurement. Google Analytics and Google Tag Manager show where your visitors come from, including referrals from AI tools.

Our client Ravan Escapes, a luxury Sri Lanka tour company, has an llms.txt file alongside its escape collections, experiences and enquiry form. We also built CitiQ, a GEO platform, with Next.js.

How Blueberry Digital can help

We are a web design and development agency based in Colombo, working with clients in Sri Lanka, Germany, Switzerland and beyond. Our SEO and GEO service covers structured data, llms.txt, FAQ content, clear answer-first copy and Google Analytics and Tag Manager setup. We can add these to your existing WordPress site or build them into a new one, so both search engines and AI tools get an accurate picture of your business.

Want AI tools to understand your business?

If you are not sure what AI assistants say about you, or you want your site ready for AI search, get in touch. We will review your site and tell you what to fix first.

Frequently asked questions

Is llms.txt an official standard?

No. It is a proposal published at llmstxt.org in September 2024. It is not an official web standard, and support from AI companies varies.

Will llms.txt make my website appear in ChatGPT answers?

There is no guarantee. llms.txt gives AI tools a clear summary of your site, but no AI company promises it will change how often you are mentioned. Treat it as one small part of a wider GEO approach.

What is the difference between llms.txt and robots.txt?

robots.txt tells crawlers which parts of your site they may access. llms.txt gives AI tools a short summary and a list of your most important pages. llms.txt does not block or allow anything.

Can Yoast SEO create llms.txt for me?

Yes. Yoast SEO includes an llms.txt feature in its free version. Go to Yoast SEO, Settings, Site features, and switch on llms.txt under AI tools.

Where should llms.txt be placed?

Usually at the root of your domain, so it loads at yourdomain.com/llms.txt. The proposal also allows a file in a subfolder to describe just that section of a site.

You May Also Like

What is GEO? How to get your business recommended by ChatGPT, Gemini and Perplexity

Learn More

How we launch a website in 14 days (and what you need to prepare)

Learn More

WordPress vs Contentful vs Next.js: which is right for your business website?

Learn More