What is llms.txt and what problem does it solve?
llms.txt is a proposed text file that briefly describes a site and points to materials useful for language models. Its idea is to provide compact navigation to content instead of requiring models to start by scanning many pages. This is a community proposal, not a mandatory requirement from Google or a universal setting for AI search.
The file is typically placed in the domain root and formatted in Markdown: a title, a short description, then groups of links with explanations. The llms.txt proposal describes a possible structure and purpose for the format. Use this as a specification of the idea, not as confirmation that any specific model will read the file.
The file can be useful if your site has extensive documentation, reference materials, or product pages and you want to gather key sources in one place. For a small site with clear navigation and up-to-date pages, a separate file may offer little practical benefit. Decide based on the convenience of structure and maintenance, not on promises of ranking improvements.
Is there evidence that llms.txt impacts SEO and AI answers?
As of today, the correct conclusion is: publishing llms.txt alone does not confirm organic ranking growth or guarantee site mentions in language model answers. Do not consider the file a Google ranking signal or a guaranteed way to appear in AI Overviews or Perplexity.
Separate three things: the existence of the format, the fact that it is available for download, and its confirmed use by a specific system. The first two can be verified on your site; the third depends on each platform's documentation and behavior. Even if the file is accessible, this does not prove the model discovered, read, or used it in an answer. For a comparison of approaches to systems, you can study materials on technical AEO and Google AI Overviews.
Practical benefit may be organizational: the file helps a team identify key pages and spot navigation gaps. Evaluate it as a small technical experiment. Before publishing, define what problem it solves; after publishing, verify accessibility and relevance without attributing visibility changes that may have other causes.
Example llms.txt for SEO: what to include in the file
A good example llms.txt for SEO is a short pointer to substantive pages, not a copy of the entire site. Start with a clear project name and description, then group links by meaning: documentation, products, rules, or reference materials. Each URL should have a clear purpose.
For example, the structure can include a title with the project name and brief description, a "Documentation" section with links to getting started and FAQ, and an "About" section with a link to the product description. Add a short explanation for each link about the page's content.
Replace placeholder URLs with actual URLs from your own site. Do not include pages with outdated terms, duplicates, restricted sections, or content you do not want to present as a primary source. Verify that link labels match what is actually on the target pages: the file should not promise material that is not behind the link.
For structured data, separately consider schema.org markup for AI search. This is a different tool: llms.txt collects links and descriptions, while markup helps define content type and properties.
How to configure llms.txt on your site and verify it
To configure llms.txt, prepare a text Markdown file, place it at the root of your site, and verify that the server serves it without errors. This is a small technical task, but more important than placement itself is the accuracy of links, page accessibility, and clarity of descriptions.
A working sequence:
- Select pages that genuinely explain the product, documentation, or project rules.
- Group them by topic and add short explanations without promotional promises.
- Save the file in UTF-8 and ensure it is accessible at the expected URL.
- Open each URL from the file: check the server response, redirects, and absence of mandatory authentication.
- After site structure changes, update the list and assign someone responsible for verification.
If the site is built from a CMS or generator, configure file creation during the build process or add it to public static files. Then verify the final version on the published domain, not just in local preview. Details on the technical side of AI search are collected in the technical AEO guide. Do not automatically change robots.txt for llms.txt: the files have different purposes, and each should match the site's actual access policy.
Best practices for llms.txt: how to keep the file useful
Best practices for llms.txt boil down to brevity, accuracy, and regular cross-checking with the site. The file is useful only when the reader understands what is behind the links, and the pages themselves are accessible and match the description.
When preparing, check several things:
- Keep only materials that help understand the project or find the original source.
- Break links into small thematic sections, not a long unorganized list.
- Use descriptions that match the page content and do not replace it with promotional text.
- Remove URLs that have been moved, closed, or become outdated.
- Maintain a file owner and a reason for updates: for example, documentation changes or section structure changes.
Do not duplicate the full text of pages in the file: maintaining two versions of the same material is harder, and an outdated copy creates confusion. It is better to link to canonical pages and maintain the file as an editorial index. If the team is already working on content optimization for Perplexity or monitoring visibility in AI search, consider llms.txt only as one of the technical checks, not a replacement for source and content quality.
How to use llms.txt for Google AI Overviews and Perplexity
Using llms.txt for Google AI Overviews or Perplexity can be a way to organize links to important pages, but not as a direct setting to control display in answers. The fact of publishing alone does not give control over which sources the system selects for a specific query.
For AI Overviews and other answer interfaces, first check the basics: pages are crawlable, contain clear and useful answers, and titles and descriptions match the actual content. Look at the official requirements of the search platform and do not transfer assumptions from one system to another. To understand how to appear in Perplexity answers, evaluate not only technical files but also the presence of accurate, citable materials on the topic.
If you are testing the file, formulate a verifiable question: for example, "Can the file and all listed pages be opened without authentication?" Separately track impressions and mentions in selected systems, but do not attribute any change to llms.txt without other evidence. To understand general visibility tasks, it is useful to compare this approach with SEO for AI search.
Limitations of llms.txt: what the file cannot do
llms.txt does not control how a specific search engine or language model discovers, evaluates, and cites sources. Neither the file's placement nor its content allows the site owner to designate a page as an answer source or influence the platform's editorial and algorithmic decisions.
This is especially important for Google AI Overviews and Perplexity: the file's accessibility does not confirm that the corresponding system considers it. Source selection, answer display, and composition are determined by the platform, not by the llms.txt owner. Therefore, you cannot promise ranking improvements, citations, or traffic based solely on publishing the file.
Check risks before launch:
- Do not add URLs that should remain private; the file is public and may reveal section structure.
- Do not include outdated or contradictory information, even if it is important for the internal team.
- Do not substitute the file for robots.txt, sitemap.xml, or fixing page accessibility issues.
- Do not consider the file's presence as evidence that the site's content is correctly represented in AI search.
Priority is to fix accessibility and content issues, and use llms.txt as an optional navigation layer.
Prices
| Service | Price | Quote |
|---|---|---|
| Technical AEO | from $600 / project |
Starting prices in USD. Custom bundles and volume discounts on request. Payment in USDT, USDC, BTC, ETH, SOL, TON or your project token.
How it works
- Define the goalDecide which site sections need to be shown as primary sources. If you do not yet have a list of useful pages, start with an audit, not file generation.
- Select current URLsChoose open pages with content you are ready to consider primary. Remove duplicates and outdated materials.
- Assemble MarkdownAdd a title, short description, and thematic groups of links with clear explanations. Do not copy large page fragments into the file.
- Publish in the domain rootPlace the file in the public part of the site. If publication is controlled by a CMS or build, check settings with the developer responsible.
- Verify accessibility and updateOpen the published file and each link, then repeat verification after site structure or documentation changes.
Frequently asked questions
Does my site need llms.txt?
It can be useful if your site has extensive documentation or sections and you need a short pointer to key materials. For a small site with a clear structure, the benefit may be limited. Decide based on the convenience of maintaining the file, not on promises of SEO improvement.
How to configure llms.txt if the site runs on a CMS?
Prepare a Markdown file and place it in the public root directory of the domain. Depending on the CMS, this may be a static file or part of the site build process. After publishing, open the URL in a browser and separately check each link from the file.
Will llms.txt help me appear in Google AI Overviews?
The file alone does not ensure display in Google AI Overviews. It can serve as a navigation pointer, but Google determines source selection and answer composition. Maintain page accessibility and quality, and consider llms.txt as an optional element.
How to use llms.txt for Perplexity?
Place links to current pages that provide accurate answers on the topic, and verify they are accessible without authentication. This does not configure citation: Perplexity independently selects sources. Track visibility separately and do not attribute changes to a single file without evidence.
How is llms.txt different from robots.txt and sitemap.xml?
llms.txt is a proposed navigation file with descriptions and links to selected materials. robots.txt sets access rules for compatible bots, and sitemap.xml lists URLs the site owner wants search engines to discover. These files solve different tasks and do not replace each other.
Can Google or Perplexity guarantee processing of llms.txt?
No: the presence of an accessible file does not obligate the platform to read it or use the listed pages in answers. The method of discovering and selecting sources remains outside the site owner's control. You can only guarantee correct publication and verification of the file within your own infrastructure.
Tell us about your project
Answer four quick questions and a manager will send you a plan, timing and a price range within the hour. Everything stays confidential.
Loading the form…