3 min read
What Is llms.txt, and Does Your Business Need One?
llms.txt is a proposed markdown file you put on your website to give AI agents a short guide to your most useful pages. It's a community proposal, not an official standard. Google says its Search, including AI Overviews and AI Mode, ignores it. OpenAI, Anthropic and Perplexity don't say their search uses it. For most local businesses it's optional. It's cheap to add, but don't expect it to get you recommended.
What is llms.txt?
llms.txt is a plain text file in markdown format, placed at yourdomain.com/llms.txt. It was proposed by Jeremy Howard in September 2024, and the proposal was updated to a second version in August 2026.
The idea: web pages are built for people, with menus, ads and scripts that make them hard for AI tools to read. An llms.txt file gives AI agents a short summary of your site and links to the pages that matter, ideally in clean markdown versions.
A simple version for a local business could look like this:
# Smith Plumbing
> Licensed plumbers serving Austin, TX. Emergency call outs 7 days a week.
## Services
- [Leak repair](https://example.com/leak-repair): Same-week repairs for homes
- [Water heaters](https://example.com/water-heaters): Install and replace
## Contact
- [Hours and contact](https://example.com/contact)
Who uses it?
The proposal says thousands of sites publish an llms.txt file and documentation platforms generate one automatically. It adds that Chrome’s Lighthouse tool checks for one in its agentic browsing audits. OpenAI, Anthropic and Google’s Gemini publish llms.txt files for their own developer documentation.
The proposal also says it’s used most heavily for software documentation, where coding agents follow it to find references.
Does Google use llms.txt?
No, according to Google. Its guide to generative AI search lists llms.txt files under things you can ignore. It says Google Search doesn’t use them, and that creating one will neither harm nor help your visibility or rankings in Google Search. That includes AI Overviews and AI Mode.
Google also says it’s fine to keep an llms.txt file for other services that use it.
Do ChatGPT, Claude or Perplexity use it?
They don’t say they do. Their crawler documentation (OpenAI, Anthropic, Perplexity) explains how to allow or block their bots with robots.txt. None of those pages says their search reads llms.txt to decide what to cite.
That could change. Today, there’s no public statement from these companies to rely on.
llms.txt vs robots.txt vs sitemap.xml
| File | What it does | Who reads it |
|---|---|---|
| robots.txt | Tells bots what they’re allowed to crawl | Search engines and AI crawlers; user-requested fetches may not follow it |
| sitemap.xml | Lists the pages on your site | Search engines |
| llms.txt | Gives AI agents a short guide to your key pages | Some AI agents and tools, by choice; Google Search says it ignores it |
The proposal itself says llms.txt and robots.txt have different purposes. llms.txt doesn’t block or allow anything. If you want to control AI crawlers, use robots.txt.
Should your business add one?
It depends on what you do.
Probably worth it if:
- You have documentation, an API or a software product that coding agents use
- Your platform (some CMSs and SEO plugins) can generate one for you in a few minutes
Probably low priority if:
- You’re a local service business and your crawler access, website content, Business Profile and reviews still need work
For a local business, the things Google and the AI companies do document, like crawler access and accurate business details, are a better use of your first hours.
Where Meristoll fits
Our free report checks the things AI companies do document, like whether AI crawlers can read your site, along with your listings, reviews and mentions. It asks your customers’ questions in six AI assistants and gives you a 0 to 100 score for each, plus a prioritized fix list.
Questions people ask
Is llms.txt an official standard?
No. It's a proposal by Jeremy Howard, now in its second version, and it's open for community input. It isn't run by a standards body.
Will adding llms.txt get my business recommended by ChatGPT?
OpenAI doesn't say ChatGPT search uses llms.txt. Its stated requirement for ChatGPT search is allowing its search crawler, OAI-SearchBot. Treat llms.txt as optional, not as a way into ChatGPT's answers.
Does llms.txt hurt my Google rankings?
Google says no. Its guidance says creating an llms.txt file will neither harm nor help your visibility or rankings in Google Search, because Google Search ignores it.
Can llms.txt block AI from using my content?
No. llms.txt is a guide, not an access control. To allow or block AI crawlers, use robots.txt with the crawler names the AI companies publish.