llms.txt is a proposed plain-text file, placed at a site’s root, that gives language models a short markdown guide to the site’s most useful pages.
Jeremy Howard of Answer.AI published the proposal in September 2024. The file starts with the site name, a one-paragraph summary, then grouped lists of links with a sentence about each. A companion convention, llms-full.txt, carries the full text in one document.
It is not a standard that any major AI company has committed to honour, and it does not control crawling the way robots.txt does. Think of it as a well organised table of contents for machines rather than a permission file.
It costs little to publish and can help agents and developer tools that do read it. Every brand site The Woof Back serves publishes one automatically, built from the live list of articles.