The llms.txt format
According to llmstxt.org (proposed by Jeremy Howard on 3 September 2024), the file is Markdown in a fixed order: an H1 title with the site name (the only required part), a blockquote with a summary, free-form body sections without headings, then zero or more H2 sections containing link lists in the form “- [name](url): notes”. An H2 section named “Optional” holds secondary links that an agent may skip when it needs a shorter context.
The file goes at /llms.txt or in a sub-path, and its links should preferably point to pages that are easy for machines to read, such as Markdown versions of the pages.