llms.txt
A machine-readable guide file at your website root that tells AI crawlers exactly who you are and what your most important pages contain.
Plain Language Definition
llms.txt is a simple text file placed at the root of your website that acts as a quick-reference guide written specifically for AI crawlers. It provides canonical descriptions of your business, links to your most important pages, and summaries AI can ingest quickly. It is to AI crawlers what a brochure is to a human visitor — a structured first impression designed for machine consumption.
Technical Definition
Root-level markdown specification file containing canonical entity descriptions, structural content summaries, curated navigation paths, and FAQ blocks — designed for direct ingestion by LLM-driven content parsers and agentic crawlers without requiring full HTML rendering.
Why This Matters for AI Search Visibility
AI crawlers often take shortcuts when parsing complex, JavaScript-heavy websites. A well-structured llms.txt gives those crawlers a clean, direct path to your most important content without them having to navigate your full site architecture. It can dramatically improve AI content ingestion quality.