Schema and llms.txt for AI
The technical layer of GEO: access for AI crawlers, llms.txt and structured data for models.
Schema and llms.txt for AI
Before an AI model can cite a page, it has to read and understand it. This GEO layer handles the technical accessibility of content for AI crawlers and the signals that help models recognize what a page is about.
Access for AI crawlers
/seo geo your-domain.com
The first step is checking whether the model bots are allowed in. The console verifies robots.txt rules and Content-Signal headers for the most important agents:
| Crawler | Model / platform |
|---|---|
GPTBot |
ChatGPT (OpenAI) |
ClaudeBot |
Claude (Anthropic) |
PerplexityBot |
Perplexity |
Google-Extended |
Gemini and AI Overviews |
llms.txt - a content index for models
An llms.txt file in the root is a content map written for models: a list of the most important pages with a short description, plus an optional llms-full.txt with the full Markdown content. The console generates both and keeps them consistent with the sitemap.