LlmsTxtGenerator / report
LlmsTxtGenerator report: https://demo-docs.example/
Demo report on a fictional sample site.
46 / 100
4 of 7 checks need attention (1 high priority).
- ✗ /llms.txt published (high): Missing (HTTP 404). Preview of the generated file: - [Docs](https://demo-docs.example/docs) - [Quickstart](https://demo-docs.example/docs/quickstart) - [Api](https://demo-docs.example/docs/api) - [Pricing](https://demo-docs.example/pricing) - [Blog](https://demo-docs.example/blog)
- ✗ /llms-full.txt published (optional) (low): Not published.
- ✗ AI crawlers can read the site (medium): GPTBot: blocked; ClaudeBot: allowed by default; PerplexityBot: allowed by default; Google-Extended: allowed by default; CCBot: blocked; OAI-SearchBot: allowed by default
- ✓ robots.txt reachable (medium): HTTP 200
- ✓ Sitemap found (feeds the generated index) (medium): https://demo-docs.example/sitemap.xml: HTTP 200, 40 entries.
- ✓ Site title and description for the llms.txt header (medium): Title: DemoDB | Serverless database; description: 56 characters.
- ✗ Organization or WebSite JSON-LD (low): Missing.
Read-only: one page request plus robots.txt, sitemap and llms.txt lookups. llms.txt is an emerging convention; AI providers decide whether and how to use it. Review generated files before publishing.