Free tool
Does your site give AI a map?
Checks whether /llms.txt exists on your domain, what it contains, and whether robots.txt and sitemap.xml back it up — from a live crawl.
A full scan of your pages runs in the background — about 30 to 60 seconds. Scans are limited to 6 per hour per visitor.
How this works
- Source: a live scan of your domain by the WebsiteSpa engine (
POST /api/aro/scan), the same scanner behind the free audit. - The engine crawls real pages and checks
/llms.txt,robots.txtandsitemap.xml, and it rejects catch-all servers that answer every URL with the homepage — a 200 response is not proof a file exists. - Scanning is limited to 6 runs per hour per visitor so the free tool stays free.
llms.txt is how you tell an assistant which pages matter and what they mean. Without it, the model decides for itself — usually from whatever it crawled first.
Next step: run the free AI-readiness scan. It crawls your real pages and grades how well assistants can read and quote them — three domains free, no card.
Run the free scan