AI agents are coming for your website. Not to attack it — to use it. They browse, they transact, they interact with your content. And if your site isn’t built for them, they’ll move on to one that is.
IsItAgentReady.com is a free scanner that evaluates how ready your website is for AI agents. It checks multiple emerging standards — from robots.txt directives to MCP server cards — and gives you a concrete score with actionable fixes.
What Do They Check?
The scanner runs checks across five categories:
Discoverability
- robots.txt presence and validity
- Sitemap availability and format
- Link response headers
Content Accessibility
- Markdown content negotiation — can agents get your content in a machine-readable format?
Bot Access Control
- AI bot rules in robots.txt
- Content Signals specification
- Web Bot Auth
Protocol Discovery
- MCP Server Card
- Agent Skills
- WebMCP
- API Catalog
- OAuth discovery
- OAuth Protected Resource
Commerce
- x402 (machine-readable payment
- UCP
- ACP
Why This Matters Now
The web is shifting from a human-facing model to a machine-facing one. Agents need to be able to discover your content, authenticate against your services, understand your commerce flows, and interact with your tools — all without a screen and a mouse.
Right now, most websites are invisible or inaccessible to AI agents. They don’t expose Agent Skills, they don’t expose MCP server cards, and their robots.txt files don’t include AI bot directives. The sites that fix this first will get crawled, used, and purchased from first.
The Easy Wins
According to the site, the fastest way to improve your score:
- Publish a valid robots.txt with AI bot rules and sitemap directives — this alone covers discoverability and bot access control basics
- Expose useful discovery headers or metadata on your homepage — this helps agents understand what you offer before they crawl deeper
Both are free to implement and take minutes, not days.
Where to Learn More
Check out the Cloudflare Agents documentation to learn how to build and deploy AI agents that can browse, interact, and transact on the web.
Agentic commerce isn’t theoretical anymore. Run a scan on your site today and see where you stand.