Access
40 pts- Responds to agents
- HTTPS
- robots.txt present
- AI crawlers allowed
- Missing pages return 404
Free · no sign-up · scored out of 100
Check how bot-friendly your site is
We fetch it the way an AI agent would and score access, content without JavaScript and machine discovery, with a fix for every gap.
Try
Fetches public, well-known paths only, the way an agent would: no JavaScript, no cookies. Six checks a minute per IP.
What gets checked
Content without JavaScript
30 pts- H1 in raw HTML
- 500+ characters of readable text
- Title and meta description
- JSON-LD
- Indexable
Machine discovery
30 pts- llms.txt
- Sitemap
- OpenAPI spec or ai-plugin.json
- Bonus: markdown negotiation, helpful 404s, MCP advertised
Agents can run this too
The same report as JSON, no browser needed. Add format=prompt for a ready-to-paste coding-agent prompt covering every failed finding.
shell
curl "https://botfriendly.xyz/api/v1/check?url=yourservice.dev"Top scored
Browse the directory → Open spec from OpenAI and Stripe for agent-initiated checkout — product feeds, checkout endpoints, and scoped delegated payment tokens with the merchant staying merchant of record | 5/5 |
 Claude models with tool use, the MCP connector, Agent Skills, and the Claude Agent SDK | 5/5 |
 Marketplace of thousands of scraping and automation Actors, exposed over API and a remote MCP server | 5/5 |
