Data · Remote MCP server
Agent Crawl Readiness
Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
What the MCP Registry states
The entry as published to the official MCP Registry (read 2026-10-04), latest version.
- Registry name
io.github.sadri-dridi/agent-crawl-readiness- Version
- 1.0.0
- Status
- Active
- Category
- data
- Transport
- Streamable HTTP
- Published
- 2026-09-23
- Updated
- 2026-09-23
- Publisher
- sadri-dridi (GitHub) · 45 servers with pages here
- Website
- agent-ads-production-9f45.up.railway.app/
- Repository
- github.com/sadri-dridi/named-mcp-utilities (folder agent-ads/agent-crawl-readiness)
- Source
- Registry API entry
Remote endpoints
| Transport | URL | Headers declared |
|---|---|---|
| Streamable HTTP | https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp | None |
How to connect Agent Crawl Readiness
Agent Crawl Readiness is a remote MCP server: there is nothing to install. Its endpoint is https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/agent-crawl-readiness/mcp, served over Streamable HTTP. In an assistant that accepts remote MCP servers (often under a setting named connectors, integrations or tools), add a new server and give it this URL; in a client configured by file, add it as a remote (HTTP) server with the same URL.
No headers are declared in the registry entry. If the server needs you to sign in, a client that supports MCP authorization opens the service's own sign-in page when it first connects.
Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect
More from sadri-dridi (GitHub)
| Server | Runs |
|---|---|
| Advertise To AgentsAgent-to-agent advertising: labeled placements where autonomous agents look for tools. | Remote · HTTP |
| Agent Acquisition DeskSee what agents do on a page: hops, agents, doors, channels. Then place the product. | Remote · HTTP |
| Agent Audience IndexWho the audience is when your customers are agents, and how to be found by them. | Remote · HTTP |
| Agent Channel PlacementPlacement across agent channels: MCP, Cursor, Claude, ChatGPT, npm, docs, Smithery, Glama. | Remote · HTTP |
| Agent Discovery IndexWhere AI agents discover products, and how to be listed there with measured results. | Remote · HTTP |
| Agent Discovery PlacementLabeled placement in agent discovery indexes, measured with daily HMAC nicknames. | Remote · HTTP |
| Agent Facing CatalogMachine catalog for products that want agent clients: surfaces, hops, discovery paths. | Remote · HTTP |
| Agent First ListingAgent-first product listing: JSON catalog, agent card, MCP door, hops, measured landings. | Remote · HTTP |
| Agent Hops For Your SiteHops are 302s an agent followed to your site. Count them, attribute them, grow them. | Remote · HTTP |
| Agent Lead GenerationLeads from agents: hops attributed with a per-hop utm_id from discovery to trial to invoice. | Remote · HTTP |
| Agent Marketing IndexHow to market a product to AI agents: readiness, placement, measurement, 7-day trial. | Remote · HTTP |
| Agent Placement TrialStart a 7-day placement trial: card on file, cancel anytime, measured agent hops. | Remote · HTTP |
More data servers
| Server | Runs |
|---|---|
| Agent CommonsSearch public agent questions and sourced findings, browse agents, and read the onboarding guide. | Remote · HTTP |
| Agent CommonsA public commons for agents to search and share reusable findings and open research questions. | Remote · HTTP |
| Agent CommonsPublic and private rooms for agents, with messages, files, search, and resumable events. | Remote · HTTP |
| Agent CommunityAgent Community MCP: member lookup, stats, DMV checks, and proposed.agent name interest. | Remote · HTTP |
| Agent ExchangeWhere AI agents help AI agents: search past answers, ask questions, and chat in topic rooms. | Remote · HTTP |
| Agent IndexP2P Agent Index MCP — publish and search decentralized web indexes over libp2p. | Local · stdio |
| Agent KnowledgeCross-session memory for AI agents - knowledge graph, scoring, semantic search. | Local · stdio |
| Agent ModuleDeterministic compliance and vertical knowledge bases for autonomous agents. Free 24hr trial. | Remote · HTTP |