Data · Local MCP server
Robots Txt Ai Crawler Audit
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI.
What the MCP Registry states
The entry as published to the official MCP Registry (read 2026-10-04), latest version.
- Registry name
io.github.jmshinhwa/robots-txt-ai-crawler-audit- Version
- 0.1.3
- Status
- Active
- Category
- data
- Transport
- stdio (local process)
- Package
- npm
- Published
- 2026-09-19
- Updated
- 2026-09-19
- Publisher
- jmshinhwa (GitHub) · 144 servers with pages here
- Repository
- github.com/jmshinhwa/readystack-themes
- Source
- Registry API entry
Packages
| Registry | Package | Version | Transport |
|---|---|---|---|
| npmruntime: npx | @readystack/robots-txt-ai-crawler-audit | 0.1.3 | stdio |
How to connect Robots Txt Ai Crawler Audit
Robots Txt Ai Crawler Audit runs locally from a Node.js package published to the npm registry: @readystack/robots-txt-ai-crawler-audit version 0.1.3. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Node.js; clients usually start it with npx — the usual command is npx -y @readystack/robots-txt-ai-crawler-audit@0.1.3.
In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):
{
"mcpServers": {
"robots-txt-ai-crawler-audit": {
"command": "npx",
"args": [
"-y",
"@readystack/robots-txt-ai-crawler-audit@0.1.3"
]
}
}
}Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect
More from jmshinhwa (GitHub)
| Server | Runs |
|---|---|
| Proto Wire Break CheckNames the.proto edits that keep compiling and quietly change what old gRPC readers see. | Local · stdio |
| Pyproject Release Gate19 date-aware checks on the [project] metadata that decides whether your next release uploads. | Local · stdio |
| Pytest Deprecation LintMarks the lines in your test suite that current pytest no longer runs — and the config keys it silen. | Local · stdio |
| Rechnung Pflichtangaben Lint DePrüft PHP-Rechnungstemplates von WooCommerce- und WordPress-Shops gegen alle zehn Pflichtangaben des. | Local · stdio |
| Reisekosten Pruefer 202615 Checks für exportierte Reisekostenabrechnungen: 28,00 Euro Verpflegungspauschale erst ab 24 Stund. | Local · stdio |
| Renpy Release GateFind the.rpy lines that compile clean and only break inside a player's save. | Local · stdio |
| Runtime Eol Deploy Block AuditFinds the end-of-life runtimes an AI assistant still writes for you — node:20, python3.9, ubuntu-22. | Local · stdio |
| Saft Pt Atcud Lint14 verificações ao XML SAF-T (PT) antes da entrega à AT: versão 1.04_01, ATCUD, dados do QR code, ha. | Local · stdio |
| Security Headers Csp LintReads security headers and CSP line by line in your config file and names the lines that silently do. | Local · stdio |
| Security Txt Cra Lint13 rules that decide whether a vulnerability report ever reaches you. | Local · stdio |
| Sepa Pain001 Reject LintFind the lines your bank will refuse before you send the batch. | Local · stdio |
| Soup List LintReads your SOUP register the way an auditor does: 16 rules over clauses 8.1.2, 5.3.3, 5.3.4, 4.3 and. | Local · stdio |
More data servers
| Server | Runs |
|---|---|
| Robin: AI-Powered Dark Web OSINTDark web OSINT over Tor: search onion engines, scrape pages, report with your own model. | Local · stdio |
| RoboHub Robot CatalogVendor-neutral catalog of 300+ commercial robots: search, compare specs, request vendor intros. | Remote · HTTP |
| Robot Resources ScraperToken compression for web content — 70-80% reduction from HTML to clean markdown. | Local · stdio |
| Robot SpeedSEO tools for AI agents: audits, Core Web Vitals, keywords, AI visibility, traffic, backlinks. | Remote · HTTP |
| Robotstxt AiAnalyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot. | Local · stdio |
| RobutlerBuild, remix, and run apps with agents on Robutler. Search, delegate, post, chat, manage channels. | Remote · HTTP |
| Rock Regeneration GigsSearch upcoming gigs from the Rock Regeneration gig guide (southern England). | Local · stdio |
| RocketListSearch current startup jobs and hiring companies through RocketList's public read-only data. | Remote · HTTP |