Data · Local MCP server

Robots Txt Ai Crawler Audit

Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI.

What the MCP Registry states

The entry as published to the official MCP Registry (read 2026-10-04), latest version.

Registry name
io.github.jmshinhwa/robots-txt-ai-crawler-audit
Version
0.1.3
Status
Active
Category
data
Transport
stdio (local process)
Package
npm
Published
2026-09-19
Updated
2026-09-19
Publisher
jmshinhwa (GitHub) · 144 servers with pages here
Repository
github.com/jmshinhwa/readystack-themes
Source
Registry API entry

Packages

RegistryPackageVersionTransportEnvironment variables
npmruntime: npx@readystack/robots-txt-ai-crawler-audit0.1.3stdioNone declared

How to connect Robots Txt Ai Crawler Audit

Robots Txt Ai Crawler Audit runs locally from a Node.js package published to the npm registry: @readystack/robots-txt-ai-crawler-audit version 0.1.3. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Node.js; clients usually start it with npx — the usual command is npx -y @readystack/robots-txt-ai-crawler-audit@0.1.3.

In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):

{
  "mcpServers": {
    "robots-txt-ai-crawler-audit": {
      "command": "npx",
      "args": [
        "-y",
        "@readystack/robots-txt-ai-crawler-audit@0.1.3"
      ]
    }
  }
}

Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect

More from jmshinhwa (GitHub)

All 144 →
ServerRunsEndpoint or package
Proto Wire Break CheckNames the.proto edits that keep compiling and quietly change what old gRPC readers see.Local · stdionpm: @readystack/proto-wire-break-check
Pyproject Release Gate19 date-aware checks on the [project] metadata that decides whether your next release uploads.Local · stdionpm: @readystack/pyproject-release-gate
Pytest Deprecation LintMarks the lines in your test suite that current pytest no longer runs — and the config keys it silen.Local · stdionpm: @readystack/pytest-deprecation-lint
Rechnung Pflichtangaben Lint DePrüft PHP-Rechnungstemplates von WooCommerce- und WordPress-Shops gegen alle zehn Pflichtangaben des.Local · stdionpm: @readystack/rechnung-pflichtangaben-lint-de
Reisekosten Pruefer 202615 Checks für exportierte Reisekostenabrechnungen: 28,00 Euro Verpflegungspauschale erst ab 24 Stund.Local · stdionpm: @readystack/reisekosten-pruefer-2026
Renpy Release GateFind the.rpy lines that compile clean and only break inside a player's save.Local · stdionpm: @readystack/renpy-release-gate
Runtime Eol Deploy Block AuditFinds the end-of-life runtimes an AI assistant still writes for you — node:20, python3.9, ubuntu-22.Local · stdionpm: @readystack/runtime-eol-deploy-block-audit
Saft Pt Atcud Lint14 verificações ao XML SAF-T (PT) antes da entrega à AT: versão 1.04_01, ATCUD, dados do QR code, ha.Local · stdionpm: @readystack/saft-pt-atcud-lint
Security Headers Csp LintReads security headers and CSP line by line in your config file and names the lines that silently do.Local · stdionpm: @readystack/security-headers-csp-lint
Security Txt Cra Lint13 rules that decide whether a vulnerability report ever reaches you.Local · stdionpm: @readystack/security-txt-cra-lint
Sepa Pain001 Reject LintFind the lines your bank will refuse before you send the batch.Local · stdionpm: @readystack/sepa-pain001-reject-lint
Soup List LintReads your SOUP register the way an auditor does: 16 rules over clauses 8.1.2, 5.3.3, 5.3.4, 4.3 and.Local · stdionpm: @readystack/soup-list-lint

More data servers

All 4,395 →
ServerRunsEndpoint or package
Robin: AI-Powered Dark Web OSINTDark web OSINT over Tor: search onion engines, scrape pages, report with your own model.Local · stdioOCI image (Docker): docker.io/apurvsg/robin:v3.1
RoboHub Robot CatalogVendor-neutral catalog of 300+ commercial robots: search, compare specs, request vendor intros.Remote · HTTProbohub.app
Robot Resources ScraperToken compression for web content — 70-80% reduction from HTML to clean markdown.Local · stdionpm: @robot-resources/scraper-mcp
Robot SpeedSEO tools for AI agents: audits, Core Web Vitals, keywords, AI visibility, traffic, backlinks.Remote · HTTProbot-speed.com
Robotstxt AiAnalyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.Local · stdionpm: robotstxt-ai-mcp
RobutlerBuild, remix, and run apps with agents on Robutler. Search, delegate, post, chat, manage channels.Remote · HTTProbutler.ai
Rock Regeneration GigsSearch upcoming gigs from the Rock Regeneration gig guide (southern England).Local · stdioOCI image (Docker): ghcr.io/cuotos/rock-regeneration-gigs-mcp:2.0.0
RocketListSearch current startup jobs and hiring companies through RocketList's public read-only data.Remote · HTTProcketlist.ai