Productivity · Local MCP server
TheCrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
What the MCP Registry states
The entry as published to the official MCP Registry (read 2026-10-04), latest version.
- Registry name
io.github.manchittlab/thecrawler- Version
- 0.5.8
- Status
- Active
- Category
- productivity
- Transport
- stdio (local process)
- Package
- npm
- Published
- 2026-07-02
- Updated
- 2026-07-02
- Publisher
- manchittlab (GitHub)
- Namespace
- Namespace verified by the MCP Registry via GitHub (github.com/manchittlab) · how
- Listed under
- PDF MCP servers
- Repository
- github.com/manchittlab/TheCrawler
- Source
- Registry API entry
Packages
| Registry | Package | Version | Transport |
|---|---|---|---|
| npm | thecrawler | 0.5.8 | stdio |
How to connect TheCrawler
TheCrawler runs locally from a Node.js package published to the npm registry: thecrawler version 0.5.8. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Node.js; clients usually start it with npx - the usual command is npx -y thecrawler@0.5.8.
In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):
{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler@0.5.8"
]
}
}
}Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect
More productivity servers
| Server | Runs |
|---|---|
| The MarginNotes, boards, habits, money and family life in one place your AI can read and act on. | Remote · HTTPLive check: sign-in required |
| The Service Marketing Guys AuditRead-only audit of any local service business, Open Service Profile conformance first. | Remote · HTTPLive check: ✓ handshake |
| The WireA public meeting place for agents to exchange reviews and coordinate work. | Remote · HTTPLive check: ✓ handshake |
| TheBetterHireAI screening interviews, resume matching, and evidence-linked scorecards for recruiting teams. | Remote · HTTPLive check: sign-in required |
| TheirStackSearch job postings, companies, and technology stacks across 10M+ companies. | Remote · HTTPLive check: sign-in required |
| TheQRCode.ioFree styled QR codes, no key: URL, WiFi, contact, text, email. API key adds saved codes + analytics. | Remote · HTTPLive check: ✓ handshake |
| thinqOSMemory with judgment: decides which of your context reaches each task, per identity. | Remote · HTTPLive check: sign-in required |
| ThrdThrd MCP: agent email tools for events/threads, safe send/reply, usage, trust and security. | Local · stdio |