Data · Local MCP server
Crawlberg
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
What the MCP Registry states
The entry as published to the official MCP Registry (read 2026-10-04), latest version.
- Registry name
io.github.xberg-io/crawlberg- Version
- 1.9.0
- Status
- Active
- Category
- data
- Transport
- stdio (local process)
- Package
- OCI image (Docker)
- Published
- 2026-10-03
- Updated
- 2026-10-03
- Publisher
- xberg-io (GitHub)
- Website
- xberg.io
- Repository
- github.com/xberg-io/crawlberg
- Source
- Registry API entry
Packages
| Registry | Package | Version | Transport |
|---|---|---|---|
| OCI image (Docker) | ghcr.io/xberg-io/crawlberg:1.9.0 | — | stdio |
How to connect Crawlberg
Crawlberg runs locally from a container image in an OCI registry such as Docker Hub or GitHub Container Registry: ghcr.io/xberg-io/crawlberg:1.9.0. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Docker or another OCI container runtime; started with docker run — the usual command is docker run -i --rm ghcr.io/xberg-io/crawlberg:1.9.0.
In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):
{
"mcpServers": {
"crawlberg": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"ghcr.io/xberg-io/crawlberg:1.9.0"
]
}
}
}Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect
More data servers
| Server | Runs |
|---|---|
| Crawdar Business ResearchEvidence-backed public business research for agents with compact, pageable output. | Remote · HTTP |
| Crawl CensusAsk before you fetch: will this domain serve your crawler, refuse it, or charge it? | Remote · HTTP |
| Crawl ReadinessAudit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions. | Local · stdio |
| Crawl4AgentCrawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown... | Remote · HTTP |
| CrawlbitFour free tools to check if AI engines can find, read and recognise a site. No API key. | Local · stdio |
| crawlbrulee MCPEU-native web scraping for AI agents. scrape pages, map sites, run background jobs, check usage. | Local · stdio |
| CrawlConsoleBacklink Analysis MCP for AI Agents: authority, referring domains, and competitor link gaps. | Remote & Local · HTTP |
| CrawlEyes MCP ServerWeb scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key. | Local · stdio |