Data · Remote MCP server

Commoncrawl

Common Crawl's public web archive - find every time a URL was crawled since 2008 and read the…

Visit Commoncrawl's website

What the MCP Registry states

The entry as published to the official MCP Registry (read 2026-10-04), latest version.

Registry name
io.github.pipeworx-io/commoncrawl
Version
0.1.1
Status
Active
Category
data
Transport
Streamable HTTP
Published
2026-09-25
Updated
2026-09-25
Publisher
pipeworx-io (GitHub) · 1022 servers with pages here
Namespace
Namespace verified by the MCP Registry via GitHub (github.com/pipeworx-io) · how
Website
pipeworx.io/packs/commoncrawl
Repository
github.com/pipeworx-io/mcp-commoncrawl
Source
Registry API entry

Remote endpoints

TransportURLHeaders declared
Streamable HTTPhttps://gateway.pipeworx.io/commoncrawl/mcpNone

Live check

This directory connected to each remote endpoint and asked for its list of tools. The check connects and lists tools only; it doesn't run tools, sign in or test security.

Reachable
Yes (HTTP 200)
Handshake
pipeworx-gateway 0.1.0 · protocol 2025-06-18
Tools discovered
39 - show namesask_pipeworx, ask_pipeworx_beta, ask_pipeworx_grounded, search_within, deep_research, discover_tools, resolve_entity, compare_entities, subscribe, unsubscribe, list_subscriptions, recent_alerts, entity_profile, recent_changes, validate_claim, company_facts, scan_dependency, bet_research, polymarket_arbitrage, polymarket_edges, polymarket_kalshi_spread, polymarket_fill_risk, polymarket_edge_tracker, kalshi_weather_edge, resolution_audit, resolution_diff, release_calendar_markets, pipeworx_trending, suggest_questions, generate_llms_txt, ai_visibility_check, scan_competitor_ai_presence, pipeworx_feedback, remember, recall, forget, commoncrawl_crawls, commoncrawl_index_search, commoncrawl_fetch_record
Checked on
2026-10-05

How the live check works

How to connect Commoncrawl

Commoncrawl is a remote MCP server: there is nothing to install. Its endpoint is https://gateway.pipeworx.io/commoncrawl/mcp, served over Streamable HTTP. In an assistant that accepts remote MCP servers (often under a setting named connectors, integrations or tools), add a new server and give it this URL; in a client configured by file, add it as a remote (HTTP) server with the same URL.

No headers are declared in the registry entry. If the server needs you to sign in, a client that supports MCP authorization opens the service's own sign-in page when it first connects.

Derived from the registry entry; the live check above only shows whether the endpoint answered. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect

More from pipeworx-io (GitHub)

All 1,022 →
ServerRunsEndpoint or package
CoingeckoCoinGecko MCP - wraps CoinGecko free API (no auth required)Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
CoinmarketcapCoinMarketCap MCP - crypto prices, market cap, rankings.Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
Colombia SecopColombia SECOP MCP - Colombian government procurement (public contracting).Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
Color PizzaColor Pizza MCP - names hex colors using human-friendly color-name lists.Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
ColorapiColor API MCP - wraps thecolorapi.com (free, no auth)Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
Committee ReleasesCommittee Releases - documents congressional committees publish on their OWN.Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
Companies HouseCompanies House MCP - UK statutory company registry (BYO key)Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
ComtradeComtrade MCP - UN Comtrade API for international bilateral trade data.Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
ConceptnetConceptNet MCP - open multilingual word/phrase relation graph.Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
ConfluenceConfluence MCP - wraps the Confluence Cloud REST API v2 (OAuth)Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
CongressCongress MCP - US Congress data via GovTrack API (free, no auth required)Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io
Congressional DocumentsCongressional Documents - full-text search and retrieval over the official.Remote · HTTPLive check: ✓ handshakegateway.pipeworx.io

More data servers

All 4,815 →
ServerRunsEndpoint or package
Command+KSet up and run an in-product AI assistant: widgets, knowledge, MCP connections, usage.Remote · HTTPLive check: sign-in requiredcommandplusk.com
Commercial Garage DoormanCommercial Garage Doorman, Hamilton area commercial door service: business facts and site search.Remote · HTTPLive check: ✓ handshakecommercialgaragedoorman.ca
Common Agent NetworkPublic coordination, knowledge, discovery, and feature requests for autonomous agents and swarms.Remote · HTTPLive check: ✓ handshakeagents.dooza.ai
Common PaperCreate, send, negotiate, sign, and track contracts with Common Paper.Remote · HTTPLive check: sign-in requiredapi.commonpaper.com
Commoncrawl MCPUse this MCP server to Common Crawl index discovery for historical web captures. Tools include...Local · stdionpm: commoncrawl-mcp
Community BoardSearch and discover local community listings, classifieds, services and events.Remote · HTTPLive check: ✓ handshakemcp.shavitnetzer.com
CompanieswiseVerified UK company lookup & validation for AI agents - Companies House data, snapshot or live.Local · stdionpm: companieswise
Company EnrichmentCompany enrichment for AI agents: firmographics, tech stack, headcount, funding, domain emails.Remote · HTTPLive check: sign-in requiredmcp.superagnt.com