Other · Local MCP server
Evals MCP Server
Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.
What the MCP Registry states
The entry as published to the official MCP Registry (read 2026-10-04), latest version.
- Registry name
io.github.cyanheads/evals-mcp-server- Version
- 0.1.4
- Status
- Active
- Category
- other
- Transport
- stdio (local process), Streamable HTTP
- Package
- npm
- Published
- 2026-09-22
- Updated
- 2026-09-22
- Publisher
- cyanheads (GitHub) · 140 servers with pages here
- Namespace
- Namespace verified by the MCP Registry via GitHub (github.com/cyanheads) · how
- Repository
- github.com/cyanheads/evals-mcp-server
- Source
- Registry API entry
Packages
| Registry | Package | Version | Transport |
|---|---|---|---|
| npmruntime: node | @cyanheads/evals-mcp-server | 0.1.4 | stdio |
| npmruntime: node | @cyanheads/evals-mcp-server | 0.1.4 | HTTP |
How to connect Evals MCP Server
Evals MCP Server runs locally from a Node.js package published to the npm registry: @cyanheads/evals-mcp-server version 0.1.4. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Node.js; clients usually start it with npx - the usual command is npx -y @cyanheads/evals-mcp-server@0.1.4; the entry names node as the runtime. It reads these environment variables: EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR and MCP_LOG_LEVEL; set them in the client's configuration for this server.
Evals MCP Server runs locally from a Node.js package published to the npm registry: @cyanheads/evals-mcp-server version 0.1.4. The package starts a local server that speaks MCP over Streamable HTTP; the client then connects to it by URL (the entry names node as the runtime). It reads these environment variables: MCP_HTTP_HOST, MCP_HTTP_PORT, MCP_HTTP_ENDPOINT_PATH, MCP_AUTH_MODE, EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR and MCP_LOG_LEVEL; set them in the client's configuration for this server.
In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):
{
"mcpServers": {
"evals-mcp-server": {
"command": "npx",
"args": [
"-y",
"@cyanheads/evals-mcp-server@0.1.4"
],
"env": {
"EVALS_DATA_DIR": "<value>",
"EVALS_REQUIRE_CONFIRMATION": "<value>",
"EVALS_DEFAULT_LICENSE": "<value>",
"EVALS_CAPTURE_DIR": "<value>",
"MCP_LOG_LEVEL": "<value>"
}
}
}
}Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect
More from cyanheads (GitHub)
| Server | Runs |
|---|---|
| Eia Energy MCP ServerBrowse and query the EIA API v2 - electricity, petroleum, natural gas, coal, forecasts via MCP. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Elevation MCP ServerLook up elevation worldwide, profile route ascent/descent, grid areas, check terrain line of sight. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Ensembl MCP ServerLook up genes, sequences, variants, homologs, and cross-database xrefs from Ensembl REST. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Epa MCP ServerSearch EPA compliance, TRI, Superfund, drinking-water, EJScreen, and AirNow data. | Local · stdio, HTTP |
| Eur Lex MCP ServerSearch EU legislation, CJEU case law, and treaties; traverse CELLAR graph; browse EuroVoc concepts. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Eurostat MCP ServerSearch and query the Eurostat catalogue - EU economy, demography, trade, and NUTS regional data. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Exchange Rates MCP ServerConvert currencies, get FX rates, and query historical ECB exchange rate data. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Faa Aircraft Registry MCP ServerOffline, keyless lookup of the US civil aircraft registry - decode N-numbers, search records. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| faa-traffic-delays-mcp-serverTrack FAA ground stops, delay programs, airport delays, the operations plan, and ATCSCC advisories. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Faostat MCP ServerUN FAOSTAT global food & agriculture statistics over a local SQLite mirror, via MCP. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
| Fbi Crime MCP ServerFBI Crime Data Explorer - UCR estimates, NIBRS breakdowns, hate crimes, arrests, and agency data. | Local · stdio, HTTP |
| Fcc Broadband MCP ServerFCC broadband availability, coverage analysis, and digital divide data for US geographies. | Remote & Local · HTTP, stdioLive check: ✓ handshake |
More other servers
| Server | Runs |
|---|---|
| Euclid-MCPDeterministic logical reasoning engine - facts in Euclid IR, solutions with proof trees. | Local · stdio |
| Eudr Parcel ScreenerScreen farm plots for EUDR deforestation risk with the official EU JRC maps. | Remote · HTTPLive check: sign-in required |
| EuearthAn agent-first commons: merit crowns each domain's open model; standing is earned, never bought. | Remote · HTTPLive check: ✗ no handshake |
| EvalgateStatistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more). | Local · stdio |
| Eve Mentor MCPAI mentor for new & returning EVE Online players: losses, skills, fits, ISK, routes, and more. | Local · stdio |
| Event Resolver APIResolve prediction market events. Price checks, claim verification, outcome confidence. | Remote · SSELive check: ✗ no handshake |
| EventMatey Event DiscoveryFind public EventMatey events that organisers have approved for AI discovery. | Remote · HTTPLive check: ✓ handshake |
| EventsAgent-first Austin events concierge - fresh, sourced answers to what's happening in Austin. | Remote · HTTPLive check: ✓ handshake |