Other · Local MCP server

Evals MCP Server

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

What the MCP Registry states

The entry as published to the official MCP Registry (read 2026-10-04), latest version.

Registry name
io.github.cyanheads/evals-mcp-server
Version
0.1.4
Status
Active
Category
other
Transport
stdio (local process), Streamable HTTP
Package
npm
Published
2026-09-22
Updated
2026-09-22
Publisher
cyanheads (GitHub) · 140 servers with pages here
Namespace
Namespace verified by the MCP Registry via GitHub (github.com/cyanheads) · how
Repository
github.com/cyanheads/evals-mcp-server
Source
Registry API entry

Packages

RegistryPackageVersionTransportEnvironment variables
npmruntime: node@cyanheads/evals-mcp-server0.1.4stdioEVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR, MCP_LOG_LEVEL
npmruntime: node@cyanheads/evals-mcp-server0.1.4HTTPMCP_HTTP_HOST, MCP_HTTP_PORT, MCP_HTTP_ENDPOINT_PATH, MCP_AUTH_MODE, EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR, MCP_LOG_LEVEL

How to connect Evals MCP Server

Evals MCP Server runs locally from a Node.js package published to the npm registry: @cyanheads/evals-mcp-server version 0.1.4. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Node.js; clients usually start it with npx - the usual command is npx -y @cyanheads/evals-mcp-server@0.1.4; the entry names node as the runtime. It reads these environment variables: EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR and MCP_LOG_LEVEL; set them in the client's configuration for this server.

Evals MCP Server runs locally from a Node.js package published to the npm registry: @cyanheads/evals-mcp-server version 0.1.4. The package starts a local server that speaks MCP over Streamable HTTP; the client then connects to it by URL (the entry names node as the runtime). It reads these environment variables: MCP_HTTP_HOST, MCP_HTTP_PORT, MCP_HTTP_ENDPOINT_PATH, MCP_AUTH_MODE, EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR and MCP_LOG_LEVEL; set them in the client's configuration for this server.

In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server@0.1.4"
      ],
      "env": {
        "EVALS_DATA_DIR": "<value>",
        "EVALS_REQUIRE_CONFIRMATION": "<value>",
        "EVALS_DEFAULT_LICENSE": "<value>",
        "EVALS_CAPTURE_DIR": "<value>",
        "MCP_LOG_LEVEL": "<value>"
      }
    }
  }
}

Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect

More from cyanheads (GitHub)

All 140 →
ServerRunsEndpoint or package
Eia Energy MCP ServerBrowse and query the EIA API v2 - electricity, petroleum, natural gas, coal, forecasts via MCP.Remote & Local · HTTP, stdioLive check: ✓ handshakeeia-energy.caseyjhand.com
Elevation MCP ServerLook up elevation worldwide, profile route ascent/descent, grid areas, check terrain line of sight.Remote & Local · HTTP, stdioLive check: ✓ handshakeelevation.caseyjhand.com
Ensembl MCP ServerLook up genes, sequences, variants, homologs, and cross-database xrefs from Ensembl REST.Remote & Local · HTTP, stdioLive check: ✓ handshakeensembl.caseyjhand.com
Epa MCP ServerSearch EPA compliance, TRI, Superfund, drinking-water, EJScreen, and AirNow data.Local · stdio, HTTPnpm: @cyanheads/epa-mcp-server
Eur Lex MCP ServerSearch EU legislation, CJEU case law, and treaties; traverse CELLAR graph; browse EuroVoc concepts.Remote & Local · HTTP, stdioLive check: ✓ handshakeeur-lex.caseyjhand.com
Eurostat MCP ServerSearch and query the Eurostat catalogue - EU economy, demography, trade, and NUTS regional data.Remote & Local · HTTP, stdioLive check: ✓ handshakeeurostat.caseyjhand.com
Exchange Rates MCP ServerConvert currencies, get FX rates, and query historical ECB exchange rate data.Remote & Local · HTTP, stdioLive check: ✓ handshakeexchange-rates.caseyjhand.com
Faa Aircraft Registry MCP ServerOffline, keyless lookup of the US civil aircraft registry - decode N-numbers, search records.Remote & Local · HTTP, stdioLive check: ✓ handshakefaa-aircraft-registry.caseyjhand.com
faa-traffic-delays-mcp-serverTrack FAA ground stops, delay programs, airport delays, the operations plan, and ATCSCC advisories.Remote & Local · HTTP, stdioLive check: ✓ handshakefaa-traffic-delays.caseyjhand.com
Faostat MCP ServerUN FAOSTAT global food & agriculture statistics over a local SQLite mirror, via MCP.Remote & Local · HTTP, stdioLive check: ✓ handshakefaostat.caseyjhand.com
Fbi Crime MCP ServerFBI Crime Data Explorer - UCR estimates, NIBRS breakdowns, hate crimes, arrests, and agency data.Local · stdio, HTTPnpm: @cyanheads/fbi-crime-mcp-server
Fcc Broadband MCP ServerFCC broadband availability, coverage analysis, and digital divide data for US geographies.Remote & Local · HTTP, stdioLive check: ✓ handshakefcc-broadband.caseyjhand.com

More other servers

All 8,395 →
ServerRunsEndpoint or package
Euclid-MCPDeterministic logical reasoning engine - facts in Euclid IR, solutions with proof trees.Local · stdioPyPI: euclid-mcp
Eudr Parcel ScreenerScreen farm plots for EUDR deforestation risk with the official EU JRC maps.Remote · HTTPLive check: sign-in requiredmcp.apify.com
EuearthAn agent-first commons: merit crowns each domain's open model; standing is earned, never bought.Remote · HTTPLive check: ✗ no handshakeapi.euearth.com
EvalgateStatistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).Local · stdioPyPI: eval-integrity
Eve Mentor MCPAI mentor for new & returning EVE Online players: losses, skills, fits, ISK, routes, and more.Local · stdionpm: eve-mentor-mcp
Event Resolver APIResolve prediction market events. Price checks, claim verification, outcome confidence.Remote · SSELive check: ✗ no handshakeevent-resolver.api.klymax402.com
EventMatey Event DiscoveryFind public EventMatey events that organisers have approved for AI discovery.Remote · HTTPLive check: ✓ handshakemcp.eventmatey.com
EventsAgent-first Austin events concierge - fresh, sourced answers to what's happening in Austin.Remote · HTTPLive check: ✓ handshakeyeehaw.bot