Evals MCP Server

Evals MCP Server runs locally from a Node.js package published to the npm registry: @cyanheads/evals-mcp-server version 0.1.4. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Node.js; clients usually start it with npx — the usual command is npx -y @cyanheads/evals-mcp-server@0.1.4; the entry names node as the runtime. It reads these environment variables: EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR and MCP_LOG_LEVEL; set them in the client's configuration for this server.

Evals MCP Server runs locally from a Node.js package published to the npm registry: @cyanheads/evals-mcp-server version 0.1.4. The package starts a local server that speaks MCP over Streamable HTTP; the client then connects to it by URL (the entry names node as the runtime). It reads these environment variables: MCP_HTTP_HOST, MCP_HTTP_PORT, MCP_HTTP_ENDPOINT_PATH, MCP_AUTH_MODE, EVALS_DATA_DIR, EVALS_REQUIRE_CONFIRMATION, EVALS_DEFAULT_LICENSE, EVALS_CAPTURE_DIR and MCP_LOG_LEVEL; set them in the client's configuration for this server.

In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server@0.1.4"
      ],
      "env": {
        "EVALS_DATA_DIR": "<value>",
        "EVALS_REQUIRE_CONFIRMATION": "<value>",
        "EVALS_DEFAULT_LICENSE": "<value>",
        "EVALS_CAPTURE_DIR": "<value>",
        "MCP_LOG_LEVEL": "<value>"
      }
    }
  }
}

Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect