Developer · Local MCP server
EvalForge Lite
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
What the MCP Registry states
The entry as published to the official MCP Registry (read 2026-10-04), latest version.
- Registry name
io.github.thejaredchapman/evalforge-lite- Version
- 1.0.1
- Status
- Active
- Category
- developer
- Transport
- stdio (local process)
- Package
- PyPI
- Published
- 2026-10-01
- Updated
- 2026-10-01
- Publisher
- thejaredchapman (GitHub)
- Namespace
- Namespace verified by the MCP Registry via GitHub (github.com/thejaredchapman) · how
- Website
- github.com/thejaredchapman/evalforge-lite/blob/main/docs/mcp-server.md
- Repository
- github.com/thejaredchapman/evalforge-lite
- Source
- Registry API entry
Packages
| Registry | Package | Version | Transport |
|---|---|---|---|
| PyPI | evalforge-lite | 1.0.1 | stdio |
How to connect EvalForge Lite
EvalForge Lite runs locally from a Python package published to PyPI: evalforge-lite version 1.0.1. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Python; clients usually start it with uvx (from uv) or after pip install - the usual command is uvx evalforge-lite. It reads the environment variable OPENROUTER_API_KEY (secret); set it in the client's configuration for this server.
In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):
{
"mcpServers": {
"evalforge-lite": {
"command": "uvx",
"args": [
"evalforge-lite"
],
"env": {
"OPENROUTER_API_KEY": "<secret>"
}
}
}
}Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect
More developer servers
| Server | Runs |
|---|---|
| Esm MCPEsm.sh CDN: resolve npm package versions and browse module files. No key required. | Local · stdio |
| Eterna MCPNo-KYC managed MCP for AI agents: sandboxed TypeScript trading SDK, isolated sub-accounts, futures. | Remote · HTTPLive check: sign-in required |
| Eurodns MCPModel Context Protocol server for the EuroDNS User API - domains, DNS zones, subscriptions and SSL. | Local · stdio |
| Eval Engine APIPay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI. | Remote · HTTPLive check: ✗ no handshake |
| Evalscopebench MCPA paid remote MCP for AI SDK benchmark dashboard, built to return verdicts, receipts, usage logs, an. | Remote · HTTPLive check: ✗ no handshake |
| Evalview MCPRegression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude. | Local · stdio |
| Evercraft WebRead public web content with Evercraft; search and browser automation stay behind safety gates. | Remote · HTTPLive check: ✓ handshake |
| Evernode MCPEvernode/HotPocket dApp helper: templates, non-determinism lint, lease math, live host lookup. | Local · stdio |