LiteLLM Multi-Model API

LiteLLM Multi-Model API runs locally from a Python package published to PyPI: litellm-mcp version 1.0.2. It speaks MCP over stdio, so the client starts it as a program and talks to it through standard input and output. It needs Python; clients usually start it with uvx (from uv) or after pip install — the usual command is uvx litellm-mcp; the entry names python as the runtime. It reads these environment variables: OPENAI_API_KEY (secret), ANTHROPIC_API_KEY (secret), LITELLM_API_BASE and LITELLM_API_KEY (secret); set them in the client's configuration for this server.

In the mcpServers JSON format that many desktop and editor MCP clients read, the entry looks like this (placeholders in angle brackets):

{
  "mcpServers": {
    "litellm-mcp": {
      "command": "uvx",
      "args": [
        "litellm-mcp"
      ],
      "env": {
        "OPENAI_API_KEY": "<secret>",
        "ANTHROPIC_API_KEY": "<secret>",
        "LITELLM_API_BASE": "<value>",
        "LITELLM_API_KEY": "<secret>"
      }
    }
  }
}

Derived from the registry entry, not tested here. What the server does, and on what terms, is set by its publisher; check its repository or website before giving it access to your accounts or files. How to add an MCP server to an assistant · Before you connect