# mcp-as-a-judge

A validation layer between your coding assistant and the model: plans, diffs and tests get judged before a task can close.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI · ★ 17
- Author: OtherVibes
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/OtherVibes/mcp-as-a-judge
- Updated: 2025-12-15
- HTML: https://affpapa.org/en/nevibecode/mcp/mcp-as-a-judge

## What it does

The server turns a coding task into a sequence of checkpoints. The assistant registers it with `set_coding_task`, submits the plan to `judge_coding_plan`, the changes to `judge_code_change`, the tests to `judge_testing_implementation`, and the final gate is `judge_coding_task_completion`. When requirements are vague, `raise_missing_requirements` asks you for the missing details; `raise_obstacle` brings trade-offs and blockers to a human decision.

Everything rests on MCP sampling and elicitation, so client support decides whether it works at all. In Claude and Cursor that support is partial and `LLM_API_KEY` is mandatory — without a key the server cannot judge a plan or a diff. GitHub Copilot in VS Code is listed with full support and needs no key. Docker Desktop or Python 3.13+ is required to run it.

Each judgement is a separate model call, not a lint pass inside the IDE. Existing rules and agents still apply; the judge adds approval gates on top of them. The README suggests large-context models, 1M tokens and up, for better analysis — a weak model makes the verdicts shallow.

## Requirements
- Needs: Python and uv (commands run via uvx)

## Install

### Claude Code (native platform)

**Platform CLI**
```bash
claude mcp add mcp-as-a-judge -- uvx mcp-as-a-judge
```
uvx runs the command named after the package; if the README names another one, use uvx --from mcp-as-a-judge <command>

### Codex

**Platform CLI**
```bash
codex mcp add mcp-as-a-judge -- uvx mcp-as-a-judge
```
uvx runs the command named after the package; if the README names another one, use uvx --from mcp-as-a-judge <command>

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "mcp-as-a-judge": {
            "command": "uvx",
            "args": [
                "mcp-as-a-judge"
            ]
        }
    }
}
```
uvx runs the command named after the package; if the README names another one, use uvx --from mcp-as-a-judge <command>

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "mcp-as-a-judge": {
            "type": "stdio",
            "command": "uvx",
            "args": [
                "mcp-as-a-judge"
            ]
        }
    }
}
```
uvx runs the command named after the package; if the README names another one, use uvx --from mcp-as-a-judge <command>

### Gemini CLI

**Platform CLI**
```bash
gemini mcp add mcp-as-a-judge uvx mcp-as-a-judge
```
uvx runs the command named after the package; if the README names another one, use uvx --from mcp-as-a-judge <command>

## When to use it
- review a plan before the agent starts editing files
- catch security gaps and thin tests in a diff
- force library reuse instead of hand-rolled replacements
- surface open questions when requirements are unclear
- block task completion until code and tests pass

## Example prompts
- Register the task with `set_coding_task` and send the plan to the judge
- Run `judge_code_change` on the current diff and list the risks
- Call `raise_missing_requirements` and ask me for the missing details

## Similar
- [REA](https://affpapa.org/en/nevibecode/mcp/rea.md) — MCP server · ★ 386989
- [GitHub](https://affpapa.org/en/nevibecode/mcp/github.md) — MCP server · ★ 33918
- [Netdata](https://affpapa.org/en/nevibecode/mcp/netdata.md) — MCP server · ★ 81115
- [browser-use](https://affpapa.org/en/nevibecode/mcp/browser-use.md) — MCP server · ★ 119160
- [Codebase Memory](https://affpapa.org/en/nevibecode/mcp/codebase-memory.md) — MCP server · ★ 47392
- [mcp-server](https://affpapa.org/en/nevibecode/mcp/mcp-server.md) — MCP server · ★ 43872

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md