# Scorecard

Scorecard — an MCP server that tests and evaluates LLM apps: scenario checks, a running view of model behaviour and performance numbers, all from inside your AI client.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI
- Author: docker
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/docker/mcp-registry/blob/98a203ca6e58c67031b8aaed037a26a07ec73ce3/servers/scorecard/server.yaml
- Updated: 2026-10-29
- Security check: automated, 2026-11-16 (text) — no signs of malicious code found.
- HTML: https://affpapa.org/en/nevibecode/mcp/scorecard

## What it does

Scorecard is an MCP server for evaluating LLM apps: scenario tests plus a running view of how the model behaves. It earns its place once the app is built and you need to know what it actually answers.

Benchmarks for performance sit alongside the tests and monitoring. The server is listed for Claude, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed and Gemini CLI.

docker is behind it. Stay in one client and never switch, and the rest of that list does nothing for you.

## Requirements
- Needs: Docker

## Install

### Claude Code (native platform)

**Install**
- The MCP registry has no launch command for it: see the repository README

## When to use it
- run an LLM app through structured test scenarios
- keep watching model behaviour after a change ships
- benchmark performance and compare runs
- evaluate an LLM app before release

## Example prompts
- Run my LLM service through `Scorecard` tests and list what broke.
- Pull the performance numbers from `Scorecard` for the latest build.
- Start `Scorecard` monitoring on the model responses and tell me what shifted today.

## Similar
- [llm-evaluation](https://affpapa.org/en/nevibecode/skills/llm-evaluation.md) — skill · 12755 installs
- [agent-evaluation](https://affpapa.org/en/nevibecode/skills/agent-evaluation.md) — skill · 378 installs
- [evaluation-harness](https://affpapa.org/en/nevibecode/skills/evaluation-harness.md) — skill · 275 installs
- [genai-hub-prompt-evaluation](https://affpapa.org/en/nevibecode/skills/genai-hub-prompt-evaluation.md) — skill · 185 installs
- [inference-optimisation](https://affpapa.org/en/nevibecode/skills/inference-optimisation.md) — skill · ★ 1699 repo stars
- [agent-eval](https://affpapa.org/en/nevibecode/skills/agent-eval.md) — skill · 6200 installs

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md
