# mcp

Connects an AI assistant to the Scorecard REST API so it can browse endpoints, fire test requests and help wire the SDK into your app.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI
- Author: scorecard-ai
- License: Apache-2.0 · policy=link-only · description only; the file stays with the author
- Source: https://github.com/scorecard-ai/scorecard-node
- Updated: 2026-10-06
- HTML: https://affpapa.org/en/nevibecode/mcp/scorecard-ai-mcp

## What it does

The server sits between your assistant and Scorecard's API. The agent pulls the documentation from there, tries endpoints with real calls, and suggests how to use `scorecard-ai` in your code. Handy when you evaluate and tune LLM systems and don't want to copy schemas by hand.

You can reach it over HTTP at `https://mcp.scorecard.io/mcp` or run it locally through `npx -y scorecard-ai-mcp`. The local path needs `SCORECARD_API_KEY`; without it the server can't authenticate, so requests fail. The library itself is a regular npm package.

It works with the same objects the SDK exposes: testsets, testcases, runs. If you already have a key and a Scorecard project, adding the server to your client takes a couple of commands.

## Requirements
- Needs: Node.js (commands run via npx)
- Remote server: `https://mcp.scorecard.io/mcp`
- Environment variables: `SCORECARD_API_KEY` — keys and tokens: ask the human for the values, never commit them or put them in shared files.

## Install

### Claude Code (native platform)

1. **Platform CLI: remote server**
```bash
claude mcp add --transport http mcp https://mcp.scorecard.io/mcp
```

2. **Platform CLI**
```bash
claude mcp add --env SCORECARD_API_KEY=<SCORECARD_API_KEY> --transport stdio scorecard-ai-mcp -- npx -y scorecard-ai-mcp
```
Replace <…> with your own values

### Codex

1. **Platform CLI: remote server**
```bash
codex mcp add scorecard-ai-mcp --url https://mcp.scorecard.io/mcp
```

2. **Platform CLI**
```bash
codex mcp add scorecard-ai-mcp --env SCORECARD_API_KEY=<SCORECARD_API_KEY> -- npx -y scorecard-ai-mcp
```
Replace <…> with your own values

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "scorecard-ai-mcp": {
            "url": "https://mcp.scorecard.io/mcp"
        }
    }
}
```
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "scorecard-ai-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "scorecard-ai-mcp"
            ],
            "env": {
                "SCORECARD_API_KEY": "<SCORECARD_API_KEY>"
            }
        }
    }
}
```
Replace <…> with your own values

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "scorecard-ai-mcp": {
            "type": "http",
            "url": "https://mcp.scorecard.io/mcp"
        }
    }
}
```
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "scorecard-ai-mcp": {
            "type": "stdio",
            "command": "npx",
            "args": [
                "-y",
                "scorecard-ai-mcp"
            ],
            "env": {
                "SCORECARD_API_KEY": "<SCORECARD_API_KEY>"
            }
        }
    }
}
```
Replace <…> with your own values

### Gemini CLI

1. **Platform CLI: remote server**
```bash
gemini mcp add -t http scorecard-ai-mcp https://mcp.scorecard.io/mcp
```

2. **Platform CLI**
```bash
gemini mcp add -e SCORECARD_API_KEY=<SCORECARD_API_KEY> scorecard-ai-mcp npx -y scorecard-ai-mcp
```
Replace <…> with your own values

## When to use it
- browse Scorecard API endpoints from a chat window
- send a test request without hand-writing curl
- add `scorecard-ai` to an app with the assistant's guidance
- inspect a testset or run structure using the docs
- check an API response before writing integration code

## Example prompts
- List the Scorecard endpoints for working with testsets
- Send a test request to the Scorecard API and show me the response
- Help me call `client.runs.create` from `scorecard-ai` in my project

## Similar
- [MCP Toolbox for Databases](https://affpapa.org/en/nevibecode/mcp/googleapis-mcp-toolbox-for-databases.md) — MCP server · ★ 16730
- [labelhead-artist-momentum](https://affpapa.org/en/nevibecode/mcp/labelhead-artist-momentum.md) — MCP server · ★ 107701
- [Agent Skills Search Server](https://affpapa.org/en/nevibecode/mcp/agent-skills-search-server.md) — MCP server · ★ 26673
- [Skyvern](https://affpapa.org/en/nevibecode/mcp/skyvern.md) — MCP server · ★ 23283
- [Nhost](https://affpapa.org/en/nevibecode/mcp/nhost.md) — MCP server · ★ 9369
- [PraisonAI](https://affpapa.org/en/nevibecode/mcp/praisonai.md) — MCP server · ★ 9298

## Other versions with the same name
- [mcp · kubeshark](https://affpapa.org/en/nevibecode/mcp/kubeshark-mcp.md) — ★ 12110
- [mcp · butterbase-ai](https://affpapa.org/en/nevibecode/mcp/butterbase-ai-mcp.md) — ★ 3031
- [mcp · medplum](https://affpapa.org/en/nevibecode/mcp/mcp.md) — ★ 2766
- [mcp · sceneview](https://affpapa.org/en/nevibecode/mcp/sceneview-mcp.md) — ★ 1349
- [mcp · buoy-gg](https://affpapa.org/en/nevibecode/mcp/buoy-gg-mcp.md) — ★ 691

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md