Skip to main content
skill CX Codex

llm-council · happycapy-ai — Claude Code skill: compare AI models

llm-council is a Claude Code skill that sends one prompt to several AI models and displays their replies side by side, with shared-answer synthesis and anonymous voting.

MIT ★ 138 updated 2026-09-03

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add happycapy-ai/Happycapy-skills --skill llm-council -a claude-code
Open on GitHub

What llm-council does

llm-council starts a web dashboard for querying models through AI Gateway. Replies arrive in parallel, so you can inspect them together; separate actions produce a consensus summary or run an anonymous vote. Model responses stream over SSE.

The skill includes a ThreadingHTTPServer backend, an AI Gateway client, and the dashboard’s static files. Running it requires python3 and the AI_GATEWAY_API_KEY environment variable. Set the server port with COUNCIL_PORT; it defaults to 8787. Requests to AI Gateway depend on that API key.

Install with npx skills add happycapy-ai/Happycapy-skills --skill llm-council -a claude-code. Start server.py from ~/.claude/skills/llm-council/scripts; the launch instructions check /health and export the port for browser access.

What it helps with

  • Compare several models’ answers to one prompt
  • Send parallel model queries through AI Gateway
  • Combine model replies into a consensus
  • Run an anonymous vote among models

Example prompts for the agent

  • Start the LLM Council and ask the models how to handle errors in this project.
  • Compare the available models’ answers about this architecture choice.
  • Run an anonymous model vote on this proposal.

How to install llm-council

1Skills CLI (Vercel)

npx skills add happycapy-ai/Happycapy-skills --skill llm-council -a claude-code

2Manually: put the files in place

~/.claude/skills/llm-council/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/llm-council/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about llm-council

How do I install llm-council in Claude Code?

Run npx skills add happycapy-ai/Happycapy-skills --skill llm-council -a claude-code. The skill file is at ~/.claude/skills/llm-council/SKILL.md.

What does llm-council do?

It launches a dashboard for parallel queries to multiple models, side-by-side replies, consensus synthesis, and anonymous voting.

What does llm-council need to run?

It requires python3 and the AI_GATEWAY_API_KEY environment variable. Configure the port with COUNCIL_PORT; the default is 8787.

Source text

SKILL.md · MIT
---
name: llm-council
description: >-
  Multi-model LLM Council with live dashboard. Query multiple AI models simultaneously,
  see responses side-by-side in a swarm-style dashboard, synthesize consensus, and run
  anonymous model-to-model voting. Use when the user asks to start the LLM council,
  compare models, query multiple models, convene council, ask all models, do model
  comparison, run multi-model queries, or launch the council dashboard. Supports
  Claude Sonnet 4.5, Claude Opus 4.5, GPT-4o, GPT-5.1, Gemini 2.5 Flash, and
  Gemini 2.5 Pro via AI Gateway.
---

# LLM Council

Query multiple AI models in parallel with a live web dashboard.

## Launch

```bash
cd ~/.claude/skills/llm-council/scripts
# Kill any existing server on the port
fuser -k 8787/tcp 2>/dev/null
# Start server
nohup python3 server.py > /tmp/council-server.log 2>&1 &
# Wait for startup, verify health
sleep 2 && curl -s --max-time 5 http://localhost:8787/health
# Export port for browser access
/app/export-port.sh 8787
```

Environment: `COUNCIL_PORT` (default 8787), `AI_GATEWAY_API_KEY` (required, auto-detected from environment).

## Files

- `scripts/server.py` - ThreadingHTTPServer, serves static files + API routes, SSE streaming
- `scripts/ai_gateway.py` - AI Gateway client: query, parallel query, streaming, synthesis, anonymous voting
- `scripts/static/index.html` - Dashboard UI (HappyCapy design system, light/dark theme)
- `scripts/static/app.js` - Client-side logic (model selector, SSE parsing, markdown rendering, voting UI)

## API

| Method | Path | Description |
|--------|------|-------------|
| GET | `/` | Dashboard |
| GET | `/api/models` | List models |
| GET | `/health` | Health check |
| POST | `/api/council/stream` | Query models (SSE) |
| POST | `/api/council/synthesize` | Synthesize consensus |
| POST | `/api/council/vote` | Anonymous model vote (SSE with keepalive) |

## Key Details

- Server uses `ThreadingHTTPServer` for concurrent request handling
- Vote endpoint streams SSE keepalive pings every 5s to prevent proxy timeouts (Cloudflare 524)
- Static files served with `Cache-Control: no-store, no-cache` headers
- Script tag uses cache-busting version param: `app.js?v=...` (bump when editing app.js)
- Model IDs use dots not hyphens: `anthropic/claude-sonnet-4.5` (not `claude-sonnet-4-5`)

© happycapy-ai · MIT · happycapy-ai/Happycapy-skills

Similar skills

All skills for AI and ML →

llm-council by other authors comes first.

llm-council aiwithremy llm-council is a Claude Code skill that launches five advisor sub-agents with distinct thinking styles to analyze a question independently, review each other's answers, and produce a final verdict. CX Codex +1 1,600installs llm-council am-will The llm-council skill runs several CLI agents as independent planners, strips their identities, and merges the results into one final plan. Useful when a single model's bias is the problem. CX Codex +1 1,200installs llm-council Rohit Ghumare llm-council runs multi-model deliberation in three stages: parallel drafts, anonymous peer rankings, and final synthesis by a designated chairman. CX Codex +1 ★ 2,966repo stars council t3dotgg The council skill triggers a simultaneous code review by three different AI models to gather independent feedback. The agent summarizes the findings and assists in applying necessary fixes. CX Codex +1 1,500installs LLM Council shuntacurosu LLM Council coordinates multiple LLMs across three stages: independent responses, anonymized peer grading, and chairman synthesis. CX Codex +1 5installs runcomfy-cli prime-skills Skill for Claude Code, Codex, Cursor, Copilot, Gemini CLI and OpenCode teaches the agent to work with RunComfy CLI. CX Codex +1 390,900installs vercel-ai bobmatnyc Architecture guidance for Vercel AI SDK, AI Gateway, and MCP workflows. Helps when building agentic workloads on Vercel. CX Codex +1 341installs neon-ai-gateway neondatabase This skill teaches your agent to route LLM and embedding calls through Neon AI Gateway, using a single Neon credential instead of separate provider keys. CX Codex +1 45,800installs cli-models cheaper-inference cli-models — a skill that lets the agent query the Anthropic model catalog from the command line: search, filter by provider, add and edit entries. CX Codex +1 1,300installs

From the same set41

The whole set →
video-frames video-frames pulls frames and thumbnails from video files using ffmpeg. It helps Claude Code inspect video contents or grab screenshots at specific timestamps. CX Codex +1 ★ 138repo stars weather Fetches current conditions and forecasts for a city or airport. It works for quick answers and JSON-based weather requests. CX Codex +1 ★ 138repo stars oss-contributor-swarm oss-contributor-swarm deploys an autonomous 9-agent swarm to discover simple GitHub issues, write fixes, and submit pull requests. CX Codex +1 ★ 138repo stars capy-cortex capy-cortex keeps a local base of rules, anti-patterns and preferences, then feeds the matching ones into context through hooks. Useful when an agent keeps repeating the same mistakes. CX Codex +1 ★ 138repo stars happycapy-skill-creator happycapy-skill-creator adapts existing skills from anthropics/skills for HappyCapy environments. It strips Docker dependencies and bundles the result into a .skill archive. CX Codex +1 ★ 138repo stars youtube-music Search YouTube Music by track or artist, then open a result in the default browser. It needs an API key and MCP configuration. CX Codex +1 ★ 138repo stars agent-4-code-writer agent-4-code-writer — a Claude Code subagent that implements fixes or features within an open-source contributor swarm using an existing issue plan and codebase map. CX Codex ★ 138repo stars agent-3-codebase-explorer agent-3-codebase-explorer explores a repository before a fix or feature, locating relevant files and documenting the project structure for the next agents. CX Codex ★ 138repo stars

Project sponsors

Companies that keep this analytics open