voice-agents · davila7 — Claude Code skill: build low-latency voice agents
Walks you through picking a voice agent architecture, budgeting latency and handling interruptions without awkward pauses.
npx claude-code-templates@latest --skill ai-research/voice-agentsWhat voice-agents does
The skill lays out two ways to build a voice agent. Speech-to-speech on the OpenAI Realtime API sends audio straight to audio: lowest latency, emotion preserved, less control. The pipeline route runs STT→LLM→TTS, so every step stays inspectable and easier to debug, at the cost of added milliseconds.
Its core point: latency is the constraint. Each component contributes its own delay, and the total decides whether a conversation feels natural. So the skill tells you to measure and budget latency per component first, before picking models.
Inside are patterns for voice activity detection, barge-in detection and turn-taking, plus a list of anti-patterns. The sharp edges get their own section: turn detection that only listens for silence, long responses, background noise, STT errors. It pairs with agent-tool-builder, multi-agent-orchestration, llm-architect and backend.
What it helps with
- choose between speech-to-speech and an STT→LLM→TTS pipeline
- budget latency across every component in the chain
- set up voice activity detection and turn-taking
- detect barge-in so the agent stops talking when interrupted
- keep agent replies short and spoken-friendly
Example prompts for the agent
- help me design a voice agent on the Anthropic Realtime API
- break down latency per component in an STT→LLM→TTS pipeline
- how do I implement barge-in detection in a voice agent
How to install voice-agents
1claude-code-templates
npx claude-code-templates@latest --skill ai-research/voice-agents2Skills CLI (Vercel)
npx skills add davila7/claude-code-templates --skill voice-agents -a claude-code3Manually: put the files in place
~/.claude/skills/voice-agents/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/voice-agents/
Manually: put the files in place
.agents/skills/voice-agents/SKILL.mdFor all projects use ~/.agents/skills/
Manually: put the files in place
.cursor/skills/voice-agents/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install davila7/claude-code-templates voice-agents2Manually: put the files in place
.github/skills/voice-agents/SKILL.mdPlatform CLI
gemini skills install https://github.com/davila7/claude-code-templates --path cli-tool/components/skills/ai-research/voice-agentsManually: put the files in place
.devin/skills/voice-agents/SKILL.mdThe legacy .windsurf/skills/ path still works
Claude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about voice-agents
How do I install voice-agents in Claude?
Use the templates CLI: npx claude-code-templates@latest --skill ai-research/voice-agents. Or install with npx skills add davila7/claude-code-templates --skill voice-agents -a claude-code. The skill lands at ~/.claude/skills/voice-agents/SKILL.md.
What does voice-agents do?
It covers voice agent architectures and their latency trade-offs. You get patterns for speech detection, barge-in and turn-taking, plus a list of anti-patterns to avoid.
How is speech-to-speech different from a pipeline?
Speech-to-speech on the OpenAI Realtime API gives the lowest latency and keeps emotional nuance, but is harder to steer. An STT→LLM→TTS pipeline gives control at each step and is easier to debug, but adds latency.
Similar skills
Everything for AI and ML →voice-agents by other authors comes first.