Skip to main content
skill

voice-agents · davila7 — Claude Code skill: build low-latency voice agents

Walks you through picking a voice agent architecture, budgeting latency and handling interruptions without awkward pauses.

Install into Claude Code · claude-code-templates All methods and platforms ↓
npx claude-code-templates@latest --skill ai-research/voice-agents
Open on GitHub

What voice-agents does

The skill lays out two ways to build a voice agent. Speech-to-speech on the OpenAI Realtime API sends audio straight to audio: lowest latency, emotion preserved, less control. The pipeline route runs STT→LLM→TTS, so every step stays inspectable and easier to debug, at the cost of added milliseconds.

Its core point: latency is the constraint. Each component contributes its own delay, and the total decides whether a conversation feels natural. So the skill tells you to measure and budget latency per component first, before picking models.

Inside are patterns for voice activity detection, barge-in detection and turn-taking, plus a list of anti-patterns. The sharp edges get their own section: turn detection that only listens for silence, long responses, background noise, STT errors. It pairs with agent-tool-builder, multi-agent-orchestration, llm-architect and backend.

What it helps with

  • choose between speech-to-speech and an STT→LLM→TTS pipeline
  • budget latency across every component in the chain
  • set up voice activity detection and turn-taking
  • detect barge-in so the agent stops talking when interrupted
  • keep agent replies short and spoken-friendly

Example prompts for the agent

  • help me design a voice agent on the Anthropic Realtime API
  • break down latency per component in an STT→LLM→TTS pipeline
  • how do I implement barge-in detection in a voice agent

How to install voice-agents

1claude-code-templates

npx claude-code-templates@latest --skill ai-research/voice-agents

2Skills CLI (Vercel)

npx skills add davila7/claude-code-templates --skill voice-agents -a claude-code

3Manually: put the files in place

~/.claude/skills/voice-agents/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/voice-agents/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about voice-agents

How do I install voice-agents in Claude?

Use the templates CLI: npx claude-code-templates@latest --skill ai-research/voice-agents. Or install with npx skills add davila7/claude-code-templates --skill voice-agents -a claude-code. The skill lands at ~/.claude/skills/voice-agents/SKILL.md.

What does voice-agents do?

It covers voice agent architectures and their latency trade-offs. You get patterns for speech detection, barge-in and turn-taking, plus a list of anti-patterns to avoid.

How is speech-to-speech different from a pipeline?

Speech-to-speech on the OpenAI Realtime API gives the lowest latency and keeps emotional nuance, but is harder to steer. An STT→LLM→TTS pipeline gives control at each step and is easier to debug, but adds latency.

Similar skills

Everything for AI and ML →

voice-agents by other authors comes first.

From the same set205

The whole set →

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor