# multimodal-whisper

A Claude skill that wires up Whisper: transcribe audio in 99 languages, translate to English, and detect the spoken language.

- skill · `type=skill` · Claude Code · 91 installs
- Author: Orchestra Research
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/davila7/claude-code-templates/tree/HEAD/cli-tool/components/skills/ai-research/multimodal-whisper
- Updated: 2026-10-24
- HTML: https://affpapa.org/en/nevibecode/skills/multimodal-whisper

## What it does

The skill gives your agent access to OpenAI's Whisper speech recognition model. It transcribes audio and video, translates speech into English, and identifies the language of a recording. Useful when a podcast, meeting or interview needs to become text inside the project.

Six model sizes ship with it, from tiny at 39M parameters to large at 1550M. For a balance of speed and quality the docs point to `turbo`; `base` is fine for prototyping. You get word-level timestamps, an `initial_prompt` for technical terms and proper nouns, and temperature fallback when confidence drops. Output can be txt, srt, vtt or json.

You need Python 3.8–3.11, the `openai-whisper` package and `ffmpeg` before anything runs. GPU processing is much faster than CPU, so match the model size to your VRAM. Whisper can hallucinate on long recordings, which makes a read-through worth the time.

## Install

### Claude Code (native platform)

1. **claude-code-templates**
```bash
npx claude-code-templates@latest --skill ai-research/multimodal-whisper
```

2. **Skills CLI (Vercel)**
```bash
npx skills add davila7/claude-code-templates --skill multimodal-whisper -a claude-code
```

3. **Manually: put the files in place**
- File: `~/.claude/skills/multimodal-whisper/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/multimodal-whisper/

### Codex

**Manually: put the files in place**
- File: `.agents/skills/multimodal-whisper/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

**Manually: put the files in place**
- File: `.cursor/skills/multimodal-whisper/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install davila7/claude-code-templates multimodal-whisper
```

2. **Manually: put the files in place**
- File: `.github/skills/multimodal-whisper/SKILL.md`

### Gemini CLI

**Platform CLI**
```bash
gemini skills install https://github.com/davila7/claude-code-templates --path cli-tool/components/skills/ai-research/multimodal-whisper
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/multimodal-whisper/SKILL.md` — The legacy .windsurf/skills/ path still works

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/davila7/claude-code-templates/tree/HEAD/cli-tool/components/skills/ai-research/multimodal-whisper

## When to use it
- turn a podcast or interview into text
- generate srt subtitles for a video
- translate a foreign-language recording into English
- detect which language a speaker is using
- pull notes out of a noisy meeting recording

## Example prompts
- Transcribe `audio.mp3` with the `turbo` model and save the text
- Generate srt subtitles from `video.mp4` in English
- Translate `spanish.mp3` to English with word timestamps

## Similar
- [vision-multimodal](https://affpapa.org/en/nevibecode/skills/vision-multimodal.md) — skill · 550 installs
- [ai-multimodal](https://affpapa.org/en/nevibecode/skills/ai-multimodal.md) — skill · 530 installs
- [bailian-gen](https://affpapa.org/en/nevibecode/skills/bailian-gen.md) — skill · 9200 installs
- [openai-whisper](https://affpapa.org/en/nevibecode/skills/openai-whisper.md) — skill · 7100 installs
- [openai-whisper-api](https://affpapa.org/en/nevibecode/skills/openai-whisper-api.md) — skill · 5400 installs
- [faster-whisper](https://affpapa.org/en/nevibecode/skills/faster-whisper.md) — skill · 1800 installs

From the same set: [davila7/claude-code-templates](https://affpapa.org/en/nevibecode/by/davila7/claude-code-templates.md) — 361 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md