# music-to-video

music-to-video turns a music track into a beat-synced HyperFrames video. Use it for lyric-style clips, slideshows, or kinetic promo visuals with optional media.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, Windsurf (Devin Desktop), Claude.ai · ★ 78316 repo stars
- Author: calesthio
- License: AGPL-3.0 · policy=link-only · description only; the file stays with the author
- Source: https://github.com/calesthio/OpenMontage/tree/HEAD/.agents/skills/music-to-video/SKILL.md
- Updated: 2026-10-24
- Security check: automated, 2026-11-16 (text) — no signs of malicious code found.
- HTML: https://affpapa.org/en/nevibecode/skills/music-to-video

## What it does

This skill uses an audio file, or extracts audio from a supplied video, as the basis for the edit. It creates one timing map, lays out the frames, and sends each frame to a separate sub-agent for composition. Text and templates provide the baseline, so the project can start without image or video assets.

The workflow moves through `hyperframes.json`, `STORYBOARD.md`, HTML files under `compositions/frames/`, and the final `renders/video.mp4`. Music analysis requires Python 3 with `librosa`, `numpy`, and `soundfile`; without those packages, the analyzer will fail. The user approves the plan and the render at separate gates. Supplied images or videos can be placed on the same beat grid.

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add calesthio/OpenMontage --skill music-to-video -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/music-to-video/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/music-to-video/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add calesthio/OpenMontage --skill music-to-video -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/music-to-video/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add calesthio/OpenMontage --skill music-to-video -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/music-to-video/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install calesthio/OpenMontage .agents/skills/music-to-video
```

2. **Manually: put the files in place**
- File: `.github/skills/music-to-video/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add calesthio/OpenMontage --skill music-to-video -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/calesthio/OpenMontage --path .agents/skills/music-to-video
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/music-to-video/SKILL.md` — The legacy .windsurf/skills/ path still works

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/calesthio/OpenMontage/tree/HEAD/.agents/skills/music-to-video/SKILL.md

## When to use it
- turn a music track into a video
- sync frame changes to musical timing
- map sections around energy shifts and silences
- cut supplied media into planned frames

## Example prompts
- Turn `assets/bgm.mp3` into a beat-synced HyperFrames video with typography.
- Analyze this track and draft `STORYBOARD.md` for a calm visual sequence.
- Use my supplied images in the frames according to the track’s timing map.

## Similar
- [music-video-subtitle-generator](https://affpapa.org/en/nevibecode/skills/music-video-subtitle-generator.md) — skill · 3700 installs
- [scenario-seedance-music-video](https://affpapa.org/en/nevibecode/skills/scenario-seedance-music-video.md) — skill · 865 installs
- [general-video](https://affpapa.org/en/nevibecode/skills/general-video.md) — skill · ★ 328 repo stars
- [launch-video](https://affpapa.org/en/nevibecode/skills/launch-video.md) — skill · 3400 installs
- [8-bit-orbit-video-template](https://affpapa.org/en/nevibecode/skills/8-bit-orbit-video-template.md) — skill · 3100 installs
- [weread-year-in-review-video-template](https://affpapa.org/en/nevibecode/skills/weread-year-in-review-video-template.md) — skill · 2600 installs

From the same set: [calesthio/openmontage](https://affpapa.org/en/nevibecode/by/calesthio/openmontage.md) — 101 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md
