Sonicmatch — Claude Code MCP server: what it does, how to install
Analyzes video pacing and speech to select license-safe background music with an ffmpeg ducking setup. Built for short-form clips and automated editing workflows.
Open on GitHubWhat Sonicmatch does
Sonicmatch evaluates the video footage directly. It inspects scene pacing, cut points, and voice activity rather than guessing from a text script. After scanning the visual energy, it selects matching background music, marks a 12–20s hook window, and builds audio ducking parameters for voice sections.
Without ffmpeg and ffprobe in your PATH, the server cannot run. It requires Python 3.10+ and operates in stdio or local HTTP mode on loopback. The server works out of the box with a local seed catalog of 20 tracks. External connections to Gemini, Jamendo, or Freesound remain optional and rely on environment variables.
Every recommendation includes an explicit license label. Non-commercial audio such as CC-BY-NC is excluded from automated suggestions to keep promotional content safe. Output arrives as an ffmpeg mixing recipe or an EDL-style cut list snapped to track tempo.
What it helps with
- match royalty-free music to the visual pace of a clip
- calculate ducking volume drops beneath voice tracks
- generate ready-to-run
ffmpegaudio mix commands - snap video scene cuts to musical BPM intervals
Example prompts for the agent
- Inspect
clip.mp4and suggest three royalty-free instrumental tracks with ducking settings. - Analyze speech segments in
reel.mp4and build anffmpegmix command for the chosen track. - Align edit cuts in
video.mp4to the beat of an imported background track.
How to install Sonicmatch
Install
The MCP registry has no launch command for it: see the repository README
Step by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about Sonicmatch
How to install Sonicmatch in Claude Code?
Run the server directly using uvx --from git+https://github.com/js713-lab/sonic-match-mcp.git sonicmatch-mcp. Ensure ffmpeg and ffprobe are installed on your system PATH.
What does Sonicmatch do?
It scans video files for pace, scene transitions, and voice presence to recommend license-cleared background music. It also produces ducking parameters and hook timestamps for editing.
Are external API keys mandatory?
No, the server operates offline using built-in audio heuristics and a starter catalog of 20 tracks. Services like Gemini and Jamendo are optional additions.
