Skip to main content
affpapa.org
RU EN
skill Claude Code CX Codex Cursor GitHub Copilot

video-understand — Claude Code skill: what it does, install

This skill extracts video frames and transcribes audio locally with ffmpeg and Whisper. Use it to inspect video content without API keys.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓ 
npx skills add calesthio/OpenMontage --skill video-understand -a claude-code
Open on GitHub

What video-understand does

The skill accepts a video file and produces JSON with its duration, resolution, extraction mode, frames, and transcript. It can detect scene changes, extract codec keyframes, or sample frames at even intervals. When scene detection finds no changes, it falls back to interval extraction.

The package includes the Python script skills/video-understand/scripts/understand_video.py. It can cap the number of frames, select a Whisper model, skip transcription, write JSON to a file, or emit JSON without progress messages. Frame extraction uses ffmpeg and ffprobe; audio transcription uses openai-whisper. Plan for ffmpeg and ffprobe before running it. Whisper is only needed for transcript output.

The JSON includes frame paths and timestamps, so an agent can inspect the images with the Read tool. Use -m keyframe for codec keyframes, -m interval for predictable sampling, or leave the scene mode in place for scene-change detection.

What it helps with

  • extract key frames from a video
  • transcribe video audio locally
  • return video metadata and content as JSON
  • sample frames at regular intervals
  • skip transcription while keeping extracted frames

Example prompts for the agent

  • Analyze `video.mp4`, detect scene changes, and transcribe its audio.
  • Run `python3 skills/video-understand/scripts/understand_video.py video.mp4 -m keyframe` and inspect the extracted frames.
  • Process `video.mp4` without transcription and save the JSON result to `result.json` using `--no-transcribe -o result.json`.

How to install video-understand

1Skills CLI (Vercel)

npx skills add calesthio/OpenMontage --skill video-understand -a claude-code

2Manually: put the files in place

~/.claude/skills/video-understand/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/video-understand/

From the same set28

The whole set →
remotion calesthio Teaches AI agents toolkit-specific Remotion patterns, including custom transition shaders and 30 fps video rules. Claude Code CX Codex Cursor +1 1,200installs video-download calesthio Uses yt-dlp to fetch video, audio, subtitles, or URL metadata. Use it when you need a local file, a selected resolution, or details without downloading media. Claude Code CX Codex Cursor +1 1,200installs lottie-bodymovin calesthio Applies Disney's 12 animation principles to Lottie vector animations. Bridges After Effects setup with runtime JavaScript controls. Claude Code CX Codex Cursor +1 1,100installs create-video calesthio This skill turns a description into a finished video: write what you want to see, and HeyGen generates the script, picks an avatar, adds voiceover and editing. Good for quick demos, explainers and promos without tweaking every detail. Claude Code CX Codex Cursor +1 1,100installs video-toolkit calesthio Automates video creation: generates voiceovers, background music, animates talking heads, and composes scenes with Remotion. Requires Node.js, Python3, ffmpeg, and cloud GPU access (Modal or RunPod). Claude Code CX Codex Cursor +1 1,100installs text-to-speech calesthio Generates speech audio with HeyGen Starfish and lets you choose a voice, speed, and pitch. Useful for voiceovers, narration, and podcasts. Claude Code CX Codex Cursor +1 1,100installs bfl-api Black Forest Labs This skill helps connect BFL FLUX API for image generation and editing. It covers async requests, polling, rate limits, and webhooks. Claude Code CX Codex Cursor +1 1,000installs threejs-textures calesthio Skill for working with Three.js textures: image loading, UV coordinates, cubemaps, HDR environments and optimization. Use when building 3D scenes with materials, skyboxes and reflection maps. Claude Code CX Codex Cursor +1 1,000installs

Similar

seedance-v2 prime-skills Generates cinematic short-form video using ByteDance Seedance 2.0 Pro via RunComfy. Useful for dialogue scenes with native lip-sync and multimodal references. Claude Code CX Codex Cursor +1 435,800installs happyhorse-1-0 prime-skills Skill to generate video with HappyHorse 1.0 on RunComfy. The model ranks #1 on Artificial Analysis Video Arena, produces 1080p video with synchronized audio in a single pass, and maintains character consistency across shots. Claude Code CX Codex Cursor +1 435,700installs flux-2-klein prime-skills Generates images using Black Forest Labs' Flux 2 Klein via RunComfy with tailored prompting patterns for fast iteration and polish. Claude Code CX Codex Cursor +1 435,500installs seedance-prompt-en dexhunter A skill for writing prompts to Seedance 2.0, ByteDance's video generator. Use it when you create videos from text, images, video and audio via the @ reference system. Claude Code CX Codex Cursor +1 3,100installs n8n-validation-expert czlonkowski Interprets n8n validation errors and warnings, identifies which block workflow execution and which are false positives. Explains why a node config fails validation and guides the fix in 2–3 iterations. Claude Code CX Codex Cursor +1 6,800installs kling-3-0 prime-skills Run Kling 3.0 through the RunComfy CLI to make video from a prompt or animate a source image. Choose a tier and mode for the output you need. Claude Code CX Codex Cursor +1 412,700installs skill-creator official anthropics Creates and refines skills, then tests them with prompts, evaluations, and performance checks. Claude Code Claude.ai 414,180installs writing-for-agents Matt Pocock Guidance for writing skills and agent-facing documents. Use it when editing AGENTS.md, CLAUDE.md, or reference files reached from them. Claude Code 466,719installs

Questions about video-understand

How do I install video-understand in Claude Code?

Run npx skills add calesthio/OpenMontage --skill video-understand -a claude-code, then run npx skills add calesthio/OpenMontage --skill video-understand -a claude-code again. The skill file is at ~/.claude/skills/video-understand/SKILL.md.

What does video-understand do?

It extracts frames with ffmpeg, transcribes audio with Whisper, and returns video details as JSON. Processing is local.

What is required for video transcription?

The script requires ffmpeg and ffprobe. Transcription also needs the openai-whisper package; frame extraction can run with --no-transcribe.

See also

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor