gemini-omni — Claude Code & Codex skill: video generation and editing
A skill for Claude Code and Codex that generates short clips via gemini-omni-1.1-flash and edits them through follow-up prompts without re-generating. Each generation returns an interaction_id so the next call changes only what you specify.
AGPL-3.0 ★ 78,316 updated 2026-10-24
npx skills add calesthio/OpenMontage --skill gemini-omni -a claude-codeWhat gemini-omni does
The skill runs on Claude Code and Codex through the gemini_omni_video tool, which calls the Gemini Interactions API directly with no gateway in between. Output is 3–10 second clips at 720p with synthesized audio, on-screen text, and scenes timed via bracketed ranges like [0-3s].
Within the OpenMontage toolkit, the differentiator is stateful editing. A generation call returns interaction_id; passing it as previous_interaction_id on the next call patches the clip in place. Keep edit prompts short and surgical — a descriptive scene prompt rewrites the whole clip. Routes through fal.ai or Runway do not carry Google's interaction state, so conversational editing only works through the direct gemini_omni_video call.
The skill reads GEMINI_API_KEY or GOOGLE_API_KEY from the project environment, the same key used by google_imagen and google_tts. Output video is billed at $17.50 per million tokens, roughly $0.10 per second; when usage data is unavailable, the adapter falls back to a maximum 10-second estimate. Reference images go in reference_image_paths and are bound to roles in the prompt via <IMAGE_REF_0>, <IMAGE_REF_1>, etc.; <FIRST_FRAME> pins an image as the opening frame. No seed support means generations are not reproducible.
What it helps with
- edit a generated clip in place without re-running the full generation
- generate a clip with synthesized audio and timed on-screen text
- bind a reference image to a character or style using prompt tags
- schedule scene changes across a single prompt with timecodes
- restyle or remove an object from an existing uploaded video
Example prompts for the agent
- Generate a 5-second clip: tabby cat on a sunny windowsill, tail twitching slowly, soft background music
- Remove the phone from her hand, keep everything else — pass
previous_interaction_idfrom the last response - Start from
<FIRST_FRAME>usinghero.jpg: woman walking,[0-3s]she pauses,[3-6s]turns around
How to install gemini-omni
1Skills CLI (Vercel)
npx skills add calesthio/OpenMontage --skill gemini-omni -a claude-code2Manually: put the files in place
~/.claude/skills/gemini-omni/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/gemini-omni/
1Skills CLI (Vercel)
npx skills add calesthio/OpenMontage --skill gemini-omni -a codex2Manually: put the files in place
.agents/skills/gemini-omni/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add calesthio/OpenMontage --skill gemini-omni -a cursor2Manually: put the files in place
.cursor/skills/gemini-omni/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install calesthio/OpenMontage .agents/skills/gemini-omni2Manually: put the files in place
.github/skills/gemini-omni/SKILL.md1Skills CLI (Vercel)
npx skills add calesthio/OpenMontage --skill gemini-omni -a gemini-cli2Platform CLI
gemini skills install https://github.com/calesthio/OpenMontage --path .agents/skills/gemini-omniManually: put the files in place
.devin/skills/gemini-omni/SKILL.mdThe legacy .windsurf/skills/ path still works
Claude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about gemini-omni
How do I install gemini-omni in Claude Code?
Run npx skills add calesthio/OpenMontage --skill gemini-omni -a claude-code. The skill is then available at ~/.claude/skills/gemini-omni/SKILL.md.
What does the gemini-omni skill do?
It generates 3–10 second 720p video clips through gemini-omni-1.1-flash and lets you edit them conversationally. Each response carries an interaction_id that the next call uses to patch only the specified part of the clip.
Does gemini-omni need its own API key?
No separate key — it uses GEMINI_API_KEY or GOOGLE_API_KEY already in the project environment, the same credentials as google_imagen and google_tts. Access requires a paid Gemini API tier.