minimax-image-understanding — Claude Code skill: setup and use
This skill connects your coding agent to MiniMax vision models via understand_image. It handles screenshot OCR, UI layout inspection, and visual bug diagnostics.
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a claude-codeWhat minimax-image-understanding does
The skill equips the agent with the understand_image tool, sending prompts and image payloads to the MiniMax VLM endpoint at {api_host}/v1/coding_plan/vlm. The agent uses it to transcribe code from screenshots, extract error strings, and evaluate UI components.
Input handling covers web URLs, local filesystem paths, and raw base64 data URLs. Leading @ symbols are stripped automatically. The tool converts inputs into base64. Supported image formats include JPEG, PNG, and WebP.
Files in SVG, GIF, PSD, or PDF formats will cause errors. Without valid API credentials and completed verification, the API call fails with status code 1004 or 2038.
What it helps with
- transcribe source code from technical screenshots
- extract text strings and error details using OCR
- analyze interface layouts and component hierarchies
- inspect visual layout bugs directly from local image files
Example prompts for the agent
- Extract the exact error message from ./error-screenshot.png
- Transcribe the source code shown in https://example.com/code.png
- Review the layout structure in /Users/username/Documents/mockup.png
How to install minimax-image-understanding
1Skills CLI (Vercel)
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a claude-code2Manually: put the files in place
~/.claude/skills/minimax-image-understanding/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/minimax-image-understanding/
1Skills CLI (Vercel)
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a codex2Manually: put the files in place
.agents/skills/minimax-image-understanding/SKILL.mdFor all projects use ~/.agents/skills/
1Skills CLI (Vercel)
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a cursor2Manually: put the files in place
.cursor/skills/minimax-image-understanding/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install imsus/pi-extension-minimax-coding-plan-mcp minimax-image-understanding2Manually: put the files in place
.github/skills/minimax-image-understanding/SKILL.md1Skills CLI (Vercel)
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a gemini-cli2Platform CLI
gemini skills install https://github.com/imsus/pi-extension-minimax-coding-plan-mcp --path skills/minimax-image-understandingManually: put the files in place
.devin/skills/minimax-image-understanding/SKILL.mdThe legacy .windsurf/skills/ path still works
Skills CLI (Vercel)
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a opencodeClaude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
Step by step, with commands for each platform: How to install skills in Claude Code: five ways
Questions about minimax-image-understanding
How to install minimax-image-understanding in Claude Code?
Run npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a claude-code. The file will be placed in ~/.claude/skills/minimax-image-understanding/SKILL.md.
Which file formats are supported by understand_image?
The tool accepts JPEG, PNG, and WebP files. Other formats like PDF, GIF, PSD, or SVG are rejected.
What causes status codes 1004 and 2038?
Status code 1004 indicates an authentication issue with your API key or region. Status code 2038 indicates that real-name verification is required.
Source text
SKILL.md · MIT
---
name: minimax-image-understanding
description: Analyze images using AI with the understand_image tool
---
# MiniMax Image Understanding Skill
Use this skill when you need to analyze, describe, or extract information from images.
## How to Use
Call the `understand_image` tool directly with a prompt and image URL:
```
understand_image({
prompt: "Your question about the image",
image_url: "https://example.com/image.png"
})
```
## When to Use
Use `understand_image` when:
- **Screenshots**: Error messages, UI issues, code in screenshots
- **Visual content**: Photos, diagrams, charts, graphs
- **Documents**: Extracting text from images (OCR), understanding layouts
- **UI/UX analysis**: Evaluating designs, identifying components
- **Visual debugging**: Understanding visual bugs or layout issues
## When NOT to Use
Do NOT use `understand_image` when:
- **Image is already described** in the conversation
- **The image is a simple icon** or emoji you recognize
- **No image is provided** or the image URL is inaccessible
- **Redundant with existing context** (e.g., file contents already visible)
## Usage
```
understand_image({
prompt: "What do you see in this image?",
image_url: "https://example.com/screenshot.png"
})
```
## API Details
**Endpoint**: `POST {api_host}/v1/coding_plan/vlm`
**Request Body**:
```json
{
"prompt": "Your question about the image",
"image_url": "data:image/jpeg;base64,/9j/4AAQ..."
}
```
**Response Format**:
```json
{
"content": "AI analysis of the image...",
"base_resp": {
"status_code": 0,
"status_msg": "success"
}
}
```
## Image Processing
The tool automatically handles three types of image inputs:
1. **HTTP/HTTPS URLs**: Downloads the image and converts to base64
- Example: `https://example.com/image.jpg`
2. **Local file paths**: Reads local files and converts to base64
- Absolute: `/Users/username/Documents/image.png`
- Relative: `images/photo.png`
- Removes `@` prefix if present
3. **Base64 data URLs**: Passes through existing base64 data
- Example: `data:image/png;base64,iVBORw0KGgo...`
## Image Formats
Supported:
- **JPEG** (.jpg, .jpeg)
- **PNG** (.png)
- **WebP** (.webp)
Not supported:
- PDF, GIF, PSD, SVG, and other formats
## Crafting Effective Prompts
### For Descriptions
- "Describe what's in this image in detail"
- "What is the main subject of this image?"
- "Describe the visual style and composition"
### For Code/Technical
- "What code is shown in this screenshot?"
- "Extract all text from this image"
- "Identify the UI framework/components used"
### For Analysis
- "Analyze this UI design. What is working well and what could be improved?"
- "What emotions or mood does this image convey?"
- "Compare this design to Material Design principles"
### For OCR/Text Extraction
- "Extract all text from this image"
- "Read the error message in this screenshot"
- "What does the label say in this image?"
## Examples
### Error Analysis
```
understand_image({
prompt: "What is the error message and where is it located in this screenshot?",
image_url: "./error-screenshot.png"
})
```
### Code Screenshot
```
understand_image({
prompt: "What code is shown in this screenshot? Please transcribe it exactly.",
image_url: "https://example.com/code.png"
})
```
### Design Review
```
understand_image({
prompt: "Analyze this UI design. What is working well and what could be improved?",
image_url: "https://example.com/mockup.png"
})
```
### OCR
```
understand_image({
prompt: "Extract all text from this image",
image_url: "/Users/username/Documents/scan.png"
})
```
## Tips
1. **Be specific** in your prompt about what you want to know
2. **Mention format** if you need structured output (e.g., "list all elements")
3. **Include context** if the image is part of a larger task
4. **For screenshots**, specify if you need full-page or just a specific area
5. **Complex analysis** may trigger a confirmation prompt (analyze, extract, describe, recognize, transcribe, read)
## Error Handling
- **Status code 1004**: Authentication error - check API key and region
- **Status code 2038**: Real-name verification required
- **Invalid image**: File doesn't exist or URL is inaccessible
- **Unsupported format**: Image format not in JPEG, PNG, WebP
© imsus · MIT · imsus/pi-extension-minimax-coding-plan-mcp