Skip to main content
skill CX Codex

minimax-image-understanding — Claude Code skill: setup and use

This skill connects your coding agent to MiniMax vision models via understand_image. It handles screenshot OCR, UI layout inspection, and visual bug diagnostics.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓
npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a claude-code
Open on GitHub

What minimax-image-understanding does

The skill equips the agent with the understand_image tool, sending prompts and image payloads to the MiniMax VLM endpoint at {api_host}/v1/coding_plan/vlm. The agent uses it to transcribe code from screenshots, extract error strings, and evaluate UI components.

Input handling covers web URLs, local filesystem paths, and raw base64 data URLs. Leading @ symbols are stripped automatically. The tool converts inputs into base64. Supported image formats include JPEG, PNG, and WebP.

Files in SVG, GIF, PSD, or PDF formats will cause errors. Without valid API credentials and completed verification, the API call fails with status code 1004 or 2038.

What it helps with

  • transcribe source code from technical screenshots
  • extract text strings and error details using OCR
  • analyze interface layouts and component hierarchies
  • inspect visual layout bugs directly from local image files

Example prompts for the agent

  • Extract the exact error message from ./error-screenshot.png
  • Transcribe the source code shown in https://example.com/code.png
  • Review the layout structure in /Users/username/Documents/mockup.png

How to install minimax-image-understanding

1Skills CLI (Vercel)

npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a claude-code

2Manually: put the files in place

~/.claude/skills/minimax-image-understanding/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/minimax-image-understanding/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about minimax-image-understanding

How to install minimax-image-understanding in Claude Code?

Run npx skills add imsus/pi-extension-minimax-coding-plan-mcp --skill minimax-image-understanding -a claude-code. The file will be placed in ~/.claude/skills/minimax-image-understanding/SKILL.md.

Which file formats are supported by understand_image?

The tool accepts JPEG, PNG, and WebP files. Other formats like PDF, GIF, PSD, or SVG are rejected.

What causes status codes 1004 and 2038?

Status code 1004 indicates an authentication issue with your API key or region. Status code 2038 indicates that real-name verification is required.

Source text

SKILL.md · MIT
---
name: minimax-image-understanding
description: Analyze images using AI with the understand_image tool
---

# MiniMax Image Understanding Skill

Use this skill when you need to analyze, describe, or extract information from images.

## How to Use

Call the `understand_image` tool directly with a prompt and image URL:

```
understand_image({
  prompt: "Your question about the image",
  image_url: "https://example.com/image.png"
})
```

## When to Use

Use `understand_image` when:

- **Screenshots**: Error messages, UI issues, code in screenshots
- **Visual content**: Photos, diagrams, charts, graphs
- **Documents**: Extracting text from images (OCR), understanding layouts
- **UI/UX analysis**: Evaluating designs, identifying components
- **Visual debugging**: Understanding visual bugs or layout issues

## When NOT to Use

Do NOT use `understand_image` when:

- **Image is already described** in the conversation
- **The image is a simple icon** or emoji you recognize
- **No image is provided** or the image URL is inaccessible
- **Redundant with existing context** (e.g., file contents already visible)

## Usage

```
understand_image({
  prompt: "What do you see in this image?",
  image_url: "https://example.com/screenshot.png"
})
```

## API Details

**Endpoint**: `POST {api_host}/v1/coding_plan/vlm`

**Request Body**:
```json
{
  "prompt": "Your question about the image",
  "image_url": "data:image/jpeg;base64,/9j/4AAQ..."
}
```

**Response Format**:
```json
{
  "content": "AI analysis of the image...",
  "base_resp": {
    "status_code": 0,
    "status_msg": "success"
  }
}
```

## Image Processing

The tool automatically handles three types of image inputs:

1. **HTTP/HTTPS URLs**: Downloads the image and converts to base64
   - Example: `https://example.com/image.jpg`

2. **Local file paths**: Reads local files and converts to base64
   - Absolute: `/Users/username/Documents/image.png`
   - Relative: `images/photo.png`
   - Removes `@` prefix if present

3. **Base64 data URLs**: Passes through existing base64 data
   - Example: `data:image/png;base64,iVBORw0KGgo...`

## Image Formats

Supported:
- **JPEG** (.jpg, .jpeg)
- **PNG** (.png)
- **WebP** (.webp)

Not supported:
- PDF, GIF, PSD, SVG, and other formats

## Crafting Effective Prompts

### For Descriptions
- "Describe what's in this image in detail"
- "What is the main subject of this image?"
- "Describe the visual style and composition"

### For Code/Technical
- "What code is shown in this screenshot?"
- "Extract all text from this image"
- "Identify the UI framework/components used"

### For Analysis
- "Analyze this UI design. What is working well and what could be improved?"
- "What emotions or mood does this image convey?"
- "Compare this design to Material Design principles"

### For OCR/Text Extraction
- "Extract all text from this image"
- "Read the error message in this screenshot"
- "What does the label say in this image?"

## Examples

### Error Analysis
```
understand_image({
  prompt: "What is the error message and where is it located in this screenshot?",
  image_url: "./error-screenshot.png"
})
```

### Code Screenshot
```
understand_image({
  prompt: "What code is shown in this screenshot? Please transcribe it exactly.",
  image_url: "https://example.com/code.png"
})
```

### Design Review
```
understand_image({
  prompt: "Analyze this UI design. What is working well and what could be improved?",
  image_url: "https://example.com/mockup.png"
})
```

### OCR
```
understand_image({
  prompt: "Extract all text from this image",
  image_url: "/Users/username/Documents/scan.png"
})
```

## Tips

1. **Be specific** in your prompt about what you want to know
2. **Mention format** if you need structured output (e.g., "list all elements")
3. **Include context** if the image is part of a larger task
4. **For screenshots**, specify if you need full-page or just a specific area
5. **Complex analysis** may trigger a confirmation prompt (analyze, extract, describe, recognize, transcribe, read)

## Error Handling

- **Status code 1004**: Authentication error - check API key and region
- **Status code 2038**: Real-name verification required
- **Invalid image**: File doesn't exist or URL is inaccessible
- **Unsupported format**: Image format not in JPEG, PNG, WebP

© imsus · MIT · imsus/pi-extension-minimax-coding-plan-mcp

Similar skills

All skills for AI and ML →

Project sponsors

Companies that keep this analytics open
Gold sponsor

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor