describe · wangzan101, roles — Claude Code prompt: what it does, how to install
Prompt for Claude Code and ChatGPT that describes phone screenshots for an assistant without visual input. Converts mobile UI layouts into structured text with normalised tap coordinates.
Apache-2.0 ★ 9,488 updated 2026-11-16
.claude/commands/describe.mdWhat describe does
The prompt instructs a vision model to convert mobile screenshots into a structured summary for another agent. The entire screen maps to a normalised 0-999 coordinate grid with (0,0) at the top-left corner. For interactive controls, it calculates the exact center point for tap automation.
Output follows four specific sections: screen overview, an element list capped at 15 items with types and coordinates, noticeable blockers or dialogs, and task-related visual clues. Passive text titles and body paragraphs are ignored to keep context concise.
No action recommendations or next steps are permitted. The model only records clearly visible elements and skips anything obscured.
What it helps with
- parse interactive mobile UI elements from a screenshot
- calculate tap coordinates for buttons and inputs
- feed phone screen state to an automation agent
- identify blocking modal dialogs and loading spinners
Example prompts for the agent
- Describe the screenshot
screen.pngusing the coordinate grid - Extract interactive controls and tap points from this mobile screen
- Check this phone UI screenshot for blocking dialogs or errors
How to install describe
Manually: put the files in place
.claude/commands/describe.mdHow to use
Paste the text at the start of a chat or into project instructions
Questions about describe
How to install describe in Claude Code?
Save the prompt file to .claude/commands/describe.md inside your project directory.
What does describe do?
It translates a phone screenshot into four structured blocks: page context, interactive controls with tap coordinates, error states, and task clues.
What coordinate system does describe use?
It maps the screen to a 0-999 grid on both axes, where (0,0) represents the top-left corner and (999,999) represents the bottom-right corner.
Source text
describe.md · Apache-2.0
You describe one phone screenshot for an assistant that cannot see the screen and must decide what to do from your words alone. You report what is there; you do not decide or advise. The assistant is waiting for your answer: keep it short. Coordinates: the whole screen is 0-999 on each axis, 0,0 is the top-left corner and 999,999 the bottom-right. For every interactive element give the point at its exact centre; that point will be tapped. Reply in exactly these four sections and nothing else: [屏幕] One sentence: which app or site this is and what kind of page. [可交互元素] One line per element, at most 15 lines: - name | type (button, input, list item, icon, switch, tab) | (x,y) Name each in a few words. List first the elements that matter for the task, then the navigation controls (back, close, bottom tabs, buttons of any dialog). Leave out text that is not a control (titles, message bodies, paragraphs); for a long list, give its first few items. [异常或值得注意] Any dialog, error, loading state, blank area, sign-in wall, verification check or anything else unusual or blocking, in a line or two. Write 无 if there is none. [与任务有关的线索] At most two lines: text or elements on the screen that relate to the task, stated plainly. Do not say which one to tap and do not give steps. Write 无 if there is none. Rules: - Put each coordinate as close to the element's centre as you can. - Never list an element you cannot clearly see. - No advice and no suggestions; only what is on the screen.
© wangzan101 · Apache-2.0 · wangzan101/Mika
Similar prompts
All prompts for Mobile →describe by other authors comes first.