Skip to main content
prompt GP ChatGPT

describe · wangzan101, roles — Claude Code prompt: what it does, how to install

Prompt for Claude Code and ChatGPT that describes phone screenshots for an assistant without visual input. Converts mobile UI layouts into structured text with normalised tap coordinates.

Apache-2.0 ★ 9,488 updated 2026-11-16

Install into Claude Code · Manually: put the files in place All methods and platforms ↓
.claude/commands/describe.md
Open on GitHub

What describe does

The prompt instructs a vision model to convert mobile screenshots into a structured summary for another agent. The entire screen maps to a normalised 0-999 coordinate grid with (0,0) at the top-left corner. For interactive controls, it calculates the exact center point for tap automation.

Output follows four specific sections: screen overview, an element list capped at 15 items with types and coordinates, noticeable blockers or dialogs, and task-related visual clues. Passive text titles and body paragraphs are ignored to keep context concise.

No action recommendations or next steps are permitted. The model only records clearly visible elements and skips anything obscured.

What it helps with

  • parse interactive mobile UI elements from a screenshot
  • calculate tap coordinates for buttons and inputs
  • feed phone screen state to an automation agent
  • identify blocking modal dialogs and loading spinners

Example prompts for the agent

  • Describe the screenshot screen.png using the coordinate grid
  • Extract interactive controls and tap points from this mobile screen
  • Check this phone UI screenshot for blocking dialogs or errors

How to install describe

Manually: put the files in place

.claude/commands/describe.md

Questions about describe

How to install describe in Claude Code?

Save the prompt file to .claude/commands/describe.md inside your project directory.

What does describe do?

It translates a phone screenshot into four structured blocks: page context, interactive controls with tap coordinates, error states, and task clues.

What coordinate system does describe use?

It maps the screen to a 0-999 grid on both axes, where (0,0) represents the top-left corner and (999,999) represents the bottom-right corner.

Source text

describe.md · Apache-2.0
You describe one phone screenshot for an assistant that cannot see the screen
and must decide what to do from your words alone. You report what is there;
you do not decide or advise. The assistant is waiting for your answer: keep it
short.

Coordinates: the whole screen is 0-999 on each axis, 0,0 is the top-left
corner and 999,999 the bottom-right. For every interactive element give the
point at its exact centre; that point will be tapped.

Reply in exactly these four sections and nothing else:
[屏幕] One sentence: which app or site this is and what kind of page.
[可交互元素] One line per element, at most 15 lines: - name | type (button, input, list item, icon, switch, tab) | (x,y)
  Name each in a few words. List first the elements that matter for the task,
  then the navigation controls (back, close, bottom tabs, buttons of any
  dialog). Leave out text that is not a control (titles, message bodies,
  paragraphs); for a long list, give its first few items.
[异常或值得注意] Any dialog, error, loading state, blank area, sign-in wall,
  verification check or anything else unusual or blocking, in a line or two.
  Write 无 if there is none.
[与任务有关的线索] At most two lines: text or elements on the screen that
  relate to the task, stated plainly. Do not say which one to tap and do not
  give steps. Write 无 if there is none.

Rules:
- Put each coordinate as close to the element's centre as you can.
- Never list an element you cannot clearly see.
- No advice and no suggestions; only what is on the screen.

© wangzan101 · Apache-2.0 · wangzan101/Mika

Similar prompts

All prompts for Mobile →

describe by other authors comes first.

From the same set132

The whole set →
tap This prompt for Claude Code and ChatGPT taps interface elements by reference, name, or coordinates. GP ChatGPT ★ 9,488repo stars web_interact The web_interact prompt for Claude Code and ChatGPT adds mouse and keyboard actions beyond web_tap and web_type_text. Use it to open hover menus, drag items, choose native dropdown options, or handle page dialogs. GP ChatGPT ★ 9,488repo stars web_evaluate_js web_evaluate_js — a prompt for Claude Code runs JavaScript code on the current web page and returns the collected data as JSON. GP ChatGPT ★ 9,488repo stars outcome_judge The outcome_judge Claude Code prompt checks whether an assistant’s final reply fulfils the user’s request. It labels the result done, partial, or not_possible. GP ChatGPT ★ 9,488repo stars do_steps The do_steps Claude Code prompt batches known actions on one screen into a single call. It stops when a step fails or the next result needs visual inspection. GP ChatGPT ★ 9,488repo stars notice_triage notice_triage — a prompt for Claude Code and ChatGPT categorizes phone notifications from a single app. It isolates incoming alert text to prevent prompt injection inside assistant workflows. GP ChatGPT ★ 9,488repo stars phone_type_text The phone_type_text Claude Code prompt enters a complete text string into a phone field in one call. It can target a field by label or coordinates. GP ChatGPT ★ 9,488repo stars stop_summary stop_summary — a prompt for Claude Code and ChatGPT that summarizes progress when an assistant is stopped midway. It turns session logs into a concise status report in five lines or fewer. GP ChatGPT ★ 9,488repo stars

Project sponsors

Companies that keep this analytics open