Skip to main content
affpapa.org
RU EN
skill CX Codex

pi-computer-use — Claude Code skill: what it does, how to install

Controls macOS desktop applications through Accessibility API targets instead of raw coordinates. Useful for GUI automation workflows.

Install into Claude Code · Skills CLI (Vercel) All methods and platforms ↓ 
npx skills add reason-machines/trending-skills --skill pi-computer-use -a claude-code
Open on GitHub

What pi-computer-use does

The skill provides an interface to interact with active macOS windows. It binds to accessibility tree nodes with tags like @e1 rather than guessing pixel positions. Screen captures are only requested when semantic node mapping is insufficient, keeping token usage down.

The architecture combines a TypeScript layer with a native Swift bridge. The Swift component interacts directly with AppKit, CoreGraphics, and ScreenCaptureKit. Agents can inspect open windows, move frames, fill forms, and batch multiple GUI steps into a single call.

macOS triggers permission prompts during the initial run for the bridge helper. The tool fails immediately if Accessibility and Screen Recording privileges are not granted.

What it helps with

  • interact with macOS GUI elements using accessibility identifiers
  • fill text inputs without forcing focus takeovers
  • reposition and resize application windows on the desktop
  • batch sequences of GUI operations into single execution steps

Example prompts for the agent

  • Find the active Safari window and navigate to the target address
  • Take a screenshot of the window and click the submit button via its AX tag
  • Organize the Finder window to occupy the left half of the display

How to install pi-computer-use

1Skills CLI (Vercel)

npx skills add reason-machines/trending-skills --skill pi-computer-use -a claude-code

2Manually: put the files in place

~/.claude/skills/pi-computer-use/SKILL.md

Copy the whole skill folder; for one project use .claude/skills/pi-computer-use/

Step by step, with commands for each platform: How to install skills in Claude Code: five ways

Questions about pi-computer-use

How to install pi-computer-use in Claude Code?

Run npx skills add reason-machines/trending-skills --skill pi-computer-use -a claude-code. The skill file will be placed in ~/.claude/skills/pi-computer-use/SKILL.md.

Why does it prefer Accessibility refs over pixel coordinates?

Targeting accessibility references avoids breakages caused by window movement or screen scaling. Coordinates are kept strictly as a fallback.

What macOS permissions does the helper require?

The helper located at ~/.pi/agent/helpers/pi-computer-use/bridge requires Accessibility and Screen Recording permissions. Both must be approved in system settings.

Similar skills

All skills for Automation and no-code: n8n, Zapier, Make →
remotion-render official Remotion Exports videos and static stills from Remotion projects using CLI commands. CX Codex GP ChatGPT 3installs recipe-share-event-materials official googleworkspace This skill reads Google Calendar attendees and gives them reader access to a Google Drive file. Use it when meeting materials need to reach every guest. CX Codex +1 29,700installs blogwatcher openclaw A skill that has the agent manage a list of blogs and RSS/Atom feeds through the blogwatcher CLI: add sources, scan for updates, mark articles read. CX Codex +1 5,400installs ego-browser citrolabs Connects the ego-lite Chromium browser to AI agents for web automation, form filling, screenshots, and QA testing using existing logged-in sessions. CX Codex +1 12,200installs composio ComposioHQ This skill routes Composio tasks for a personal agent or a product with user-connected accounts, from setup and integration to tool runs and troubleshooting. CX Codex +1 8,100installs remote-browser browser-use Controls an isolated Browser Use Cloud session via the CLI. It helps agents automate web tasks on machines where a local Chrome is absent. CX Codex +1 4,700installs

From the same set199

aris-autonomous-ml-research A Markdown skill that links ML idea discovery, experiments, paper writing, review, and rebuttal. It fits workflows where one model checks another. CX Codex +1 360installs crabtrap-llm-proxy Guides setup of CrabTrap forward proxy to intercept agent HTTP requests, evaluating outbound traffic against static rules and an LLM judge before reaching remote APIs. CX Codex +1 358installs freellmapi-proxy This skill sets up a self-hosted Anthropic-compatible proxy that puts free-tier keys from many providers behind one endpoint. CX Codex +1 351installs ppt-image-first-workflow Takes a vague deck request through style previews and a locked plan to a PPTX where every slide is one full-page image made with GPT Image 2. CX Codex +1 325installs gpt-image-2-skill A skill and CLI for creating and editing images with OpenAI gpt-image-2. Use it for reference-based edits, masks, and batches of variants. CX Codex +1 315installs superlevels-chrome-extension A skill that lets your agent work on SuperLevels, an open-source Chrome extension bundling tab cleaning, cookie editing, dark mode and custom CSS. CX Codex +1 314installs privacy-parser-pii-extraction Returns personal data found in a string as labelled spans with character offsets. Useful when a log or document has to be inspected before it leaves your machine. CX Codex +1 310installs flowdriver-covert-transport Routes SOCKS5 traffic through Google Drive API calls so it survives DPI and SNI filtering. Useful on networks where a normal proxy gets blocked. CX Codex +1 310installs

Project sponsors

Companies that keep this analytics open
Gold sponsor
Nutra.Club

Impressions, clicks and code copies — open statistics. We keep the numbers public for the same reason NeBlask itself is public. Become a sponsor