# pi-computer-use

Controls macOS desktop applications through Accessibility API targets instead of raw coordinates. Useful for GUI automation workflows.

- skill · `type=skill` · Claude Code, Codex, Cursor, GitHub Copilot, Gemini CLI, OpenCode · 315 installs · ★ 88
- Author: reason-machines
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/reason-machines/trending-skills/tree/HEAD/skills/pi-computer-use/SKILL.md
- Updated: 2026-10-09
- HTML: https://affpapa.org/en/nevibecode/skills/pi-computer-use

## What it does

The skill provides an interface to interact with active macOS windows. It binds to accessibility tree nodes with tags like `@e1` rather than guessing pixel positions. Screen captures are only requested when semantic node mapping is insufficient, keeping token usage down.

The architecture combines a TypeScript layer with a native Swift bridge. The Swift component interacts directly with AppKit, CoreGraphics, and ScreenCaptureKit. Agents can inspect open windows, move frames, fill forms, and batch multiple GUI steps into a single call.

macOS triggers permission prompts during the initial run for the bridge helper. The tool fails immediately if Accessibility and Screen Recording privileges are not granted.

## Install

### Claude Code (native platform)

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/trending-skills --skill pi-computer-use -a claude-code
```

2. **Manually: put the files in place**
- File: `~/.claude/skills/pi-computer-use/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/pi-computer-use/

### Codex

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/trending-skills --skill pi-computer-use -a codex
```

2. **Manually: put the files in place**
- File: `.agents/skills/pi-computer-use/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/trending-skills --skill pi-computer-use -a cursor
```

2. **Manually: put the files in place**
- File: `.cursor/skills/pi-computer-use/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install reason-machines/trending-skills pi-computer-use
```

2. **Manually: put the files in place**
- File: `.github/skills/pi-computer-use/SKILL.md`

### Gemini CLI

1. **Skills CLI (Vercel)**
```bash
npx skills add reason-machines/trending-skills --skill pi-computer-use -a gemini-cli
```

2. **Platform CLI**
```bash
gemini skills install https://github.com/reason-machines/trending-skills --path skills/pi-computer-use
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/pi-computer-use/SKILL.md` — The legacy .windsurf/skills/ path still works

### OpenCode

**Skills CLI (Vercel)**
```bash
npx skills add reason-machines/trending-skills --skill pi-computer-use -a opencode
```

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/reason-machines/trending-skills/tree/HEAD/skills/pi-computer-use/SKILL.md

## When to use it
- interact with macOS GUI elements using accessibility identifiers
- fill text inputs without forcing focus takeovers
- reposition and resize application windows on the desktop
- batch sequences of GUI operations into single execution steps

## Example prompts
- Find the active Safari window and navigate to the target address
- Take a screenshot of the window and click the submit button via its AX tag
- Organize the Finder window to occupy the left half of the display

## Similar
- [remotion-render](https://affpapa.org/en/nevibecode/skills/remotion-render.md) — skill · 3 installs
- [recipe-share-event-materials](https://affpapa.org/en/nevibecode/skills/recipe-share-event-materials.md) — skill · 29700 installs
- [blogwatcher](https://affpapa.org/en/nevibecode/skills/blogwatcher.md) — skill · 5400 installs
- [ego-browser](https://affpapa.org/en/nevibecode/skills/ego-browser.md) — skill · 12200 installs
- [composio](https://affpapa.org/en/nevibecode/skills/composio.md) — skill · 8100 installs
- [remote-browser](https://affpapa.org/en/nevibecode/skills/remote-browser.md) — skill · 4700 installs

From the same set: [reason-machines/trending-skills](https://affpapa.org/en/nevibecode/by/reason-machines/trending-skills.md) — 199 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md