# computer-use-agents

Guides the setup of desktop automation agents using vision models. Helps assemble screen-capture loops and hardened container sandboxes.

- skill · `type=skill` · Claude Code · 222 installs
- Author: davila7
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/davila7/claude-code-templates/tree/HEAD/cli-tool/components/skills/ai-research/computer-use-agents
- Updated: 2026-10-24
- HTML: https://affpapa.org/en/nevibecode/skills/computer-use-agents

## What it does

The skill defines the perception-reasoning-action loop. It captures screen frames and sends them to a vision model for step planning. Simulated actions like mouse clicks run through `pyautogui`.

Host-level execution carries severe risks. Because of that, the pattern isolates the agent inside Docker. The environment boots a virtual display using `xvfb` and drops root privileges.

Desktop widgets remain tricky. Vision models regularly misclick custom dropdown menus and scrollbars. To stop runaway loops, the architecture enforces strict step limits.

## Install

### Claude Code (native platform)

1. **claude-code-templates**
```bash
npx claude-code-templates@latest --skill ai-research/computer-use-agents
```

2. **Skills CLI (Vercel)**
```bash
npx skills add davila7/claude-code-templates --skill computer-use-agents -a claude-code
```

3. **Manually: put the files in place**
- File: `~/.claude/skills/computer-use-agents/SKILL.md` — Copy the whole skill folder; for one project use .claude/skills/computer-use-agents/

### Codex

**Manually: put the files in place**
- File: `.agents/skills/computer-use-agents/SKILL.md` — For all projects use ~/.agents/skills/

### Cursor

**Manually: put the files in place**
- File: `.cursor/skills/computer-use-agents/SKILL.md` — Cursor also reads .agents/skills/ and .claude/skills/

### GitHub Copilot

1. **GitHub CLI**
```bash
gh skill install davila7/claude-code-templates computer-use-agents
```

2. **Manually: put the files in place**
- File: `.github/skills/computer-use-agents/SKILL.md`

### Gemini CLI

**Platform CLI**
```bash
gemini skills install https://github.com/davila7/claude-code-templates --path cli-tool/components/skills/ai-research/computer-use-agents
```

### Windsurf (Devin Desktop)

**Manually: put the files in place**
- File: `.devin/skills/computer-use-agents/SKILL.md` — The legacy .windsurf/skills/ path still works

### Claude.ai

**Claude.ai**
- Zip the folder and upload it in Settings → Capabilities → Skills

Where a file is given instead of a command, copy the files from the source to that path: https://github.com/davila7/claude-code-templates/tree/HEAD/cli-tool/components/skills/ai-research/computer-use-agents

## When to use it
- Build a desktop control loop using screenshot capture and PyAutoGUI actions
- Harden the execution environment with Docker sandboxing and virtual displays
- Configure Anthropic Computer Use calls with safety limits and timeouts

## Example prompts
- Design a screen control agent loop using Claude and PyAutoGUI
- Generate a sandboxed Dockerfile with xvfb and fluxbox for GUI automation
- Add step caps and action throttling to my desktop agent

## Similar
- [setup-matt-pocock-skills](https://affpapa.org/en/nevibecode/skills/setup-matt-pocock-skills.md) — skill · 1052851 installs
- [ask-matt](https://affpapa.org/en/nevibecode/skills/ask-matt.md) — skill · 766587 installs
- [to-tickets](https://affpapa.org/en/nevibecode/skills/to-tickets.md) — skill · 711230 installs
- [writing-plans](https://affpapa.org/en/nevibecode/skills/writing-plans.md) — skill · 282859 installs
- [caveman-review](https://affpapa.org/en/nevibecode/skills/caveman-review.md) — skill · 411800 installs
- [caveman-compress](https://affpapa.org/en/nevibecode/skills/caveman-compress.md) — skill · 411500 installs

## Other versions with the same name
- [computer-use-agents · sickn33](https://affpapa.org/en/nevibecode/skills/sickn33-computer-use-agents.md) — 962 installs

From the same set: [davila7/claude-code-templates](https://affpapa.org/en/nevibecode/by/davila7/claude-code-templates.md) — 804 cards

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md