# EXTRA - Native Computer Use

Gives AI agents direct desktop control across Linux, macOS, and Windows. It handles mouse clicks, keyboard input, and UI inspection via native accessibility trees.

- MCP server · `type=mcp` · Claude Code, Codex, Cursor, GitHub Copilot, Windsurf (Devin Desktop), Cline, Zed, Gemini CLI · ★ 5
- Author: AIYantra
- License: MIT · policy=link-only · description only; the file stays with the author
- Source: https://github.com/AIYantra/extra
- Updated: 2026-10-24
- HTML: https://affpapa.org/en/nevibecode/mcp/extra-native-computer-use

## What it does

The server links local LLM agents to desktop operating systems without browser add-ons. It pairs GPU-accelerated frame grabbing with native accessibility APIs: AT-SPI2 on Linux, Quartz on macOS, and COM UI Automation on Windows. This architecture cuts token usage by up to 225 times.

Agents dispatch hardware-level mouse and keyboard events directly to target applications with zero coordinate drift. Running the server requires an isolated Python 3.10+ environment alongside a supported OS: Wayland or X11 on Linux, macOS 12.3 or higher, or 64-bit Windows 10/11. Without granting explicit accessibility and input permissions in your OS settings, the agent cannot control user windows.

## Requirements
- Needs: Python and uv (commands run via uvx)

## Install

### Claude Code (native platform)

**Platform CLI**
```bash
claude mcp add extra -- uvx extra-desktop
```
uvx runs the command named after the package; if the README names another one, use uvx --from extra-desktop <command>

### Codex

**Platform CLI**
```bash
codex mcp add extra-native-computer-use -- uvx extra-desktop
```
uvx runs the command named after the package; if the README names another one, use uvx --from extra-desktop <command>

### Cursor

**Config file**
File `.cursor/mcp.json`:
```json
{
    "mcpServers": {
        "extra-native-computer-use": {
            "command": "uvx",
            "args": [
                "extra-desktop"
            ]
        }
    }
}
```
uvx runs the command named after the package; if the README names another one, use uvx --from extra-desktop <command>

### GitHub Copilot

**Config file**
File `.vscode/mcp.json`:
```json
{
    "servers": {
        "extra-native-computer-use": {
            "type": "stdio",
            "command": "uvx",
            "args": [
                "extra-desktop"
            ]
        }
    }
}
```
uvx runs the command named after the package; if the README names another one, use uvx --from extra-desktop <command>

### Gemini CLI

**Platform CLI**
```bash
gemini mcp add extra-native-computer-use uvx extra-desktop
```
uvx runs the command named after the package; if the README names another one, use uvx --from extra-desktop <command>

## When to use it
- click desktop buttons and menus without coordinate drift
- enter text and shortcuts into local apps without browser wrappers
- inspect OS accessibility hierarchies to avoid heavy visual token loads
- automate routine file management across local directories

## Example prompts
- Open LibreOffice Calc, calculate invoice totals from my downloads, and build a chart
- Tidy up my desktop folder by moving screenshots to Pictures and deleting empty folders
- Launch VLC media player and start playing background audio

## Similar
- [REA](https://affpapa.org/en/nevibecode/mcp/rea.md) — MCP server · ★ 392262
- [GitHub](https://affpapa.org/en/nevibecode/mcp/github.md) — MCP server · ★ 33989
- [Netdata](https://affpapa.org/en/nevibecode/mcp/netdata.md) — MCP server · ★ 81163
- [browser-use](https://affpapa.org/en/nevibecode/mcp/browser-use.md) — MCP server · ★ 119231
- [Codebase Memory](https://affpapa.org/en/nevibecode/mcp/codebase-memory.md) — MCP server · ★ 47577
- [mcp-server](https://affpapa.org/en/nevibecode/mcp/mcp-server.md) — MCP server · ★ 43902

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md