Handsy AI — Claude Code MCP server: what it does, how to install
Handsy AI — an MCP server for Claude Code and Codex that links an AI agent to a physical iPhone using an ESP32-S3 board. Controls apps directly via USB HID without requiring a jailbreak.
MIT ★ 5,197 updated 2026-11-16
claude mcp add esp32agent -- npx -y esp32agentWhat Handsy AI does
The MCP server executes agent commands on a physical iPhone by sending touch events through a Seeed XIAO ESP32S3 microcontroller. The hardware acts as a USB HID peripheral while device audio streams over AirPlay.
Navigation relies on standard screen elements with AssistiveTouch turned on. The setup requires iOS 18 or newer, the companion app from TestFlight, and board firmware v0.2.4.
The phone uses cellular data while running tasks because the board's hotspot occupies the Wi-Fi connection.
What it helps with
- control native iOS apps on an actual phone without jailbreaking
- automate mobile workflows and testing through an AI agent
- capture incoming audio cues from iOS via AirPlay streaming
- operate a phone independently without tethering to Xcode on a Mac
Example prompts for the agent
- Open Duolingo on the connected iPhone and finish the lesson
- Inspect incoming notifications and dismiss active alerts
- Dial the contact number using the stock phone dialer
How to install Handsy AI
Platform CLI
claude mcp add esp32agent -- npx -y esp32agentPlatform CLI
codex mcp add handsy-ai -- npx -y esp32agentConfig file
{
"mcpServers": {
"handsy-ai": {
"command": "npx",
"args": [
"-y",
"esp32agent"
]
}
}
}Config file
{
"servers": {
"handsy-ai": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"esp32agent"
]
}
}
}Platform CLI
gemini mcp add handsy-ai npx -y esp32agentStep by step, with commands for each platform: How to add an MCP server to Claude Code, Codex, Cursor, VS Code, Gemini CLI and more
Questions about Handsy AI
How to install Handsy AI in Claude Code?
Run claude mcp add handsy-ai -- npx -y esp32agent in your terminal.
What does Handsy AI do?
It provides tools for AI models to observe an iPhone screen, capture audio prompts, and simulate user taps using an ESP32-S3 microchip.
What is required to run Handsy AI?
A Seeed XIAO ESP32S3 board flashed with firmware v0.2.4, an iPhone running iOS 18+, AssistiveTouch turned on, and the TestFlight app.