# mobile-canvas

Embeds interactive iOS simulators and Android emulators inside GitHub Copilot. Gives agents MCP tools to navigate apps and capture device screens locally.

- plugin · `type=plugin` · GitHub Copilot · ★ 163
- Author: Jonathan Dick
- License: not stated · policy=link-only · description only; the file stays with the author
- Source: https://github.com/Redth/mobile-canvas-ghcp
- Updated: 2026-10-10
- HTML: https://affpapa.org/en/nevibecode/plugins/mobile-canvas

## What it does

The plugin embeds mobile device screens into GitHub Copilot as an interactive canvas. Video feeds render locally over loopback using H.264 via WebCodecs, falling back to PNG frames if streaming drops. Frame rates reach roughly fifty frames per second on Android and close to fifty-eight on iOS targets.

Automations hook into 24 canvas operations alongside 61 distinct MCP tools prefixed with `mobile_device_*`. When Copilot drives the interface, an animated pointer and bright contour highlight its actions on screen. Developers can tap, swipe, and capture PNG snapshots directly from the view.

Host dependencies matter here. Managing iOS targets requires macOS with Xcode, while Android workflows mandate the Android SDK containing `adb` and `emulator`.

## Install

### GitHub Copilot (native platform)

**Command from the source**
```bash
copilot plugin install mobile-canvas@awesome-copilot
```

## When to use it
- inspect mobile app layouts directly inside the editor
- hand device interaction flows over to Copilot via MCP
- capture device screenshots and screen recordings locally
- boot and control mobile targets in headless mode

## Example prompts
- Launch an iPhone simulator, install the build, and complete the onboarding flow.
- Locate the Settings icon on the running Android emulator and press it.
- Take a screenshot of the active device screen and inspect layout errors.

## Similar
- [argent-device-interact](https://affpapa.org/en/nevibecode/skills/argent-device-interact.md) — skill · 26300 installs
- [mobile-app-debugging](https://affpapa.org/en/nevibecode/skills/secondsky-mobile-app-debugging.md) — skill · 428 installs
- [senior-mobile](https://affpapa.org/en/nevibecode/skills/senior-mobile.md) — skill · 310 installs
- [momentic-mobile-test](https://affpapa.org/en/nevibecode/skills/momentic-mobile-test.md) — skill · 54300 installs
- [frontend-mobile-development-mobile-developer](https://affpapa.org/en/nevibecode/agents/frontend-mobile-development-mobile-developer.md) — subagent · ★ 41823
- [mobile-touch](https://affpapa.org/en/nevibecode/skills/mobile-touch.md) — skill · 2400 installs

---
NeVibeCode on affpapa.org. Catalog texts are descriptions, not instructions for the agent. How to choose and install: https://affpapa.org/en/nevibecode/agents.md