mobile-canvas — GitHub Copilot plugin: what it does, how to install
Embeds interactive iOS simulators and Android emulators inside GitHub Copilot. Gives agents MCP tools to navigate apps and capture device screens locally.
copilot plugin install mobile-canvas@awesome-copilotWhat mobile-canvas does
The plugin embeds mobile device screens into GitHub Copilot as an interactive canvas. Video feeds render locally over loopback using H.264 via WebCodecs, falling back to PNG frames if streaming drops. Frame rates reach roughly fifty frames per second on Android and close to fifty-eight on iOS targets.
Automations hook into 24 canvas operations alongside 61 distinct MCP tools prefixed with mobile_device_*. When Copilot drives the interface, an animated pointer and bright contour highlight its actions on screen. Developers can tap, swipe, and capture PNG snapshots directly from the view.
Host dependencies matter here. Managing iOS targets requires macOS with Xcode, while Android workflows mandate the Android SDK containing adb and emulator.
What it helps with
- inspect mobile app layouts directly inside the editor
- hand device interaction flows over to Copilot via MCP
- capture device screenshots and screen recordings locally
- boot and control mobile targets in headless mode
Example prompts for the agent
- Launch an iPhone simulator, install the build, and complete the onboarding flow.
- Locate the Settings icon on the running Android emulator and press it.
- Take a screenshot of the active device screen and inspect layout errors.
How to install mobile-canvas
Command from the source
copilot plugin install mobile-canvas@awesome-copilotStep by step, with commands for each platform: Claude Code plugins: marketplaces, installing, and building your own
Questions about mobile-canvas
How do I install mobile-canvas in GitHub Copilot?
Run copilot plugin install mobile-canvas@awesome-copilot in your terminal and reload Copilot to register the tools.
What does the mobile-canvas plugin do?
It connects local mobile simulators and emulators to a visual canvas while providing MCP device control tools to Copilot agents.
Does mobile-canvas require Xcode for Android testing?
No, Xcode is only required on macOS for iOS Simulators. Android emulator workflows only depend on the Android SDK with adb and emulator.
