Esp32 Iphone Agent
Open-source ESP32 board and iPhone app that let an AI agent operate a real iPhone without jailbreak, for teams running device tests.
No visits from OpenBeat in the last 30 days yet. Every click on “Visit” is counted here.
Pricing and API checked by an OpenBeat editor on Nov 11, 2026 · facts from the maker’s own site ·
Tool insights
Handsy AI lets an AI agent see and control a physical iPhone through a small add-on board, so tasks run on a real device instead of a simulator. It works without jailbreaking the phone, and you can start tasks from the iPhone app, a command-line tool, Siri or Shortcuts.
AI agents mostly work on web pages and desktop apps, and they can't easily use apps that only run on a real iPhone. Handsy AI gives them a way to look at the screen and tap, swipe and type on an actual device.
Teams that need real iPhones for agents, Bluetooth tests or device labs, and developers who like to tinker with open hardware. It is a poor fit if you need Android, can't leave the phone unlocked, or want a finished product with stable documentation.
What it does
Handsy AI is an open-source project by Henry Yuan. It pairs a small ESP32 board with an iPhone app so an AI model can operate a real iPhone. The board gets a view of the screen through AirPlay Screen Mirroring. It then acts on the phone by emulating a USB mouse, so it can tap, swipe and type. No jailbreak is needed.
You can start work from the iPhone app or from the Handsy CLI. Saved tasks can also be launched with Siri or Shortcuts.
Key features
- Screen view through AirPlay Screen Mirroring.
- Taps, swipes and typing through USB mouse emulation.
- Runs from the iPhone app or the Handsy CLI.
- Saved tasks that start from Siri or Shortcuts.
- Run replay with step screenshots and export.
- An ask-me-first setting for payments, sending and deleting.
- Phone audio listening, added in firmware 0.2.4 and app 1.0.2. The CLI listen command (0.1.3) reads phone audio as words.
- Board firmware updates over Wi-Fi, with rollback.
- Pinyin typing for Chinese through the board.
Pricing
As of November 2026, Handsy AI is free and open source. The site lists no paid plans and no pricing page. The maker describes the hardware as a $7 ESP32 board, so you pay for the board and your own AI model usage. Model costs depend on the model you connect and are not stated on the maker's site.
The code is under the MIT license. The exception is the firmware's AirPlay receiver, which is under GPL-3.0.
API and integrations
A public API is not stated on the maker's site, and no SDKs are listed. The CLI runs on macOS, Windows and Linux. The iPhone app is on iOS. Listed integrations are Claude Code, Codex, DeepSeek Harness, Siri, Shortcuts, AirPlay Screen Mirroring and MCP.
Good to know
- The phone must stay unlocked and in portrait orientation.
- The AI can't see passcode entry, Apple Pay or DRM video.
- USB-C iPhones get no wired charging during a run.
- You need an iPhone XS or newer on iOS 18 with cellular data.
- The CLI needs board firmware 0.2.2, which comes through the TestFlight channel.
- The documentation is in beta and may change.
The project is active. The GitHub repository showed about 4,800 stars, and the latest CLI release, 0.1.4, came out on 8 November 2026. App 1.0 was submitted to the App Store and was in review. App 1.0.1 was the first public TestFlight build, and 1.0.2 followed on TestFlight with longer tasks and steadier taps. Check the changelog before relying on it for production work.
FAQ
Is Handsy AI free?
As of November 2026, Handsy AI is open source and has no paid plans listed. You still need the ESP32 board, which the maker describes as costing $7, plus whatever your chosen AI model charges.
Do I need to jailbreak my iPhone to use Handsy AI?
No. Handsy AI sees the screen through AirPlay Screen Mirroring and controls the phone by emulating a USB mouse. The maker says it works without jailbreak.
Which iPhones does Handsy AI support?
It requires an iPhone XS or newer running iOS 18 with cellular data. The phone must stay unlocked and in portrait orientation during a run.
Does Handsy AI have an API?
A public API is not stated on the maker's site, and no SDKs are listed. You can drive it from the iPhone app, the Handsy CLI, Siri or Shortcuts. Listed integrations include MCP, Claude Code and Codex.
What can the AI not see on the iPhone?
Passcode entry, Apple Pay and DRM-protected video are not visible to the AI. The app also has an ask-me-first setting for actions such as payments, sending and deleting.
Releases
No tracked releases yet.
In the news
No coverage yet.