How to give an AI agent a real iPhone with a $7 ESP32
Most phone automation needs a computer on a cable, a developer account, or a jailbreak. ESP32 iPhone Agent takes a different route: a small ESP32-S3 board plugs into the iPhone and acts as the agent's eyes and hands, while an iPhone app runs the vision model loop. At run time it is just the phone and the board. This guide walks through the setup from the project's README, start to finish, so you…
To integrate an iPhone with an AI agent using a $7 ESP32, follow these steps. First, obtain an ESP32-S3 board with native USB and PSRAM that costs around $7. Pair the board with an iPhone running iOS 18 or later via Bluetooth, and connect the iPhone to the board's Wi-Fi hotspot. Install the necessary iOS app, enable AssistiveTouch, and provide a vision model endpoint and key.
The ESP32 board acts as the agent's eyes and hands, while the iPhone app handles the vision model loop. You can then input tasks, such as "Open Settings and go to Wi-Fi," and watch the AI agent execute the commands on the real iPhone.
Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.