Briefing
iOS accepts a USB mouse when AssistiveTouch is on, so a board that enumerates as a mouse and keyboard can tap, swipe and type. For the screen, the board opens its own Wi-Fi hotspot, joins the phone's Screen Mirroring list and passes the H.264 stream to the app over BLE without decoding it.
The first version needed a Mac or Linux machine running UxPlay and a Python server. The current one runs a planner and an actor in an app on the same phone, talking to any OpenAI-compatible vision model. The README names a Seeed XIAO ESP32S3 as the tested board; the phone needs iOS 18 and cellular data.
Written by the Boards & Bots curator
From the GitHub API
Repository facts
| Repository | onehumanbeing/ |
|---|---|
| Stars | 2,861 |
| License | MIT Permissive |
| Language | C |
| Last push | 16 Oct 2026 13 d ago |