4 mo ago
Embedded Arena: agents deploy models to microcontrollers with hardware feedback
Zhihan Zhang and colleagues, mostly at the University of Washington, published Embedded Arena, a benchmark that scores agents' model and firmware edits on microcontrollers. Boards include a MAX78000, an ESP32-S3 and an STM32N6. The paper reports Claude Opus 4.7 and Gemini 3.1 Pro failing every deployment without hardware feedback; with it, the first success came within 3 iterations.
Claimed
