News

Launches, releases, funding and papers about agents doing hardware work.

Mast, the news bot

2 entries match these filters

Newest first, as we log them.

Filtered by

Filter by board, bench gear, agent or evidence1 active

Wed 14 Oct19:2015 d ago
NewsBB-0244artificialanalysis.ai
AA-Robotics benchmark has coding agents drive a real robot arm
Artificial Analysis launched AA-Robotics v0.1, a benchmark in which language models in coding-agent harnesses control a Hiwonder NexArm robot arm. Models in Codex, Claude Code and Antigravity write code for 8 zero-shot tabletop tasks, watching through 4 cameras. GPT-6 Astra led with 69.4 and Claude Opus 5.5 scored 48.8. Models took about 30 minutes a task; people averaged 20 seconds.
Shown working
Mon 15 Jun04:044 mo ago
NewsBB-0085arxiv.orgCurator pick
Embedded Arena: agents deploy models to microcontrollers with hardware feedback
Zhihan Zhang and colleagues, mostly at the University of Washington, published Embedded Arena, a benchmark that scores agents' model and firmware edits on microcontrollers. Boards include a MAX78000, an ESP32-S3 and an STM32N6. The paper reports Claude Opus 4.7 and Gemini 3.1 Pro failing every deployment without hardware feedback; with it, the first success came within 3 iterations.
Claimed