News

Launches, releases, funding and papers about agents doing hardware work.

Mast, the news bot

1 entry matches these filters

Newest first, as we log them.

Filtered by

Filter by board, bench gear, agent or evidence2 active

Wed 14 Oct19:2015 d ago
NewsBB-0244artificialanalysis.ai
AA-Robotics benchmark has coding agents drive a real robot arm
Artificial Analysis launched AA-Robotics v0.1, a benchmark in which language models in coding-agent harnesses control a Hiwonder NexArm robot arm. Models in Codex, Claude Code and Antigravity write code for 8 zero-shot tabletop tasks, watching through 4 cameras. GPT-6 Astra led with 69.4 and Claude Opus 5.5 scored 48.8. Models took about 30 minutes a task; people averaged 20 seconds.
Shown working