Collection · 12 entries · updated 29 Oct 2026

Robot arms and rovers driven by agents

Builds where an LLM agent moves physical hardware: a single servo, desktop and industrial arms, and small rovers. Start with one motor, move up to arms with cameras and vision, then rovers. The last 2 entries show what goes wrong with a model in the control loop; read them before you power anything that can drive off a table. Almost every entry here has video or photos of the physical robot.

Entries in this collection

  1. 4 mo ago

    1 of 12The smallest step: Claude Code finds an RS-485 servomotor, turns it and reads the encoder. A mock backend runs without hardware, and the demo video shows an M17 on the bench.

    ToolBB-0091github.com0 starsPython

    servomotor-mcp: Claude Code drives Gearotons M17 RS-485 servomotors

    Gearotons' servomotor-mcp drives its M17 closed-loop NEMA-17 servomotors over RS-485 from Claude Code. It auto-detects motors on the bus, wraps each of the 48 firmware commands as a tool and adds high-level moves; a mock backend runs without hardware. A terminal recording and a 50-second video show Claude Code turning a bench M17 and reading its encoder.

    Shown working
  2. 3 mo ago

    2 of 12A full replacement stack for a WLKATA desktop arm: new ATmega2560 firmware, ArUco camera calibration and an MCP server. Linked videos show typed requests turned into cube stacking.

    BuildBB-0108github.comBuild of the week

    WLKATA MT4 arm gets new firmware, vision pick-and-place and an MCP server for LLM control

    Sigurd Enghoff replaced the WLKATA MT4 desktop arm's stock firmware and built a vision and MCP control stack on top. His ATmega2560 firmware runs Cartesian moves on the arm, ArUco markers calibrate a fixed camera, and an MCP server takes requests from Claude Code or Cursor. Linked videos show the arm stacking cubes and following typed instructions.

  3. 5 mo ago

    3 of 12A reporter's account of OpenClaw and Codex setting up serial links, calibrating joints and training pick-and-place on a LeRobot SO-101. The clips show the arm finding and gripping a red ball.

    BuildBB-0056wired.comBuild of the week

    A Wired reporter gives his OpenClaw agent a LeRobot SO-101 arm

    Wired's Will Knight connected OpenClaw and Codex to a LeRobot SO-101 arm with a camera. Codex configured the connections, helped calibrate the joints and wrote a script that grips a red ball the camera sees. OpenClaw then guided training of a control model, checking its error rate after each run. The article's clips show the arm at work.

  4. 4 mo ago

    4 of 12Claude Code does the unglamorous work on a home-built SO-101: servo IDs, live gripper values and fine-tuning errors. After 97 recorded episodes the arm places a block in a cup on its own.

    BuildBB-0071note.comBuild of the week

    Claude Code helps fine-tune GR00T so a home-built SO-101 arm drops a block into a cup

    Claude Code wrote serial scripts for the STS3215 servos of a self-assembled SO-101 arm and fixed GR00T N1.6-3B fine-tuning errors for a Japanese maker. It set motor IDs, showed live gripper values and ran training over SSH on a DGX Spark. After 97 recorded episodes, the post's GIF shows the arm placing a block in a cup on its own.

  5. 6 mo ago

    5 of 12An industrial six-axis arm, an electric gripper and cameras wired up by Claude Code in a 4.5-hour hackathon session. Read the write-up for the wrist singularity and blocking Modbus writes it had to fix.

    BuildBB-0023github.comBuild of the week

    Claude Code builds a DENSO robot arm control system in 4.5 hours

    Norihide Mikami used Claude Code with Opus 4.7 to write a Flask control system for a DENSO six-axis arm in one 4.5-hour hackathon session. It drives the arm over b-CAP, an IAI electric gripper over Modbus RTU, a 4K Basler GigE camera, a webcam and a PS5 gamepad. The three-minute video shows the system running.

  6. 4 mo ago

    6 of 12A student 3-DOF crane where Claude plans tasks through a typed MCP control stack and a safety layer blocks any move that would cross a worker. The model stays out of the low-level loop.

    BuildBB-0078github.comBuild of the week

    Claude drives a 3-DOF tower crane through MCP, with a safety check in code

    Amer El-Saad built a 3-DOF tower crane for his master's thesis that Claude plans and drives through 4 MCP tools. One overhead camera, YOLOv8 and ArUco markers locate parts and stations in centimeters. An Arduino Uno drives the DC motors, and code rejects any route that crosses a worker. README photos show the crane and live detections.

  7. 15 d ago

    7 of 12A benchmark that runs Claude Code, Codex and Antigravity on a Hiwonder arm for 8 tasks. Browse the failure clips: missed grasps and wrong completion calls are the usual problems.

    NewsBB-0244artificialanalysis.ai

    AA-Robotics benchmark has coding agents drive a real robot arm

    Artificial Analysis launched AA-Robotics v0.1, a benchmark in which language models in coding-agent harnesses control a Hiwonder NexArm robot arm. Models in Codex, Claude Code and Antigravity write code for 8 zero-shot tabletop tasks, watching through 4 cameras. GPT-6 Astra led with 69.4 and Claude Opus 5.5 scored 48.8. Models took about 30 minutes a task; people averaged 20 seconds.

  8. 5 mo ago

    8 of 12A rover with a short setup: Claude Code drives a Pico W mecanum car with plain TCP commands. The repo media shows it backing up to a wall and sweeping its sonar into a radar plot.

    BuildBB-0065github.com

    Claude Code drives a Freenove mecanum robot car over MCP and maps obstacles with its sonar

    Claude Code drives a Freenove 4WD mecanum car on a Raspberry Pi Pico W through an MCP server and plain-text TCP commands. In one session it reversed until the ultrasonic sensor read 6 cm, then swept the sensor from 20 to 140 degrees and plotted the distances. The repo has photos, terminal captures and clips from live sessions.

  9. 3 mo ago

    9 of 12Claude Code drives a PiCar-X with camera frames as feedback. It learned a three-point turn, then spent 15 minutes parking at a filing cabinet instead of the door.

    BuildBB-0141talraviv.coBuild of the week

    Tal Raviv has Claude drive a SunFounder PiCar-X around his house

    Tal Raviv connected Claude to a SunFounder PiCar-X through a terminal on its Raspberry Pi, with camera photos as feedback. The robot saved notes, learned gentler turns and a three-point turn, and spent about 15 minutes parking at a filing cabinet instead of 20 cm from the door. The post embeds an edited demo video.

  10. 4 mo ago

    10 of 12Claude Code runs on the rover's own Raspberry Pi 4, with lidar, a ToF sensor and two cameras behind MCP tools. The video shows it finding a target object and driving to it around obstacles.

    BuildBB-0092youtube.comBuild of the week

    Saras 2.0: a Raspberry Pi 4 rover that runs Claude Code as its brain

    Tech With Anant rebuilt the Saras rover around Claude Code running on a Raspberry Pi 4. A small MCP server exposes the motors, encoders and camera as tools, and a CLAUDE.md file sets the robot's identity. An LD06 lidar handles obstacle detection. The 24-minute video shows the rover in a live test, driving toward a named object around obstacles.

  11. 5 mo ago

    11 of 12Slow cloud round trips sent a rover into trees and under a shed. The author's fixes, non-AI safety reflexes first and local motor control, apply to every rover on this list.

    Magic SmokeBB-0038aliceplante.substack.comCurator pick

    Building robots with Claude: a rover that hit trees, and the fixes that followed

    Alice Plante had Claude write the code and choose actions for a SunFounder PiCar-X on a Raspberry Pi 5 and a FrodoBots Earth Rover. The Earth Rover's commands went through a cloud relay while Opus took about ten seconds to answer, and it drove into trees. A small binary on the rover cut command latency to under 10 ms.

  12. 3 mo ago

    12 of 12Anthropic's red team on a Unitree Go2: a misjudged trash can, a charge at a reflection in a glass door, and no model finished the hallway loop.

    Magic SmokeBB-0116anthropic.comCurator pick

    Claude plays robotics: a Go2 walks into a trash can and no model completes the office loop

    Anthropic's red team had Claude, GPT, Gemini and other models drive robots, mostly in simulation plus a real Unitree Go2. The team reports that Opus 4.6 misjudged where a trash can was and the Go2 dragged it. Grok 4.1 Fast headed for a table reflected in a glass door, and no model completed an office loop on vision alone.

All collections