Self-Building Labs
Jiaru Bai, Yuchi Zhao, Han Hao, Miroslav Bogdanovic, Yang Cao, Varinia Bernales, et al.
arXiv:2610.23826v1Self-driving laboratories have already changed how scientists can run experiments. Instead of manually pipetting, moving samples, or tuning conditions one by one, an automated lab can execute experiments, observe the results, and use those results to decide what to try next. That closed loop is powerful because it speeds up discovery and lets researchers search larger spaces of possibilities than they could by hand. But there is a catch. Most self-driving labs are only autonomous within the narrow set of procedures they were originally built to do. If the scientific question changes, or if the workflow needs a new instrument, a new layout, or a new robot behavior, people usually have to step in and do a lot of engineering. That means the bottleneck is no longer just scientific reasoning. It is laboratory flexibility: how quickly can the lab itself be adapted to a new task? This paper argues that to really scale scientific automation, the lab should not just execute experiments. It should be able to build up the missing capabilities needed for the experiment. The authors call this a self-building laboratory, or SBL. The idea is simple to say but ambitious in practice: given a high-level scientific goal, the system should figure out what capabilities it already has, identify what is missing, and then design, configure, and operate the lab setup needed to carry out the work. That includes several layers. First, it has to understand the physical laboratory: where the devices are, what they are, how they connect, and how they are arranged. Second, it needs a digital twin, meaning a software model of the lab that can be used for planning and testing. Third, it needs robot skills, from basic motion to precise interaction with equipment. And fourth, it needs full experimental workflows that combine all of those pieces into a real procedure. The broader context here is important. In recent years, language models and other AI agents have become much better at planning experiments, generating code, and interacting with tools. At the same time, robotics has advanced enough that robots can move through lab spaces, transfer samples, and use feedback from cameras and sensors. Digital twins have also become more useful for testing procedures before trying them in the real world. So the ingredients for more flexible laboratory automation are starting to exist. What has been missing is a system that ties them together so the lab can grow its own capabilities instead of waiting for a human engineer to wire everything up manually. SBL is the authors’ answer to that problem. The system starts from whatever is already there, which could be an empty room, or a partially automated lab, or a working self-driving lab. The user gives it a scientific goal plus a description of the current environment, such as photos, device identifiers, and any existing automation interfaces. From there, SBL works out what needs to be built. A key part of the system is the digital twin. The paper describes a twin-building agent that reconstructs the lab from available information. If CAD models or URDF files already exist, it can use them. If not, it can approximate the equipment from manufacturer documentation, technical specifications, and reference images. It estimates dimensions, decomposes devices into components like frames, housings, doors, and moving parts, and then builds models from geometric primitives and custom meshes. It iteratively compares rendered views against real reference images and adjusts the geometry until the model is close enough for planning. Then it adds articulations, such as joints and motion limits, so the models can behave like real devices in simulation. After that, the system places those devices into a scene that matches the lab layout. It can use robot-mounted cameras to gather additional observations from different viewpoints, compare what it sees to what the twin predicts, and refine device positions and orientations. This matters because accurate spatial relationships are what make motion planning work. The twin is not just a static drawing of the lab. It is a living replica that can be updated as new observations arrive. The twin also mirrors device interfaces. Simulated devices expose the same API as the physical ones, but point to different endpoints. That means the same code can be tested in simulation and then executed on the real device by switching the target endpoint. The monitoring system also keeps the twin synchronized with the physical lab by polling device status and updating the simulated states. Once the lab is represented digitally, SBL turns to skills. The paper organizes skills into layers: device-level execution interfaces, embodied robot operations, and higher-level scientific procedures. If a needed skill is missing, the agent tries to develop it. In simulation, it maps experimental goals onto available equipment and explores candidate action sequences. It uses object states to define grasp and placement poses, then uses a motion planner to generate collision-free trajectories through the workspace. Those motion segments are composed into workflows. But simulation alone is not enough, especially for precise tasks. The authors point out that transport and coarse positioning can often transfer well from simulation to reality, but millimeter-scale interactions like grasping, insertion, and alignment are much more sensitive to calibration and modeling errors. For those, SBL uses online exploration on the real robot. It takes in visual observations, depth data, robot state, and force-torque feedback, and then uses that feedback to refine its actions. In the example described, a constrained insertion might involve visual alignment, guarded descent, contact detection, lateral adjustment, and then resuming insertion after the load decreases. A particularly interesting design choice is that once a useful behavior has been discovered, SBL tries to turn it into a reusable skill. The system distills successful action sequences and their feedback conditions into executable Python scripts with deterministic actions, sensor-based conditions, and recovery branches. Then it tests that skill repeatedly until it is reliable. After that, the skill can run without the agent actively reasoning over every step. That is important because full agentic reasoning is too slow for many lab workflows. The system only calls the agent back in when execution goes outside the conditions encoded in the skill. Safety is another major concern. The authors treat it as a first-class part of the system. In simulation, SBL can explore hazardous scenarios to discover potential risks and generate candidate safety guidelines. In the physical lab, it includes human stop controls, speed limits on robot motion, and continuous force monitoring so the robot can stop if it encounters unexpected contact. So the safety story is both reactive and proactive: stop bad things from happening in the lab, and also use simulation to anticipate hazards before they occur. The paper demonstrates the full system in a real quantum-dot synthesis workflow. This is a good test case because it combines liquid handling, plate sealing, and photophysics measurements, and it requires long-horizon execution across multiple instruments. A rail-mounted robotic arm moves a 96-well plate between devices, and that means the robot has to keep the plate level and place it with high precision during pickup and insertion. The workflow begins with the system reading the lab setup through APIs: the deck layout, pipettes, tip inventory, sealer, and reader capabilities. It then adapts the requested chemistry to those constraints and writes a standalone Opentrons Python protocol offline. That protocol is run in a simulator matching the robot’s software version, reviewed, and then frozen by recording its SHA-256 hash. The gateway is configured to reject any change to that hash, which helps ensure the executed protocol is exactly the one that was validated. Before execution, SBL checks that the equipment is ready and idle. It then sends the protocol actions sequentially, verifying before each request that no motion is in progress and confirming afterward that the request was accepted. For the plate transfers between instruments, it uses the digital twin for motion planning and visual plus sensory feedback for grasping and placement. The plate is first moved from the Opentrons OT-2 to the PlateLoc for sealing. Then, to prepare for insertion into the Cytation 5, the robot uses an intermediate plate holder as a transfer station. The excerpt cuts off there, but the important point is clear: the system is coordinating an end-to-end workflow across multiple devices, not just executing a single isolated motion. What do the results actually show? At a high level, they show that SBL can start from incomplete laboratory information, reconstruct the environment, develop missing operational skills, and carry out a real scientific workflow. The paper also says the system scales across different robot types and setups, from a single workstation to multi-robot laboratories. That suggests the approach is not tied to one specific platform. More importantly, the quantum-dot experiment validates the end-to-end claim: the system is not only planning in simulation, but carrying out a real-world synthesis workflow that combines software, robotics, and lab instrumentation. The main limitation is also clear from the paper’s framing. This is still a system that depends on digital twins, careful validation, and human approval at key points. It is not magic autonomy. The quality of the twin matters, the accuracy of the device models matters, and the reliability of the interfaces matters. The paper also implies that some tasks still require trial-and-error in the real world, especially where precision is critical. And because the system is trying to generalize across arbitrary laboratories, building and maintaining those capabilities will remain a substantial engineering challenge. Still, the big idea is compelling. Instead of asking humans to prebuild every automation capability in advance, SBL shifts the human role upward. Researchers specify the scientific objective, and the system takes on more of the work of making the lab able to do it. If that direction continues to mature, it could make scientific automation much more flexible, more accessible to non-specialists, and much easier to scale to new kinds of discovery.
Also spotted that day
Previous daily papers