real-to-sim

Definition

Reconstructing a simulated environment from real-world capture — video, scans, or sensor logs — so that the sim faithfully mirrors a particular physical setting. Policies can then be trained and stress-tested there cheaply and safely before deployment. It is the mirror image of sim-to-real, which transfers a policy learned in simulation out to hardware; in practice robotics pipelines run the loop in both directions.

Explainers using this term

• Lucida, explained — turning a room video back into parts you can move, by deferring precision to the endLucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling