Code-as-World: Agentic Loop Converts Real Videos Into Executable MuJoCo Physics Programs

Researchers have introduced MIRROS, a system using a Code-as-World approach where an agentic loop analyzes real-world video and rewrites it as executable physics simulation code in MuJoCo. Rather than storing video as pixels or latent vectors, the system represents scenes as structured, runnable programs that encode object geometry, dynamics, and interactions. This approach makes world representations interpretable, editable, and physically grounded — a meaningful step for robotics, simulation, and embodied AI research. Developers working on sim-to-real transfer, synthetic data generation, or physics-based planning pipelines will find this directly relevant. The agentic loop architecture also demonstrates a practical pattern for using LLMs to bridge perception and executable simulation.