Runway: Learning From Watching the World · Not Boring by Packy McCormick
Science, Technology & Innovation · Oct 13, 2026
Runway argues that a shared, video-pretrained World Model can support interfaces, robotics, and operating systems by learning physical and visual dynamics, then adapting to domain-specific actions through lightweight post-training. This backbone-centric approach could improve multiple products at once and makes action representations key interfaces to a common perception-and-simulation layer.
Runway: Learning From Watching the World · Not Boring by Packy McCormick
Science, Technology & Innovation · Oct 13, 2026
Runway reports that web video can initialize robot manipulation policies nearly as well as teleoperated robot video, reducing—but not eliminating—the need for costly robot demonstrations. Praxis-1 uses a shared 3D end-effector action representation, with embodiment-specific fine-tuning and physical validation still required for force and precision.
Runway: Learning From Watching the World · Not Boring by Packy McCormick
Science, Technology & Innovation · Oct 13, 2026
The document proposes learned, action-conditioned “wind tunnel” simulators for testing policies before costly or dangerous real-world deployment. While one robotics study found strong agreement between simulated and real policy rankings, simulator exploitation remains a major limitation, requiring continual validation against real-world data and deliberate environmental randomization.
Runway: Learning From Watching the World · Not Boring by Packy McCormick
Science, Technology & Innovation · Oct 13, 2026
Runway’s Interface World Model thesis proposes generating application interfaces frame by frame from user interactions, using an LLM for semantic logic, rather than relying on fixed presentation layers. Early company-reported comparisons favored Solaris over Claude Opus 5 for instruction following and natural scene behavior, but the practical opportunity is mainly in visually rich interactive software—not safety-critical structured systems—requiring verified state, transactional logic, and generative rendering to remain separate while inference cost, reliability, accessibility, and session drift are addressed.