OnlyAct: Extracting Action Representations from Foundation Models for World Models
NeurIPS 2026
Turns a pretrained video encoder into an action encoder with zero action labels, keeping what moved and discarding the scene, so the motion from one video can drive a world model in any other.