Search papers, labs, and topics across Lattice.
The paper introduces WildActor, a framework for generating human videos conditioned on arbitrary viewpoints while maintaining strict identity consistency. To facilitate this, the authors created Actor-18M, a large-scale human video dataset containing 1.6M videos and 18M images with diverse viewpoints. WildActor employs an Asymmetric Identity-Preserving Attention mechanism and a Viewpoint-Adaptive Monte Carlo Sampling strategy to achieve balanced manifold coverage and preserve identity across dynamic shots.
WildActor generates realistic human videos from any viewpoint while strictly preserving identity, a feat that existing methods struggle with due to face-centric behavior or copy-paste artifacts.
Production-ready human video generation requires digital actors to maintain strictly consistent full-body identities across dynamic shots, viewpoints and motions, a setting that remains challenging for existing methods. Prior methods often suffer from face-centric behavior that neglects body-level consistency, or produce copy-paste artifacts where subjects appear rigid due to pose locking. We present Actor-18M, a large-scale human video dataset designed to capture identity consistency under unconstrained viewpoints and environments. Actor-18M comprises 1.6M videos with 18M corresponding human images, covering both arbitrary views and canonical three-view representations. Leveraging Actor-18M, we propose WildActor, a framework for any-view conditioned human video generation. We introduce an Asymmetric Identity-Preserving Attention mechanism coupled with a Viewpoint-Adaptive Monte Carlo Sampling strategy that iteratively re-weights reference conditions by marginal utility for balanced manifold coverage. Evaluated on the proposed Actor-Bench, WildActor consistently preserves body identity under diverse shot compositions, large viewpoint transitions, and substantial motions, surpassing existing methods in these challenging settings.
