Search papers, labs, and topics across Lattice.
CameraAnything is a novel framework that allows for comprehensive video editing through simultaneous manipulation of intrinsic and extrinsic camera parameters, overcoming the limitations of previous methods that either required costly 3D reconstruction or focused solely on extrinsic controls. By integrating per-pixel Pl眉cker ray injection with resolution-aware 3D RoPE in self-attention, the system achieves seamless camera position adjustments, focal length changes, and resolution adaptations without the need for cropping or outpainting. The framework's innovative synthetic data generation pipeline and tailored training strategy enable effective editing across diverse dynamic scenes, significantly enhancing the capabilities of video production tools.
CameraAnything enables filmmakers to reshoot videos with arbitrary camera angles and focal lengths in a single generation, revolutionizing video editing workflows.
We introduce CameraAnything, the first unified framework for camera controlled video editing that enables joint control of both intrinsic and extrinsic camera parameters. Existing approaches either rely on expensive 3D reconstruction to achieve full camera functionality or restrict editing to extrinsic parameter manipulation. Moreover, the coupled influence of intrinsic and extrinsic parameters on video appearance makes disentangled modeling particularly challenging. To address this, we adopt per-pixel Pl眉cker ray injection alongside resolution-aware 3D RoPE in self-attention, building both camera conditioning and spatial positional encoding on the target latent to jointly control camera position, focal length, and native resolution editing without cropping or outpainting. To overcome the scarcity of paired training data, we further develop a scalable synthetic pipeline that constructs diverse dynamic scenes through structured multi-camera recording and generates synchronized videos with varied camera configurations. With a tailored orthogonal training strategy, CameraAnything enables expressive video reshooting with arbitrary viewpoint control, focal length adjustment, resolution adaptation, and multi-shot transitions within a single generation process, offering strong practical value for cinematic video editing and cross-platform content adaptation in video production.