Search papers, labs, and topics across Lattice.
AvatarPointillist introduces a novel autoregressive Transformer-based framework for generating dynamic 4D Gaussian avatars from a single portrait image. The model sequentially generates a point cloud for 3D Gaussian Splatting, dynamically adjusting point density based on subject complexity and predicting per-point binding information for animation. Conditioning a dedicated Gaussian decoder on the latent features from the AR generator significantly improves avatar fidelity.
Autoregressive Transformers can now generate high-fidelity, animatable 4D Gaussian avatars from single portrait images, offering a new paradigm for controllable avatar creation.
We introduce AvatarPointillist, a novel framework for generating dynamic 4D Gaussian avatars from a single portrait image. At the core of our method is a decoder-only Transformer that autoregressively generates a point cloud for 3D Gaussian Splatting. This sequential approach allows for precise, adaptive construction, dynamically adjusting point density and the total number of points based on the subject's complexity. During point generation, the AR model also jointly predicts per-point binding information, enabling realistic animation. After generation, a dedicated Gaussian decoder converts the points into complete, renderable Gaussian attributes. We demonstrate that conditioning the decoder on the latent features from the AR generator enables effective interaction between stages and markedly improves fidelity. Extensive experiments validate that AvatarPointillist produces high-quality, photorealistic, and controllable avatars. We believe this autoregressive formulation represents a new paradigm for avatar generation, and we will release our code inspire future research.
