Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
Sphere Encoder 2 addresses two key limitations in its predecessor's latent sphere autoencoder for image generation: the under-explored polar region of the latent space and the blurriness induced by pixel-wise reconstruction loss. By introducing a novel training strategy that encourages exploration of the latent sphere's poles and employing a perceptual loss function, Sphere Encoder 2 achieves significantly improved image quality with high-frequency details. This advancement maintains the original autoencoder's efficiency and simplicity while enhancing generative capabilities.
Latent sphere autoencoders can now generate sharp, high-fidelity images by overcoming equatorial bias and averaging artifacts with a novel training regimen.
Sphere Encoder is an autoencoder that generates images by decoding random points from a high-dimensional latent sphere. We identify two limitations of the original formulation that reduce its generation quality. First, random points concentrate near the equator relative to the pole on an encoded latent, but the training rotation never reaches this region, leaving a gap that limits one-step generation. Second, training for generation with pixel-wise reconstruction loss encourages the decoder to average over plausible images, producing blurry images that lack high-frequency details. We present Sphere Encoder 2 to address both limitations, substantially improving image generation quality while maintaining the speed and simplicity of a autoencoder. Models are released at \href{https://github.com/kaiyuyue/sphere2}{github.com/kaiyuyue/sphere2}.