Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces PrismAvatar, a novel system that enables real-time stereoscopic video communication by integrating monocular avatar capture with subpixel-encoded glasses-free lenticular displays. By utilizing natural head movements as pseudo-multiview supervision, the system effectively reconstructs a controllable head avatar while optimizing for weakly observed regions, leading to enhanced visual fidelity. The resulting prototype achieves a frame rate of 10.65 FPS, which can be increased to 38.49 FPS with a subject-specific distilled driver, making it a significant advancement in immersive telepresence technology.
Real-time stereoscopic communication is now possible with a monocular video input, achieving high visual fidelity without specialized capture rigs.
Real-time stereoscopic video communication has long been a goal of immersive telepresence, yet practical systems still require specialized capture rigs or reduce remote users to a single portrait view. We present PrismAvatar, a Gaussian head-avatar system that connects monocular avatar capture with subpixel-encoded glasses-free lenticular display for real-time autostereoscopic communication. From a monocular portrait video, PrismAvatar reconstructs a controllable head avatar and optimizes it for the lateral viewing zones induced by the display. The method uses natural head turns as pseudo-multiview (PMV) supervision to constrain regions that are otherwise weakly observed in monocular training, including hair, ears, jaw contours, and neck boundaries. Reliable side frames are yaw-binned, aligned to virtual cameras, and supervised within a strict head-and-hair domain; contour-aware losses and staged regularization further suppress ghosting, alpha leakage, and depth instability while preserving lateral detail. At runtime, PrismAvatar renders 32 virtual views and encodes them into a 4K lenticular raster with calibrated subpixel-routing masks. The live-tracker prototype sustains 10.65 FPS, and a subject-specific distilled driver raises the same display pipeline to 38.49 FPS.