Search papers, labs, and topics across Lattice.
This paper introduces a multi-layer system for ultra-high-resolution static 360-degree telepresence that integrates an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera to enhance immersive experiences. By employing a three-layer representation that includes a tile-based ultra-high-resolution background, a dynamic update layer for foreground motions, and a region-of-interest 4K layer, the system effectively surpasses the limitations of current capture and display hardware. Evaluation results show that this approach significantly improves perceived detail and user immersion compared to traditional video super-resolution methods.
Tile-based background refinement in 360-degree telepresence can dramatically enhance perceived detail and interactivity, surpassing traditional video resolution techniques.
360-degree video telepresence offers strong immersive potential but remains constrained by the limited resolution of current capture and display hardware. Many telepresence installations feature fixed viewpoints and largely static scenes, yet optimization strategies tailored to such setups have received limited attention. We present a multi-layer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera. Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching high-detail 4K PTZ scans onto the base 8K panorama to achieve effective resolution beyond native capture, and represented as a set of spatial tiles; (2) a dynamic update layer that composites foreground motions from the 8K stream via real-time high-resolution background matting; and (3) a region-of-interest 4K layer that streams a real-time PTZ view of the selected region and additionally updates the corresponding background tiles over time. We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience. Our results indicate that tile-based background refinement, together with user-guided updates, provides a practical way to balance panoramic fidelity and interactivity in static 360-degree telepresence.
