Search papers, labs, and topics across Lattice.
IRIS introduces a novel framework for efficient and interactive scene editing by combining the benefits of Neural Radiance Fields and 3D Gaussian splatting. It employs an analytical sampling strategy to precisely identify ray-scene intersection points, avoiding empty space processing, and introduces a continuous feature aggregation mechanism along the ray to bypass costly 3D searches. This approach enables high-fidelity, real-time rendering and flexible shape editing.
IRIS achieves real-time rendering and editing of neural scenes by analytically computing ray intersections and aggregating features along the ray, sidestepping slow volumetric sampling and spatial lookups.
Neural Radiance Fields achieve high-fidelity scene representation but suffer from costly training and rendering, while 3D Gaussian splatting offers real-time performance with strong empirical results. Recently, solutions that harness the best of both worlds by using Gaussians as proxies to guide neural field evaluations, still suffer from significant computational inefficiencies. They typically rely on stochastic volumetric sampling to aggregate features, which severely limits rendering performance. To address this issue, a novel framework named IRIS (Intersection-aware Ray-based Implicit Editable Scenes) is introduced as a method designed for efficient and interactive scene editing. To overcome the limitations of standard ray marching, an analytical sampling strategy is employed that precisely identifies interaction points between rays and scene primitives, effectively eliminating empty space processing. Furthermore, to address the computational bottleneck of spatial neighbor lookups, a continuous feature aggregation mechanism is introduced that operates directly along the ray. By interpolating latent attributes from sorted intersections, costly 3D searches are bypassed, ensuring geometric consistency, enabling high-fidelity, real-time rendering, and flexible shape editing. Code can be found at https://github.com/gwilczynski95/iris.
