Search papers, labs, and topics across Lattice.
RenderFormer++ introduces a novel feed-forward neural rendering framework that enhances global illumination in mesh scenes by addressing the limitations of existing Transformer-based methods. By integrating Physics-Informed Transport Guidance (PITG) and Hierarchical Object-Centric Tokenization (HOCT), the framework achieves significant improvements in physical consistency and scalability while reducing computational costs. Extensive experiments show that RenderFormer++ not only generalizes effectively across complex scenes but also enhances physical accuracy and rendering efficiency compared to its predecessors.
Achieving physically grounded global illumination rendering at scale, RenderFormer++ outperforms prior methods in both accuracy and efficiency.
We present RenderFormer++, a scalable and physically grounded feed-forward neural rendering framework for global illumination in mesh scenes. Existing Transformer-based neural rendering methods such as RenderFormer achieve promising cross-scene generalization, but suffer from limited physical consistency and poor scalability due to the quadratic attention complexity of triangle-level tokenization. To address these issues, we introduce Physics-Informed Transport Guidance (PITG), which embeds rendering-equation inductive biases into the attention mechanism and enforces transport consistency loss, enabling physically consistent light transport modeling. We further propose Hierarchical Object-Centric Tokenization (HOCT), which aggregates triangle-level features into compact object-level tokens via cross-attention with learnable queries, substantially reducing computational and memory costs while preserving geometric and radiometric information. Extensive experiments demonstrate that RenderFormer++ achieves scalable, stable, and generalizable feed-forward global illumination rendering across complex large-scale scenes with improved physical accuracy and efficiency over prior neural rendering methods.
