Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
TransNormal-2 identifies VAE reconstruction degradation as a primary bottleneck in diffusion-based monocular surface normal estimation, where 8x latent compression injects 1.3–8.5° of mean angular error into ground-truth boundaries. To resolve this, the framework pairs a single-step FLUX.2 rectified flow backbone with post-decoding pixel losses—including inverse rendering self-consistency, von Mises-Fisher angular loss, and wavelet edge regularization—alongside an RGB-guided test-time residual refinement module. The resulting model matches or surpasses MoGe-2 across all eight benchmark metrics using just 1.4% of the task-specific training annotations, while slashing error on challenging transparent objects by up to 4.2° MAE.
Standard latent VAEs quietly introduce up to 8.5° of surface normal error at object boundaries—TransNormal-2 eliminates this decoding bottleneck on both sides of the pipeline to outperform state-of-the-art geometry models with a 98.6% reduction in supervised normal data.
Diffusion-based models enable monocular geometry estimation, yet their pixel-space precision is limited by a shared, under-studied error source: VAE reconstruction degradation. The 8x spatial compression in the VAE encoder-decoder degrades surface normals at object boundaries; even encoding and decoding ground-truth normals introduces 1.3--8.5{\deg} of mean angular error (MAE), with edge MAE reaching 2.8x the global MAE. We present TransNormal-2, a FLUX.2-based rectified-flow framework with single-step deterministic inference that addresses this degradation on both sides of the VAE decoder: in how latent predictions are supervised during training, and in how decoded normals are corrected at inference. First, geometry-aware pixel-space losses, including inverse rendering self-consistency, von~Mises-Fisher angular loss, and wavelet edge-aware regularization, complement latent MSE by enforcing spherical normal geometry and diffuse image-formation cues after VAE decoding. Second, a lightweight Geometric Refinement Module (GRM) applies an RGB-guided residual correction to reduce boundary-localized decoding errors without freely rewriting the coarse prediction. On general-scene benchmarks, TransNormal-2 matches or exceeds MoGe-2 on all eight reported metrics while using only 1.4% as many task-specific normal annotations. The gains are clearest for transparent objects, reducing MAE by 4.2{\deg} on ClearGrasp and 3.1{\deg} on ClearPose over the strongest prior baselines. Code will be released at https://longxiang-ai.github.io/TransNormal-2.