Search papers, labs, and topics across Lattice.
The paper identifies a structural failure mode in Chamfer distance optimization for 3D shapes, where direct optimization leads to worse Chamfer values than no optimization. This failure is attributed to a many-to-one collapse induced by the per-point Chamfer gradient, acting as a unique attractor. The authors demonstrate that non-local coupling, achieved through shared-basis deformation in 2D and a differentiable Material Point Method (MPM) prior in 3D, can suppress this collapse and improve Chamfer optimization.
Chamfer distance, the workhorse loss for point cloud tasks, can actually *increase* when you optimize it, unless you use non-local coupling to avoid gradient collapse.
Chamfer distance is the standard training loss for point cloud reconstruction, completion, and generation, yet directly optimizing it can produce worse Chamfer values than not optimizing it at all. We show that this paradoxical failure is gradient-structural. The per-point Chamfer gradient creates a many-to-one collapse that is the unique attractor of the forward term and cannot be resolved by any local regularizer, including repulsion, smoothness, and density-aware re-weighting. We derive a necessary condition for collapse suppression: coupling must propagate beyond local neighborhoods. In a controlled 2D setting, shared-basis deformation suppresses collapse by providing global coupling; in 3D shape morphing, a differentiable MPM prior instantiates the same principle, consistently reducing the Chamfer gap across 20 directed pairs with a 2.5$\times$ improvement on the topologically complex dragon. The presence or absence of non-local coupling determines whether Chamfer optimization succeeds or collapses. This provides a practical design criterion for any pipeline that optimizes point-level distance metrics.
