Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an end-to-end Transformer encoder-decoder architecture for reconstructing 3D house roof wireframe models from sparse SfM point clouds and ground-level semantic data, addressing the S23DR Challenge 2026. The method employs dynamic subsampling of point clouds based on semantic priority and integrates Gestalt and ADE20k features to enhance segmentation context, ultimately decoding learned query embeddings into 3D wireframe edges through cross-attention. Evaluated on the "HoHo 22k" dataset, the approach achieves a Hybrid Structure Score (HSS) of 0.6476, outperforming existing baselines and securing a top position in the challenge.
Achieving a Hybrid Structure Score of 0.6476, this method redefines the state-of-the-art in 3D roof wireframe reconstruction from sparse data.
This paper presents a competitive solution to the S23DR Challenge 2026, which aims to reconstruct 3D house roof wireframe models from sparse SfM point clouds and ground-level semantic segmentations and depth maps. Our proposed method utilizes an end-to-end Transformer encoder-decoder architecture inspired by DETR. To effectively process the geometric and semantic data, the sparse SfM point cloud input is dynamically subsampled based on semantic priority and augmented with Gestalt and ADE20k class features. To further increase segmentation context, we fuse the point features with additional Gestalt feature encodings which are obtained by projecting the points into latent feature maps produced by a frozen autoencoder. Learned query embeddings are then decoded directly into 3D wireframe edges via cross-attention mechanisms. Evaluated on the "HoHo 22k" dataset, our approach significantly outperforms both handcrafted and learned baselines, achieving a Hybrid Structure Score (HSS) of 0.6476 and securing the second-highest position on the challenge's private leaderboard.