Search papers, labs, and topics across Lattice.
This paper introduces TextCAD, a multimodal framework that enhances panoptic symbol spotting in CAD floor plan drawings by jointly modeling graphical primitives and textual annotations. The authors address the limitations of existing methods that inadequately utilize textual annotations, which are crucial for capturing complex semantics, by employing a Type-Attribute Correlation Encoder (TACE) and a Semantic Hierarchy Alignment framework. Experimental results demonstrate that TextCAD significantly outperforms state-of-the-art methods, showcasing its effectiveness in improving symbol spotting performance through advanced cross-modal semantic integration.
TextCAD achieves state-of-the-art symbol spotting performance by effectively integrating graphical and textual information, revealing the untapped potential of textual annotations in CAD analysis.
Computer-Aided Design (CAD) floor plan drawings contain both graphical primitives and textual annotations, which provide complementary geometric and semantic cues for intelligent design understanding. Among CAD analysis tasks, panoptic symbol spotting has become increasingly important with the growing demand for industrial digitalization and deep learning-based automation. However, most existing methods remain primarily primitive-centric and underexploit textual annotations, despite their critical semantic value. Even the few text-aware approaches often treat annotations only superficially, without properly modeling complex syntax and hierarchical semantics of CAD annotations, which leads to semantic loss and suboptimal spotting performance. To address these limitations, we propose TextCAD, a multimodal framework that jointly models graphical primitives and textual annotations for panoptic symbol spotting. Specifically, we design a Type-Attribute Correlation Encoder (TACE) to explicitly encode the compositional semantics within annotations by jointly modeling their types and attributes. We further introduce a Semantic Hierarchy Alignment framework with Multi-level Semantic Filtering (MSF) and primitive downsampling, which adaptively aligns annotation semantics with graphical primitives at different semantic levels and enables accurate cross-modal semantic injection and fusion. Experiments on real-world building-design datasets show that TextCAD effectively improves symbol spotting performance and achieves state-of-the-art results.
