Search papers, labs, and topics across Lattice.
This paper introduces Ishigaki-IDS, an open-weight LLM designed to streamline the drafting of Information Delivery Specifications (IDS) in Building Information Modeling (BIM) by leveraging continued pretraining, supervised fine-tuning, and reinforcement learning with external validator feedback. The model significantly outperforms existing baselines, achieving an IDSAuditPass score of 0.651 on a benchmark of expert-created cases, indicating its effectiveness in generating validator-loadable drafts. Furthermore, practical implementation with BIM practitioners demonstrated a 54.7% reduction in authoring time, underscoring its potential to alleviate the burdens of IDS creation.
Ishigaki-IDS slashes IDS authoring time by over half while dramatically improving validation success rates, making it a game-changer for BIM practitioners.
Building Information Modeling (BIM) projects require information requirements to be described as machine-checkable Information Delivery Specification (IDS) files in order to verify whether building models contain the required attributes. However, IDS authoring remains a practical bottleneck: practitioners must handle domain vocabulary, strict XML schema constraints, and external validator conformance while also checking whether the requirement itself is correctly expressed. We present Ishigaki-IDS, an open-weight LLM specialized for verifier-aware IDS draft generation. The model combines continued pretraining on BIM/IDS corpora, supervised fine-tuning on information-requirement-to-IDS pairs, and reinforcement learning with verifiable rewards from an external validator. The goal is not to replace expert review, but to move IDS authoring from low-level XML and schema repair toward validator-loadable drafts that practitioners can inspect and correct. On the 166-case expert-created Ishigaki-IDS-Bench, Ishigaki-IDS-8B achieves an IDSAuditPass score of 0.651, a validator-pass metric for generated IDS files, substantially outperforming Claude Opus 4.5, the strongest single-shot LLM baseline we evaluated, at 0.331. It also obtains an Audit-Gated FacetF1 of 0.282, which measures requirement-facet alignment among validator-passing drafts. The same recipe scales: 14B and 32B variants reach IDSAuditPass 0.753 / 0.693 and Audit-Gated FacetF1 0.392 / 0.369. In a workflow check with six BIM practitioners, Ishigaki-assisted authoring reduced aggregate work time by 54.7% under the same validation and alignment endpoint. These results suggest that verifier-aware IDS generation can reduce the practical burden of converting BIM information requirements into reviewable IDS drafts.