Search papers, labs, and topics across Lattice.
This paper explores using Large Language Models (LLMs) for Design Structure Matrix (DSM) modularization, a combinatorial problem in engineering design, across five cases and three backbone LLMs. The proposed method achieves near-reference quality modularization within 30 iterations without specialized optimization code. Surprisingly, the inclusion of domain knowledge consistently impairs performance on more complex DSMs, leading to the semantic-alignment hypothesis.
Domain knowledge hurts, not helps, when using LLMs to modularize complex engineering systems, revealing a semantic misalignment between LLM priors and structural optimization objectives.
Design Structure Matrix (DSM) modularization, the task of partitioning system elements into cohesive modules, is a fundamental combinatorial challenge in engineering design. Traditional methods treat modularization as a pure graph optimization, without access to the engineering context embedded in the system. Building on prior work on LLM-based combinatorial optimization for DSM sequencing, this paper extends the method to modularization across five cases and three backbone LLMs. Our method achieves near-reference quality within 30 iterations without requiring specialized optimization code. Counterintuitively, domain knowledge, beneficial in sequencing, consistently impairs performance on more complex DSMs. We attribute this to semantic misalignment between the LLM's functional priors and the purely structural optimization objective, and propose the semantic-alignment hypothesis as a testable condition governing knowledge effectiveness with LLMs. Ablation studies identify the most effective input representation, objective formulation, and solution pool design for practical deployment. These findings offer practical guidance for deploying LLMs in engineering design optimization.