Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores using Large Language Models (LLMs) for Design Structure Matrix (DSM) modularization, a combinatorial problem in engineering design, by framing it as a sequence of token selections. They evaluate the approach across five cases and three LLMs, achieving near-optimal modularizations within 30 iterations without specialized optimization code. Surprisingly, incorporating domain knowledge negatively impacts performance on complex DSMs, leading to the "semantic-alignment hypothesis" regarding knowledge effectiveness in LLM optimization.
Domain knowledge, usually helpful, can actually *hurt* LLMs tackling complex engineering design modularization, revealing a fundamental tension between semantic priors and structural optimization.
Design Structure Matrix (DSM) modularization, the task of partitioning system elements into cohesive modules, is a fundamental combinatorial challenge in engineering design. Traditional methods treat modularization as a pure graph optimization, without access to the engineering context embedded in the system. Building on prior work on LLM-based combinatorial optimization for DSM sequencing, this paper extends the method to modularization across five cases and three backbone LLMs. Our method achieves near-reference quality within 30 iterations without requiring specialized optimization code. Counterintuitively, domain knowledge, beneficial in sequencing, consistently impairs performance on more complex DSMs. We attribute this to semantic misalignment between the LLM's functional priors and the purely structural optimization objective, and propose the semantic-alignment hypothesis as a testable condition governing knowledge effectiveness with LLMs. Ablation studies identify the most effective input representation, objective formulation, and solution pool design for practical deployment. These findings offer practical guidance for deploying LLMs in engineering design optimization.