Search papers, labs, and topics across Lattice.
This paper introduces a multi-agent discovery engine that autonomously designs hardware-compliant computing systems by leveraging an Evolutionary Knowledge Graph to guide structural evolution. The framework successfully evolved two innovative compression methodologies, Q-Enhance and MoE-Salient-AQ, which outperform traditional human-engineered approaches in both accuracy and efficiency. Notably, the deployment of a 235-billion-parameter model on a constrained dual-A100 server achieved a 75% reduction in memory requirements with minimal accuracy loss, showcasing the potential for scalable hardware-software co-design in AI systems.
Evolving hardware-aware compression techniques can outperform human designs, achieving unprecedented efficiency in deploying massive AI models.
Artificial intelligence increasingly drives automated scientific discovery, yet contemporary generalist agents lack physical grounding, frequently hallucinating hardware-incompatible designs. Here, we present a physically grounded, multi-agent discovery engine that autonomously architects hardware-compliant computing systems. Anchored by an Evolutionary Knowledge Graph structuring past scientific innovations, the framework extracts an "algorithmic Chain-of-Thought" to transform blind stochastic search into directed structural evolution. Applied to the extreme testbed of foundation model deployment, the engine evolved two hardware-aware compression methodologies surpassing human-engineered heuristics: Q-Enhance mitigates long-context accuracy loss in dense models, and MoE-Salient-AQ outperforms state-of-the-art manual sparse Mixture-of-Experts designs by 3.7% at sub-3-bit regimes. Utilizing a bandwidth-efficient Sensitivity Profile, we successfully deployed a massive 235-billion-parameter model onto a constrained dual-A100 server, reducing memory requirements by 75% with a marginal 0.64% accuracy degradation. By transforming unconstrained combinatorial search into knowledge-driven autonomy, this establishes a scalable hardware-software co-design paradigm for machine-driven discovery within strict physical boundaries.
Tsinghua AI