Search papers, labs, and topics across Lattice.
This paper introduces a trust-aware coordination framework that utilizes a shared knowledge graph to enhance the traceability of software artifacts in multi-agent AI systems. By implementing a two-stage traceability link prediction pipeline that integrates embedding-based retrieval with LLM-based multi-criteria analysis, the authors address the propagation of errors and low-confidence decisions across sequential agents. The evaluation on an automotive software engineering case study demonstrates that confidence calibration is crucial for effective coordination, significantly improving link prediction accuracy and protocol effectiveness.
Confidence calibration in multi-agent systems can drastically reduce compliance gaps and contradictory links in safety-critical software engineering tasks.
Multi-agent AI systems are increasingly used to automate software engineering tasks including requirements analysis, architecture design, test generation, and traceability linking. When these agents operate as a sequential pipeline over shared software artifacts, errors and low-confidence decisions made by upstream agents propagate to downstream stages, producing orphaned requirements, contradictory links, and compliance gaps that pose significant risks in safety-critical domains. We propose a trust-aware coordination framework where a shared knowledge graph serves as both centralized semantic memory and a coordination surface through which agents assess and build upon each other's contributions using calibrated confidence scores. Our approach introduces a two-stage traceability link prediction pipeline combining embedding-based retrieval with LLM-based multi-criteria analysis, a traceability seeding mechanism that enables comparison between derivation-time and validation-time confidence, and a consistency protocol governing pipeline interactions through confidence threshold gating, confidence divergence detection, and conflict resolution. We evaluate on an automotive software engineering case study measuring link prediction calibration, protocol effectiveness, threshold sensitivity, and the impact of traceability seeding. Ablation studies confirm that confidence calibration is essential for effective pipeline coordination.
