Search papers, labs, and topics across Lattice.
This study benchmarks the performance of open- and closed-source Large Language Models (LLMs) in repairing misconfigurations in complex computer networks, integrating formal network verification and context retrieval tools. The findings reveal that agentic architectures significantly enhance both repair efficacy and safety compared to base LLMs, with improvements of 12% and 17% respectively. This advancement is crucial as it addresses the persistent issue of network outages caused by misconfigurations, showcasing a more reliable approach to automated network management.
Agentic architectures boost network configuration repair efficacy by 12% and safety by 17%, tackling a critical source of Internet outages.
Misconfigurations in computer networks remain a major source of critical Internet outages. Research is turning to Large Language Models (LLMs) to automate the complex, error-prone task of network configuration. However, even state-of-the-art models fail to resolve misconfigurations in large-scale, complex scenarios and often introduce new errors. In this work, we benchmark open- and closed-source LLMs augmented with formal network verification and context retrieval tools. We demonstrate that agentic architectures outperform base LLMs in repair efficacy (by 12% on average) and safety (by 17% on average), enabled by the ability to dynamically manage context and iteratively validate configuration repairs.
ETH