Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study evaluates eight retrieval architectures for aerospace supply chain intelligence, revealing that traditional vector retrieval methods fail on queries requiring structural reasoning over interconnected entities. By analyzing a 46-node knowledge graph and 23 queries, the authors find that five query classes are structurally unreachable for vector retrieval, highlighting that the limitations stem from the computational operators available rather than model intelligence. An LLM Query Planner utilizing nine typed traversal primitives significantly outperforms bespoke handlers, achieving an F1 score of 0.632 compared to 0.472, and effectively generalizes to unseen queries by selectively adopting additional graph computation tools when necessary.
Structural reasoning in retrieval-augmented generation is not limited by model intelligence but by the computational operators available, revealing significant gaps in current approaches.
Retrieval-Augmented Generation (RAG) fails systematically on queries requiring structural reasoning over interconnected entities. We compare eight retrieval architectures for aerospace supply chain intelligence, progressing from text retrieval through graph traversal to graph computation. Using a 46-node knowledge graph with 64 typed edges, we evaluate 23 queries across 10 intent categories and demonstrate that five query classes are structurally unreachable for vector retrieval. Our central finding is the operator vocabulary thesis: the barrier to LLM-based graph reasoning is not model intelligence but the computational operators available as tools. An LLM Query Planner with 9 typed traversal primitives outperforms bespoke handlers (F1 = 0.632 vs. 0.472) while generalizing to unseen queries. Adding 6 graph computation tools, the LLM selectively adopts them for exactly the query categories where traversal fails. We also identify a measurement gap: entity-level F1 systematically underscores structural queries where comprehensive answers are correct.