Search papers, labs, and topics across Lattice.
This paper introduces a hierarchical, skill-based architecture for agentic orchestration that mitigates the decision-space explosion faced by Large Language Model (LLM) agents when accessing a flat registry of tools. By organizing capabilities into a rooted tree structure and employing a Last-In-First-Out (LIFO) stack for execution, the architecture allows for deterministic task execution and efficient management of nested contexts. The proposed method significantly improves routing accuracy and memory efficiency, as evidenced by controlled benchmarks that demonstrate its superiority over traditional flat routing approaches under various operational pressures.
Hierarchical orchestration can drastically reduce decision-space explosion in LLMs, enhancing both routing accuracy and memory efficiency.
The rapid expansion of capabilities in Large Language Model (LLM) agents has exposed a critical architectural bottleneck: when agents are given access to a flat, monolithic registry of tools, the model must evaluate hundreds or thousands of options simultaneously. This leads to decision-space explosion, context window saturation, and degraded routing accuracy. To address these limitations, this paper presents a hierarchical, skill-based architecture for agentic orchestration. Capabilities are organized as a rooted tree where internal nodes make routing decisions and leaf nodes execute deterministic tasks. The runtime enforces a single-step execution loop governed by a Last-In-First-Out (LIFO) stack, giving the agent a form of memory akin to a Pushdown Automaton, therefore enabling it to track nested execution contexts and resume deterministically from any depth. Capability discovery follows a manifest-driven, lazy-loading protocol: only the immediate children of the active node are loaded, so memory and prompt costs scale with the explored path rather than the global registry. By replacing global memory with localized stack frames, the architecture prevents outputs from one execution branch from leaking into another, establishing the isolation guarantees required for deployment in regulated enterprise environments. We also discuss UPI Help, an AI-powered digital payments support product, as a motivating production deployment context. We provide a mathematical formalization of the orchestration state, detailed algorithmic analysis of the execution loop, and controlled benchmarks comparing flat and hierarchical routing under increasing tool catalogs, multi-step workflow pressure, and visible schema-token exposure per LLM call.
