Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the unique challenges of requirements engineering for agentic AI systems, introducing the concept of the delegated-autonomy boundary, which delineates the decisions regarding delegation, authority, oversight, and control. To facilitate this, the authors propose two artifacts: the Agency Justification Record (AJR) for determining when to use agentic systems over simpler alternatives, and the Agentic Delegation Policy (ADP) that outlines essential specifications for safe development. The framework is exemplified through contrasting applications in a safety-critical hospital discharge coordination agent and an automated code review agent, highlighting the importance of graduated authority in the ADP.
Defining the delegated-autonomy boundary could revolutionize how we specify and manage authority in agentic AI systems, ensuring safer and more effective deployment.
Agentic AI systems do not just predict or recommend; they plan, maintain state, and act in external environments with varying degrees of autonomy. This changes the requirements engineering problem in a specific and under-addressed way: it introduces what we call the delegated-autonomy boundary -- the set of decisions about what may be delegated to the system, under what graduated authority, with what oversight, and how control is returned. Current practices bury these decisions inside prompts, tool schemas, and runtime policies, even though they are requirements-level commitments. This paper proposes two complementary artifacts. First, an Agency Justification Record (AJR) helps teams decide when an agent is warranted over simpler alternatives. Second, an Agentic Delegation Policy (ADP) captures what must be specified for safe and effective development: purpose, authority, information, coordination, assurance, and evolution. Crucially, authority in the ADP is modelled as graduated, i.e., a tiered structure. We illustrate the framework with two contrasting examples: a safety-critical hospital discharge coordination agent and an automated code review agent.