Search papers, labs, and topics across Lattice.
This paper presents a formal mechanism design model for participatory governance of deployed AI agents, emphasizing resource allocation as a means of self-enforcing authorization through compute budgets. By framing governance as an extensive form game with verified human stakeholders contributing to a distinct governance currency, the model aims to establish a Safe AI paradigm where compute serves as an effective governance lever. Key findings highlight the challenges of manipulating the governing electorate by the governed agents and propose a structured approach to mitigate these risks while ensuring compliance with safety standards.
Governance of AI agents can be transformed into a self-enforcing system through innovative resource allocation strategies that directly tie compute budgets to stakeholder contributions.
We give a formal mechanism design model for the continuous participatory governance of a deployed AI agent. The mechanism is built on the principle that governance should control an AI agent through resource allocation so as to make authorization self enforcing via compute budgets. The mechanism seeks to establish the Safe AI paradigm that compute is an effective governance lever. We situate our work as a compliance or commons overlay on a deployer. One governance period is an extensive form game in which verified human stakeholders arrive sequentially and contribute, on a provision or a rejection market, in a governance currency that is deliberately distinct from the agents compute. A funding aggregator turns raw contributions into breadth weighted effective supports - a two threshold gate with hysteresis converts net support into a binary authorization that, through a coupling map bounded by an exogenously certified safety ceiling, releases a metered compute budget - realized in hardware as a signed compute license so that the decision is self-enforcing. We characterize the class of agents the mechanism can govern and isolate manipulation of the governing electorate by the governed agent as the central open problem. We also introduce several challenges addressing manipulation of governing electorate by the governed agents.
