Search papers, labs, and topics across Lattice.
This paper introduces RuntimeGuard-AI, a prototype designed to enhance the durability and trust of AI audit records by binding deterministic policy decisions to their source and providing a privacy-minimizing receipt system. The approach allows for rapid decision-making while ensuring that audit evidence can be validated after system restarts, achieving a throughput of 27,193 requests per second with low latency. Key findings highlight a trade-off between durability and latency, emphasizing that while the system improves audit reliability, it does not guarantee complete protection against compromised signers or legal conformity.
Achieving over 27,000 requests per second, this system redefines the durability-latency trade-off in AI audit records, but raises questions about security and compliance.
An AI audit record is useful only if its durability and trust boundary are explicit. Returning a guarded decision before any durable write minimizes latency, but it cannot guarantee that evidence survives an immediate crash. We rebuild RuntimeGuard-AI around this constraint. The resulting research prototype binds each deterministic policy decision to the exact policy source, commits a privacy-minimizing record at a caller-selected synchronization boundary, and returns an Ed25519-signed receipt that states whether that boundary completed. After restart, the engine validates framed records, manifests, shard placement, sequence continuity, and replay identity. A separate attestation path groups committed records into chained, signed Merkle epochs that an auditor verifies with an externally obtained key. On an Apple M4 Pro at four worker threads and 2,048-byte prompts, buffered signed evidence reaches 27,193 requests/s with 141.9 microseconds median latency. Per-record data and full synchronization reduce throughput to approximately 242 requests/s and raise median latency to 16.0 ms. Sealing a 100,000-record signed epoch takes 97.0 ms. The result is a measured durability-latency trade-off, not a "free" asynchronous audit path. The prototype does not prove model execution, prevent a compromised signer from forking history, or establish legal conformity.
