Search papers, labs, and topics across Lattice.
This paper addresses the challenge of cryptographic auditing for off-chain data by modeling it as a Constrained Markov Decision Process (CMDP) under partial observability, leading to the development of the DRQN-CMDP framework. The method employs a Deep Recurrent Q-Network with a GRU layer to maintain a belief over hidden node types while adapting the miss-rate penalty using Lagrangian dual ascent. The results show that DRQN-CMDP achieves 83% lower gas costs compared to fixed high-frequency auditing, maintains a low miss rate of 7.5%, and offers moderate detection latency, outperforming 13 other methods across these metrics.
DRQN-CMDP achieves a unique trifecta of 83% lower gas costs, a 7.5% miss rate, and moderate detection latency, outperforming all existing methods in off-chain data auditing.
We model cryptographic auditing of off-chain data as a Constrained MDP (CMDP) under partial observability: the storage node's hidden type and corruption state make the problem a POMDP, while a miss-rate ceiling rho imposes an explicit security constraint. We propose DRQN-CMDP, a Deep Recurrent Q-Network whose GRU layer maintains a belief over the latent node type, paired with Lagrangian dual ascent that adapts the miss-rate penalty lambda automatically. A pairing-free homomorphic-MAC primitive supplies O(1) on-chain verification cost. Across 13 methods--four DQN variants, PPO, A2C, PPO-Lagrangian, a stateful Bayesian heuristic, three fixed-rule baselines, and an oracle-informed heuristic--DRQN-CMDP achieves a favourable balance: 83% lower gas than fixed high-frequency auditing, single-digit miss rate (7.5%), and moderate detection latency--a combination no other method matches across all three objectives simultaneously.
