Search papers, labs, and topics across Lattice.
This paper introduces DiffPDE, a novel framework that utilizes masked diffusion language models for efficient synthesis of Partial Differential Equation (PDE) solvers, addressing the inefficiencies of autoregressive models in localizing and repairing code errors. By implementing a localized re-masking and infilling strategy, DiffPDE focuses on regenerating only erroneous regions, thereby enhancing the accuracy and speed of code repair. Additionally, the authors present Iterative Debugging GRPO (ID-GRPO), a reinforcement learning approach that facilitates multi-round debugging, demonstrating competitive performance on PDEBench compared to traditional autoregressive models.
DiffPDE achieves faster and more accurate PDE code repair by focusing only on localized errors, challenging the inefficiencies of existing autoregressive methods.
Existing approaches for synthesizing Partial Differential Equation (PDE) solvers predominantly rely on autoregressive models, yet their global left-to-right decoding incurs substantial redundancy when addressing inherently localized bugs. In this work, we challenge this inefficient paradigm and propose DiffPDE, a framework leveraging discrete diffusion language models for targeted code repair. By introducing a localized re-masking and infilling strategy, DiffPDE regenerates only erroneous regions while preserving correct context, naturally aligning generation with the sparse nature of PDE errors. Furthermore, to handle coupled bugs requiring sequential interventions, we present Iterative Debugging GRPO (ID-GRPO), a reinforcement learning scheme that enables multi-round debugging within single trajectories via intermediate rewards. Experiments on PDEBench show that DiffPDE achieves competitive accuracy, outperforms same-scale AR models, and significantly accelerates repair.
