Search papers, labs, and topics across Lattice.
This paper introduces MResOpt, a novel staged residual neural network architecture designed specifically for constrained optimization problems, which enhances constraint satisfaction through a structured approach that prioritizes high-priority constraints. By leveraging domain-informed ordered constraint satisfaction and intermediate re-completion, MResOpt demonstrates significant improvements in constraint handling on various benchmarks, including quadratic programming and optimal power flow scenarios. Notably, the architecture achieves lower high-priority constraint violations while maintaining computational efficiency compared to traditional methods, particularly in complex non-convex settings.
MResOpt achieves significantly lower high-priority constraint violations in constrained optimization tasks while remaining computationally efficient, revolutionizing how we approach complex optimization problems.
We propose MResOpt, a staged residual neural network architecture for constrained optimization problems. Our architecture fits within predict-complete-correct pipelines and decomposes constraint satisfaction by priority through intermediate re-completion and stage-aware losses. The framework enables domain-informed ordered constraint satisfaction which allows the network to utilize ordinal structure when present. Under an idealized infinite-width regime, we show that our design behaves as sequential Gaussian Process regression. On synthetic QP, QCQP, and SOCP benchmarks, the staged architecture improves high-priority constraint satisfaction across convex and non-convex settings. On line-flow-constrained AC optimal power flow, we introduce a physics-motivated constraint ordering and show that MResOpt supports a learned division of labor that keeps iterates on the equality manifold, achieving substantially lower high-priority violation than reprojected baselines while remaining computationally efficient.
Google Research