Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores a novel approach to active flow control by employing coding agents to directly search for explicit executable feedback laws, rather than optimizing neural-network parameters through deep reinforcement learning (DRL). The authors introduce a constrained heuristic-learning protocol that iteratively proposes and evaluates controller implementations, achieving competitive performance across 13 benchmarks while maintaining interpretability. The results show that the heuristic controllers not only match or exceed the best DRL policies in 10 out of 13 environments but also reveal physically meaningful feedback mechanisms, enhancing their applicability across various configurations.
Heuristic learning with coding agents outperforms traditional DRL in active flow control while providing interpretable and physically meaningful feedback mechanisms.
Active flow control involves nonlinear dynamics, partial observations, and computationally expensive simulations, making controller design particularly challenging. Deep reinforcement learning (DRL) has emerged as a powerful framework for such problems, but its success typically relies on large numbers of simulator interactions and produces neural-network policies whose decision process often remains difficult to interpret. In this work, we investigate a different paradigm: instead of optimizing neural-network parameters, we use modern coding agents to search directly for explicit executable feedback laws. We introduce a constrained heuristic-learning protocol in which an agent iteratively proposes, evaluates, and revises controller implementations while interacting exclusively through the public benchmark interface. The proposed framework is evaluated on 13 active flow-control benchmarks spanning one, two, and three-dimensional problems and compared against the strongest available DRL baselines under identical simulation budgets. The discovered heuristic controllers match or outperform the best DRL policy in 10 of the 13 environments while remaining compact, interpretable, and directly inspectable. Beyond aggregate performance, the resulting controllers reveal physically meaningful feedback mechanisms, transfer successfully across more challenging configurations, and remain competitive under varying Reynolds and Rayleigh numbers, actuator counts, and observation sparsity. These results suggest that heuristic learning through coding agents constitutes a credible and complementary alternative to conventional reinforcement learning, combining competitive performance with physically interpretable controller representations. Prompts and source code are available at https://github.com/DonsetPG/fluid-heuristic-learning.