Search papers, labs, and topics across Lattice.
This paper formalizes the concept of the time value of evolution within a finite-horizon Markov decision process, highlighting how immediate-return control can overlook the long-term benefits of weaker offspring. The authors introduce Lineage-Value Policy Gradients (LVPG), an innovative actor-critic framework that separates search control into specialized policy heads to optimize mutation strategies over a longer horizon. Their experiments demonstrate that LVPG significantly enhances search efficiency, yielding a 0.394 Sharpe unit increase in validation best-so-far AUC while reducing temporary regressions compared to traditional immediate-return optimization methods.
Long-horizon credit assignment can boost search efficiency in evolutionary algorithms, leading to stronger policies and fewer regressions.
In evolutionary search, a weak child can be a valuable ancestor that makes high-fitness regions reachable. Immediate-return control is blind to this delayed utility, penalizing mutations through their immediate offspring even when they open productive future lineages. We formalize this hidden dynamic as the time value of evolution within a finite-horizon Markov decision process. To exploit it, we introduce Lineage-Value Policy Gradients (LVPG), a long-horizon actor-critic framework for automated trading policy discovery. Our architecture decouples search control into specialized policy heads over a shared generative backbone: a bootstrapped critic head estimates the value of finite-horizon lineage potential from multi-step mutation trees, while an actor head dynamically modulates mutation intensity over the remaining search budget. We isolate the impact of long-horizon credit assignment against immediate-return optimization across 90 paired runs under matched operators, lineage supervision, folds, seeds, and budgets. Path-based credit assignment substantially accelerates finite-budget search, increasing validation best-so-far AUC by 0.394 Sharpe units. LVPG also produces fewer temporary regressions than immediate-return optimization and recovers from them more often. Finite-horizon lineage value yields more selective non-monotonic search and stronger policies within identical resource constraints.
