Search papers, labs, and topics across Lattice.
This paper introduces a model-agnostic framework called residual-space evolutionary optimization, which integrates flow-based generative editing with evolutionary algorithms to address the limitations of differentiable objectives in flow settings. By leveraging conditional flow matching (CFM) to disentangle condition-controlled factors from instance-specific residuals, the framework enables two distinct search regimes: self-pollination for local refinement and cross-pollination for broader exploration. The approach is validated on MorphoMNIST and crystal data, showing improved balance between target alignment, instance preservation, and diversity in generative tasks.
Evolving generative models in residual space reveals a powerful balance between local refinement and global exploration, enhancing data editing capabilities.
Data editing with generative methods typically requires differentiable objectives and gradient-based search. However, these assumptions break down in flow-based settings, where edits are performed through forward and backward integration and often involve non-differentiable or black-box objectives. We introduce residual-space evolutionary optimization, a model-agnostic framework that addresses this gap by combining flow-based generative editing with evolutionary algorithms. Building on the observation that conditional flow matching (CFM) can disentangle condition-controlled factors from instance-specific residuals, our framework directly operates in residual space and separates two complementary search regimes: self-pollination performs local exploitation through feature-preserving residual refinement, and cross-pollination promotes broader exploration by recombining residuals across heterogeneous samples. As a proof of concept, we validate on MorphoMNIST, a benchmark dataset for counterfactual generation, and on crystal data, demonstrating that this exploration--exploitation decomposition provides a useful mechanism for balancing target alignment, instance preservation, and diversity, and extends beyond images to real-world scientific domains.
