Search papers, labs, and topics across Lattice.
The paper introduces GenSR, a symbolic regression framework that uses a conditional variational autoencoder (CVAE) to map symbolic equations into a continuous, generative latent space. This latent space is designed to exhibit symbolic continuity and local numerical smoothness, allowing for gradient-based search. GenSR then uses a modified CMA-ES algorithm to refine candidate equations within this latent space, effectively maximizing the conditional probability of equations given numerical data. Experiments demonstrate that GenSR achieves a balance between accuracy, simplicity, and efficiency, while also demonstrating robustness to noise.
By mapping symbolic equations into a continuous latent space, GenSR enables gradient-based optimization for symbolic regression, sidestepping the noisy feedback that plagues discrete search methods.
Symbolic Regression (SR) tries to reveal the hidden equations behind observed data. However, most methods search within a discrete equation space, where the structural modifications of equations rarely align with their numerical behavior, leaving fitting error feedback too noisy to guide exploration. To address this challenge, we propose GenSR, a generative latent space-based SR framework following the `map construction -> coarse localization -> fine search'' paradigm. Specifically, GenSR first pretrains a dual-branch Conditional Variational Autoencoder (CVAE) to reparameterize symbolic equations into a generative latent space with symbolic continuity and local numerical smoothness. This space can be regarded as a well-structured `map'' of the equation space, providing directional signals for search. At inference, the CVAE coarsely localizes the input data to promising regions in the latent space. Then, a modified CMA-ES refines the candidate region, leveraging smooth latent gradients. From a Bayesian perspective, GenSR reframes the SR task as maximizing the conditional distribution $p(\mathrm{Equ.} \mid \mathrm{Num.})$, with CVAE training achieving this objective through the Evidence Lower Bound (ELBO). This new perspective provides a theoretical guarantee for the effectiveness of GenSR. Extensive experiments show that GenSR jointly optimizes predictive accuracy, expression simplicity, and computational efficiency, while remaining robust under noise.
