Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper investigates the ability of conditional generative models, specifically flow-matching models, to predict unseen scientific interactions by evaluating their performance across diverse simulated and real-world datasets. The study reveals that these models often hallucinate non-additive interaction effects, learning individual effects significantly earlier than interactions and failing to generalize when condition structure deviates between observed and unseen targets. Consequently, aggregate fidelity metrics can mask the models' inability to accurately recover and extrapolate crucial interaction dynamics.
Conditional flow models frequently hallucinate non-additive scientific interactions, even when overall prediction accuracy appears high.
Conditional generative models are increasingly used for scientific prediction beyond the direct training support. Yet scientific questions often concern whether one intervention changes the effect of another. Such interactions can be of primary interest while explaining little of the total variation, allowing models to appear accurate overall without recovering the relevant scientific effect. It remains unclear how these models learn interactions and when these successfully extrapolate to unseen conditions. We therefore study interaction recovery in flow-matching models using a physiological time-series simulator, drug dose-response data, combinatorial cell perturbations, and molecular conformer generations, where we separate recovery from hallucinated interaction structure. In the controlled setting, individual effects are learned much earlier than interactions and models hallucinate interactions where none exist. Across settings, we find qualitatively different generalization problems, with successful prediction depending on whether condition structure continues from observed to held-out targets. When it does, interactions are recoverable. If not, models can generate plausible responses while missing the interaction. We furthermore find that hallucinations increase as targets become less identifiable, and that successful interaction recovery in output space can fail under nonlinear readouts. Finally, we show that aggregate fidelity metrics can conceal whether models learn and extrapolate interactions.