Search papers, labs, and topics across Lattice.
This paper introduces TimeSynth, a benchmarking framework designed to evaluate the temporal fidelity of health-signal digital twins by focusing on oscillatory dynamics, phase accuracy, and state transitions. The authors reveal that traditional pointwise metrics can misrepresent model performance, with discrepancies in phase accuracy reaching up to 53掳 among models with similar pointwise errors. By demonstrating that architectural choices significantly impact fidelity, the study emphasizes the need for a principled approach to model selection based on specific use cases rather than a one-size-fits-all winner.
Models may appear comparable in accuracy, but TimeSynth reveals that phase and frequency fidelity can diverge significantly, impacting health signal forecasting.
Forecasting models for health-signal digital twins must preserve the oscillatory, frequency, phase, and state-transition dynamics of physiological signals, yet the pointwise metrics used to benchmark them cannot detect when these fundamental properties are lost. We show that this blind spot misranks models: across 11 architectures, models with comparable pointwise error diverge by up to 53掳 in phase accuracy, equivalent to roughly 123 ms for a 1.2 Hz cardiac rhythm and invisible to standard metrics. To enable development of models that escape such failures, we introduce TimeSynth, a controlled benchmarking framework with two reusable components: a physiologically grounded generator producing signals with analytically known ground-truth dynamics from parametric models fitted to real electroencephalography, electrocardiography and photoplethysmogram signals, along with diagnostics quantifying amplitude, frequency, phase, and state-transition fidelity. Linear and full-sequence attention models systematically lose frequency and phase information despite acceptable amplitude error, whereas architectures with localized temporal structure better preserve dynamical fidelity and adapt to observable state transitions; none, however, reliably preserves stochastic switching. Because the dominant determinant of fidelity is architectural, model choice becomes a principled, use-case-driven decision rather than a search for a single winner. TimeSynth thus supplies the controlled preclinical stress test missing before models are coupled to patient data, with a reusable generator and diagnostics for fidelity-aware development.