Search papers, labs, and topics across Lattice.
TIDES introduces a continuous-time event simulation framework that leverages dynamic Gaussian splatting to accurately predict event timestamps without the limitations of traditional frame-based methods. By utilizing an explicit 3D scene representation, TIDES effectively derives per-pixel intensity dynamics and adapts time stepping based on occlusion, enhancing simulation fidelity. The results demonstrate that TIDES achieves state-of-the-art performance in event-stream fidelity and shows superior transferability to real-world tasks compared to existing simulators.
TIDES achieves unprecedented event-stream fidelity by simulating events in continuous time, overcoming the limitations of traditional timestamp batching.
Event cameras emit asynchronous events in response to environmental appearance changes. The scarcity of real-world event datasets makes simulation essential. However, most simulators infer event timestamps from frame sequences, forcing many threshold crossings to share a small set of discrete times; a failure mode we term timestamp batching that worsens under fast motion and occlusion. We present TIDES, a continuous-time event simulator built on dynamic Gaussian splatting. Because TIDES operates on an explicit 3D scene representation with learnt geometry and motion, it can derive per-pixel intensity dynamics directly from the scene, rather than by differencing rendered frames. This enables accurate threshold-crossing prediction, including multiple crossings per rendering step, without temporal upsampling or frame interpolation. The same 3D scene model reveals where objects partially occlude one another; TIDES uses this to guide adaptive time stepping, concentrating computation only in regions where occlusion dynamics make simple models of brightness change unreliable. Finally, we model finite sensor bandwidth using a tile-level arbiter whose throughput, jitter, and event drops reproduce realistic sensor artifacts. Across paired RGB-event benchmarks, TIDES attains state-of-the-art event-stream fidelity. We also show that events simulated by TIDES transfer more effectively to real downstream tasks than competitors'.
