Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
MEOW is a feed-forward model that jointly predicts metric pointmaps and relative poses from uncalibrated N-view image sets mixing perspective, fisheye, and $360^\circ$ panoramas in a single forward pass without requiring camera-type metadata. Rather than altering network architectures to handle heterogeneous projections, the framework retains a standard perspective-pretrained backbone and solves multi-camera reconstruction as a data-adaptation problem using a procedural engine with certified covisibility. Trained strictly on synthetic data, MEOW transfers zero-shot to real-world captures, achieving 79.9 mAA@30 on heterogeneous 2D3DS tuples compared to 53.8 for Wid3R, even though the baseline is explicitly provided ground-truth camera types.
Standard perspective backbones can solve feed-forward 3D reconstruction across arbitrary mixtures of uncalibrated perspective, fisheye, and 360° panoramas in a single pass, beating camera-conditioned baselines by over 26 mAA without any architectural redesign.
Real-world capture is heterogeneous: perspective, fisheye, and $360^\circ$ panoramic images can coexist within a single reconstruction task, yet most feed-forward 3D reconstruction models assume perspective imagery and a uniform input representation. Recent models handling several camera types are either informed of the camera type for each view or reconstruct one image pair at a time. No single-pass method reconstructs mixed-camera tuples containing full panoramas from images alone. We present MEOW, a feed-forward system that jointly reconstructs metric pointmaps and camera poses from one N-view tuple mixing perspective, fisheye and full-panorama images, in a single forward pass from images alone: no calibration, distortion parameters, camera-type labels or poses are supplied for any view. Our guiding design philosophy is to treat heterogeneous-camera reconstruction as a data-adaptation problem rather than an architectural redesign. MEOW retains a perspective-pretrained backbone and learns heterogeneous cameras entirely from a procedural data engine, which renders each scene across a continuous manifold of camera models with exact rays and depth, and certifies covisibility for every camera-sampled training tuple. Trained on synthetic tuples only, MEOW transfers zero-shot to real captures: on heterogeneous 2D3DS tuples it achieves 79.9 mAA@30 against 53.8 for Wid3R given the camera type of every view; on our laser-scanned mixed-camera benchmark it registers every four-view mixed tuple with 79.4 AUC@30. The data engine, benchmark, and complete evaluation pipeline will be released.