Search papers, labs, and topics across Lattice.
49 papers published across 6 labs.
Omni-modal foundation models achieve self-improvement via RL compute scaled to 1M context, leveraging asynchronous training and agentic grading for enhanced intelligence.
LLMs can now understand and execute complex, semantic image edits from sparse drag inputs by inferring intended object-level transformations.
Heterogeneous diffusion models can be seamlessly stitched together, unlocking new capabilities by sharing a common latent language.
Generative representations need more than just semantic alignment; they require active exploitation, as shown by Representation Guidance outperforming larger models on ImageNet with a novel flow-matching target modification.
LVLMs can be trained to actively mentalize spatial scenes from novel viewpoints, boosting their reasoning accuracy by up to 20% on complex tasks.
LLMs can now understand and execute complex, semantic image edits from sparse drag inputs by inferring intended object-level transformations.
Heterogeneous diffusion models can be seamlessly stitched together, unlocking new capabilities by sharing a common latent language.
Generative representations need more than just semantic alignment; they require active exploitation, as shown by Representation Guidance outperforming larger models on ImageNet with a novel flow-matching target modification.
LVLMs can be trained to actively mentalize spatial scenes from novel viewpoints, boosting their reasoning accuracy by up to 20% on complex tasks.
MLLMs possess an intrinsic "S-Space" that acts as a spatial workspace, encoding object coordinates and enabling viewpoint transformations, even under non-spatial queries.
Abstracting human demonstrations into scene graphs unlocks zero-shot generalization for dexterous manipulation policies, achieving 71% better performance on unseen tasks than imitation-heavy methods.
Frozen VLAs can recover from unseen actuator faults by inferring joint capabilities online, boosting success rates from 24.8% to 59.3% on 28 tasks.
Pretrained LLMs can drive complex robot navigation tasks across diverse environments and requests without any navigation-specific fine-tuning, by offloading motion execution to specialized tools.
Explicit 3D geometry, rendered as text, unlocks superior spatial reasoning in RGB-only VLMs by guiding trajectory correction during distillation.
Fine-grained 3D object generation is now possible by directly controlling local geometry and appearance with text and shape primitives, bypassing the need for model retraining.
Robot world models can now achieve 6.25% interaction defect rates, a 7-fold reduction, by training on counterfactual futures and a novel embodied video reward.
Even the best vision-language models struggle with predictive spatial reasoning, scoring less than 60% on a new benchmark designed to test anticipating unseen outcomes.
Direct 2D spatial composition with four binding types unlocks unprecedented controllability in poster generation, outperforming prompt-based methods.
Visual-native skill cards, directly accessible to VLMs, unlock a self-reinforcing loop of policy improvement and skill accumulation, drastically boosting sample efficiency.
Irrelevant text distractors cripple mixed-modality retrieval performance more than images, revealing a text modality preference that degrades performance in a V-shaped curve.
Visual transition reasoning, not just diverse data, unlocks significant multimodal LLM improvements, with just 2,000 examples boosting 22 benchmarks.
Even state-of-the-art LMMs struggle with reasoning-informed visual editing, with the best model only achieving 56.6% accuracy on a new comprehensive benchmark.
Ambiguous object selection in text-guided image editing is solved by directly annotating the canvas, achieving state-of-the-art performance in complex edits.
City-scale audio-visual reasoning is currently dominated by expensive agentic pipelines, not standalone multimodal models.
Contextual contamination in few-shot vision-language learning is mitigated by a novel semantic purification and reinforcement-learning gating mechanism, unlocking superior performance.
Egocentric video generation can be achieved by a learned transformer that probabilistically synthesizes novel views, outperforming explicit depth-based reconstruction pipelines.
Casual images are now enough to generate high-fidelity, scene-aligned 3D objects with accurate pose, even from sparse observations.
Omni-modal foundation models achieve self-improvement via RL compute scaled to 1M context, leveraging asynchronous training and agentic grading for enhanced intelligence.
Static 3D worlds now possess vivid, looping motion, seamlessly transitioning from any viewpoint without explicit motion capture.
Synergistic multimodal information, previously elusive, is unlocked by modeling higher-order statistical dependencies via tensor decomposition.
A single forecasting backbone unifies multivariate and multimodal time series, outperforming 16 SOTA models by disentangling media identity and mastering temporal scales.
Most 3D foundation models struggle to accurately estimate absolute metric distances, a fundamental capability overlooked by existing benchmarks.
Frontier MLLMs exhibit strong local perception but falter on long-horizon audio-visual reasoning, with a single benchmark exposing specific failure modes like identity drift and cross-modal misalignment.
Identity-preserving dense correspondence is now achievable across arbitrary image transformations, even those breaking physical continuity, by leveraging foundation models and multi-source supervision.
A unified multimodal agent, OneSearch-VL, achieves state-of-the-art performance on diverse visual research tasks by explicitly modeling and preserving interdependencies within a Visually Grounded Evidence Graph.
Complex-valued fusion of audio-visual embeddings unlocks significant gains in open-vocabulary event localization, surpassing prior methods by up to 6.6% Event-F1.
Realistic human-object interactions in complex 3D scenes are now achievable by decoupling scene feasibility from motion synthesis, leveraging separate supervision signals.
Achieve state-of-the-art image generation quality at a fraction of the compute cost by dynamically adapting tokenization to visual complexity.
Even state-of-the-art MLLMs struggle to grasp the nuanced data interpretation and narrative coherence required for data videos, with significant performance gaps in causal reasoning and narrative structure.
Decouple complex audio scenes into individual, controllable sound sources directly from a single generative model.
Current image generation models struggle with rendering dense, multi-region text, with fidelity dropping by over 14 points when clarity is prioritized.
A quadtree visual tokenizer slashes token count for autoregressive image generation by adaptively focusing representational power on intricate image regions.
Stored patch vectors from visual document retrieval systems can be inverted to reconstruct original pages, revealing sensitive information and enabling source page identification with high accuracy.
A single-word instruction change can tank VLA performance by 98%, but a simple LLM-based rephrasing pipeline boosts success by up to 27% without retraining.
Current multimodal agents can build sophisticated perception-control pipelines but fail to reliably execute physical tasks, losing object states and mistaking unfinished goals for completion.
Generating 3D scenes where objects not only look plausible but also physically fit together, even when interactions are hidden.
A 300K-sample dataset and diagnostic benchmark unlock the challenging task of generating product-preserving, narrative-driven advertisement videos.
Fingertip touch dynamics, not just vision, unlock a 10.5% boost in dexterous robotic grasp success.
Frontier multimodal agents struggle to autonomously acquire and utilize task-relevant information in unfamiliar physical environments, failing 77% of the time on a new exploration benchmark.
Embodied agents can now remember objects they never touched by tracking their resting locations and inferring moves from repeated evidence, boosting downstream task accuracy by over 10%.
A single 500-hour visual-tactile dataset boosts zero-shot contact prediction from 13% to 38% IoU and quadruples robot manipulation success rates, proving scale and consistency are paramount for embodied learning.
Interactive video generation systems can now robustly handle latent dependencies by transforming unstructured inputs into executable constraints, achieving a 10.3-point average improvement.
A single generative model recovers temporally consistent 3D hand motion from video by jointly learning 2D-3D pose dynamics, bypassing unreliable per-frame estimates.
Sparse video reasoning can outperform dense observation models by learning to extract crucial temporal evidence from limited frames, even without explicit VQA annotations.
