Search papers, labs, and topics across Lattice.
26
0
17
5
A groundbreaking pipeline has generated over 8,000 hours of action-conditioned video, overcoming the limitations of real-world data collection.
Overcoming the 2D-to-4D spatial bottleneck in VLMs does not require native 3D architectures; factorizing visual projections into verifiable planar, depth, and temporal RL objectives delivers immediate 4-6% benchmark gains.
Scaling from 120,000 hours of egocentric video boosts robotic manipulation success rates from 36.1% to 77.8% in zero-shot evaluations.
TailSieve achieves up to 2.59x speedup in LLM rollouts by intelligently routing long-tail requests, transforming how we handle high-concurrency decoding.
Achieving top performance in long-horizon audio-visual generation, JoyAI-Echo-1.5 sets a new standard for coherent storytelling and interactive environments.
Achieving synchronized audio-visual generation and trajectory control, EchoWM sets a new standard for immersive media experiences in generative models.
JoyAI-Video-Edit achieves real-time video editing at 30 FPS while maintaining high fidelity and temporal consistency, outperforming traditional streaming editors.
Oxygen-TryOn achieves unprecedented realism in virtual try-on by synthesizing images across diverse fashion categories, outperforming both proprietary and open-source models.
Fine-grained hallucination diagnosis can dramatically enhance the reliability of multimodal language models by revealing the types of hallucinations they produce and how to correct them.
Spatial reasoning hallucinations in MLLMs can be drastically reduced by integrating geometric evidence, challenging the effectiveness of traditional mitigation methods.
SGF bridges the gap in video generation by allowing future losses to inform past latent encodings, resulting in unprecedented long-video extrapolation capabilities.
KAT-Coder-V2.5 outperforms existing models in agentic tool-use, showcasing a new paradigm for autonomous coding agents within executable environments.
Reducing sampling steps from 50 to just 8 without sacrificing quality could revolutionize how we approach generative modeling.
DiT-Reward not only outperforms existing models in image evaluation but also accelerates inference by 1.65x without sacrificing quality.
Human raters overwhelmingly prefer JoyAI-VL-Interaction over existing video-call assistants, showcasing a leap in real-time interaction capabilities.
AnchorEdit achieves state-of-the-art performance in multi-turn image editing by maintaining subject identity across 10+ interactions, revolutionizing iterative design workflows.
Raw context outperforms compact memory designs, revealing that memory structure is crucial for effective video generation in action-conditioned models.
Despite the advancements in multimodal agents, even the best models struggle with interactive spatial reasoning, achieving only a 17.4% success rate in complex real-world tasks.
Ultra Flash achieves real-time high-resolution video generation at unprecedented frame rates, pushing the boundaries of what鈥檚 possible in streaming video AI.
Real-time infinite video generation is now feasible, achieving over 1.3 million frames in a single 24-hour rollout without sacrificing quality.
Bidirectional interaction between enhanced understanding, controllable spatial editing, and novel-view-assisted reasoning enables a unified multimodal model to achieve spatial intelligence beyond general visual competence.
Unlock the full potential of your pretrained video diffusion models with a surprisingly simple four-stage post-training framework that drastically improves visual quality, temporal coherence, and instruction following.
Bridging the gap between human manipulation and robotic control, JoyAI-RA unlocks enhanced cross-embodiment behavior learning through multi-source pretraining.
Spatial reasoning gets a major boost: OpenSpatial-3M, a new dataset, enables models to leapfrog existing benchmarks by 19%.
Existing image editing models fall short when it comes to precise spatial manipulations, but a new benchmark and dataset reveal the path to closing the gap.
Achieve real-time, synchronized audio-visual generation at 25 FPS by distilling a bidirectional diffusion model into a fast, autoregressive architecture, overcoming training instability with novel alignment and token handling techniques.