Search papers, labs, and topics across Lattice.
Robot learning, embodied agents, manipulation, locomotion, and sim-to-real transfer with foundation models.
#13 of 70
5
VLM agents can achieve state-of-the-art robotic manipulation by treating failures as coding bugs, with contact precision, not reasoning, proving the primary bottleneck.
Explicitly grounding the goal object in view unlocks near-expert performance in object-goal navigation, revealing perception rather than policy as the key limitation.
Current VLA models fail at zero-shot robotic personalization, highlighting a critical gap in embodied AI's ability to adapt to user preferences.
Explicitly supervising physical state changes, not just language or latent representations, unlocks more robust VLA model generalization and real-world robotic control.
A 2.4B VLA model achieves state-of-the-art performance by integrating a novel register-based memory into its action expert, drastically reducing oscillations and improving real-world robotic task success.
Offline-trained neural networks are mathematically proven to diverge in closed-loop control, but bounded online adaptation offers a practical solution.
Real-world robot demonstrations can now be collected at 66 demos/hour by optimizing TAMP solution quality for behavior cloning.
A single adversarial token can bypass most safety filters.
Humanoid robots can now grasp and manipulate bulky objects using their entire bodies, achieving 90% success in complex repositioning tasks.
Learning to predict the visual consequences of actions significantly boosts policy performance and generalization, while simultaneously learning to generate actions sharpens world models.
Spatial intelligence tasks are solved 5.6x faster with zero accuracy loss by reframing them as classification problems, eliminating autoregressive decoding entirely.
Robot policies learn 4x faster by co-evolving their training environments with a critic that diagnoses and recreates failure modes.
GPT-6-Astra achieves unprecedented embodied intelligence performance, yet practical deployment faces significant hurdles in demonstration cost and physical constraints.
Humanoid robot control policies can be generated directly from their neural weights using diffusion models, unlocking new avenues for policy synthesis and understanding.
Driving models can achieve near-perfect performance with just one denoising step by learning to predict visual motion directly, outperforming multi-step prediction models and achieving 3.29x inference speed.
Agentic robots are no longer just predicting actions, but actively orchestrating their own learning and execution through goal-directed reasoning.
Sparse human guidance, covering less than 20% of interactions, is sufficient to dramatically improve real-world mobile manipulation performance by reshaping the critic's value landscape.
Decoupled Q-learning achieves state-of-the-art performance on continuous control by adaptively growing action grids, but surprisingly, the adaptive growth itself is not the key driver of success.
Learned representations on a hypersphere unlock closed-form planning and adaptive waypoint generation, enabling complex manipulation from scratch where baselines fail.
Robot policies can now adapt to unseen terrains and payloads in real-time, boosting performance by up to 80% without needing rewards or retraining.
Planetary landing controllers trained with adversarial disturbances uncover critical failure modes missed by standard randomization, suggesting a new paradigm for robust aerospace GNC.
Hyperbolic geometry enables RL agents to navigate complex mazes with 13x fewer parameters and 12x faster training than massive Euclidean networks, by aligning representation geometry with task demands.
Robot policies can now explicitly track and act upon physical time, unlocking robust performance in tasks requiring precise temporal reasoning and long-term memory.
Robot policies can achieve up to 16% better performance by dynamically morphing their parameters with context, rather than relying on fixed, shared weights.
A single robot world foundation model predicts dynamics and controls diverse robot bodies with top-tier accuracy and zero-shot generalization.
A lightweight latent world model directly conditions VLA action generation on predicted future consequences, boosting real-world robotic success rates from 38.3% to 73.3% without pixel-level video prediction.
Vision-language-action models can achieve superior performance and drastically reduced latency by leveraging reasoning supervision without explicitly conditioning actions on generated reasoning.
Fine-tune robot simulation physics with unprecedented interactive control, enabling AI agents to learn from real-world interactions and achieve accurate real-to-sim transfer.
Humanoid robots can now learn complex tasks from egocentric, multimodal human demonstrations thanks to a wearable observatory and a novel motion reconstruction pipeline that achieves state-of-the-art accuracy.
Robots can't truly improve themselves yet; current systems lack the crucial ability to recursively refine their own learning processes based on physical experience.
A single unified framework achieves state-of-the-art performance in both action-conditioned world modeling and real-world robotic manipulation by dynamically routing specialized experts.
A grid-based world model can achieve 89% out-of-view object recall and outperform a Kalman tracker in view, but a node-based approach offers drastically superior memory efficiency and robustness to unmodeled velocities.
Robot foundation models can now learn new tasks rapidly and retain old ones, slashing real-world training time by up to 68.5% without significant forgetting.
Even advanced LLMs fail 83% of the time on a novel 3D spatial reasoning benchmark, revealing a critical gap between 2D perception and precise 3D action control.
A novel "Predictive Intent" token bridges VLMs and VGMs for robot manipulation, unlocking superior out-of-distribution generalization without embodied pretraining.
Autonomous driving VLAs can achieve low-latency inference and SOTA planning by generating actions before CoT, with CoT solely supervising action generation.
Embodied agents improve on complex tasks by recombining learned skills, but their ability to extract value from additional experience saturates, failing to scale with learning samples.
Existing 3D asset generators can now produce objects that not only look good but also move and function realistically, passing physics tests for stability and collision-free articulation.
Innate robot reflexes, designed for solitary tasks, actively impede the evolution of effective communication strategies in social foraging.
One million parallel environments are insufficient without intelligent sampling: Success Guided Sampling unlocks mega-scale RL for robots by focusing training on the edge of learned capabilities.
Abstracting human demonstrations into scene graphs unlocks zero-shot generalization for dexterous manipulation policies, achieving 71% better performance on unseen tasks than imitation-heavy methods.
Frozen VLAs can recover from unseen actuator faults by inferring joint capabilities online, boosting success rates from 24.8% to 59.3% on 28 tasks.
Pretrained LLMs can drive complex robot navigation tasks across diverse environments and requests without any navigation-specific fine-tuning, by offloading motion execution to specialized tools.
Robot world models can now achieve 6.25% interaction defect rates, a 7-fold reduction, by training on counterfactual futures and a novel embodied video reward.
Robots can achieve 70% success on complex bimanual tasks using only code for decision-making, bypassing runtime vision-language models entirely.
Visual-native skill cards, directly accessible to VLMs, unlock a self-reinforcing loop of policy improvement and skill accumulation, drastically boosting sample efficiency.
A single filter can reduce unsafe motion generation by 90% by grounding safety rules in the generator's own reference trajectories, without retraining.
A single feedforward network learns to predict safety values and amortize minimal-intervention filtering, enabling safe RL in high-dimensional systems without analytical safety functions or competing policy objectives.
A reconstruction-free JEPA successfully disentangles invariant and variant latent factors, offering a path to robust world models without observational decoders.
Manual assembly instruction writing is now obsolete: LLMs can generate accurate, CAD-grounded procedures, preserving engineering details and passing automated checks.