Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
REKI, a 2.4B VLA model, achieves a new Pareto frontier by outperforming larger models on benchmarks like LIBERO-Plus, RoboTwin, and RoboCasa365. It integrates a VLM with a flow-matching action expert and a novel memory mechanism using register tokens to summarize past VLM outputs, significantly improving success rates and reducing oscillations in simulation and on real robots. The model prioritizes efficiency in training and inference, with open-source code and weights provided.
A 2.4B VLA model achieves state-of-the-art performance by integrating a novel register-based memory into its action expert, drastically reducing oscillations and improving real-world robotic task success.
We introduce REKI, a 2.4B vision-language-action model (VLA) pretrained exclusively on public data that sets a new Pareto frontier between performance and model size: on LIBERO-Plus, RoboTwin Clean2Rand and RoboCasa365, it is outperformed only by models about twice its size. REKI consists of a vision-language model (VLM) followed by a flow-matching action expert, and is pretrained on a curated mixture of public robot, egocentric human and vision-language data. Additionally, we endow it with a memory that gives the policy access to its recent past at negligible cost: a few register tokens in the action expert summarise the output of the VLM at each frame and persist in the expert's cache. This memory improves success in simulation and on real robots, and makes oscillations between poses about four times rarer. REKI uses a simple model design and training paradigm, and is optimised to be efficient at training and inference. We release the full code across data curation, training, inference and evaluation, deployment, and all pretrained and finetuned model weights: https://github.com/kyutai-labs/reki.