Search papers, labs, and topics across Lattice.
TuringViT introduces a novel approach to training state-of-the-art Vision Transformers (ViTs) that significantly reduces data requirements and enhances performance in various downstream tasks. By implementing Turing Linear Attention (TLA), VISTA-Curation for data generation, and dynamic-resolution pretraining, TuringViT achieves superior results compared to existing ViT models while using only 10% of the typical training data. This framework not only improves latency scaling for high-resolution inputs but also establishes a reproducible pipeline that democratizes access to advanced ViT technologies for the broader research community.
TuringViT outperforms leading ViT models with just 10% of the training data, making state-of-the-art vision technology accessible to a wider audience.
Modern VLMs and VLA systems commonly adopt off-the-shelf ViTs such as SigLIP2 as visual encoders, but diverse downstream requirements in latency, temporal modeling, and VLM integration often call for customized SOTA-level ViTs. Training such encoders remains beyond the reach of much of the community, as it requires massive image-text data, while standard softmax attention makes high-resolution or dynamic-resolution pretraining prohibitively costly and often forces low-resolution pretraining followed by post-hoc adaptation. TuringViT addresses these challenges with three key designs: Turing Linear Attention (TLA) for efficient sequence modeling, VISTA-Curation to construct supervision-rich image-video training data, and native dynamic-resolution pretraining that supports flexible inputs from the start and transfers seamlessly to downstream VLMs. As a result, TuringViT outperforms leading open-source ViT baselines with only 10% of the data, achieves stronger downstream VLM performance, and delivers substantially better latency scaling on high-resolution inputs. Our scaling-law analysis further shows that TuringViT continues to improve predictably with curated data scale, far from saturation. Its fast adaptation, hardware-friendly design, and efficient deployment have made it a unified visual foundation across XPeng's AI systems. More broadly, TuringViT provides a reproducible pipeline that dramatically lowers the cost for the community to train, customize, and deploy SOTA-level ViTs, moving toward making such Vision Transformers accessible to all.
