Search papers, labs, and topics across Lattice.
This paper introduces a vision-augmented system identification framework for autonomous racing that combines CNN-based friction priors with S4 models for capturing temporal dynamics. The CNN uses visual road textures to provide a "warm-start" for parameter optimization, while the S4 model captures dynamic residuals, improving upon the limitations of MLPs and RNNs. Results in CarSim demonstrate a 76.1% reduction in friction estimation error and a 60% decrease in lateral force RMSE compared to conventional methods.
Autonomous racecars can now learn tire dynamics 71% faster and with 60% higher accuracy by "seeing" the road surface and remembering past driving behavior.
Operating autonomous vehicles at the absolute limits of handling requires precise, real-time identification of highly non-linear tire dynamics. However, traditional online optimization methods suffer from "cold-start" initialization failures and struggle to model high-frequency transient dynamics. To address these bottlenecks, this paper proposes a novel vision-augmented, iterative system identification framework. First, a lightweight CNN (MobileNetV3) translates visual road textures into a continuous heuristic friction prior, providing a robust "warm-start" for parameter optimization. Next, a S4 model captures complex temporal dynamic residuals, circumventing the memory and latency limitations of traditional MLPs and RNNs. Finally, a derivative-free Nelder-Mead algorithm iteratively extracts physically interpretable Pacejka tire parameters via a hybrid virtual simulation. Co-simulation in CarSim demonstrates that the lightweight vision backbone reduces friction estimation error by 76.1 using 85 fewer FLOPs, accelerating cold-start convergence by 71.4. Furthermore, the S4-augmented framework improves parameter extraction accuracy and decreases lateral force RMSE by over 60 by effectively capturing complex vehicle dynamics, demonstrating superior performance compared to conventional neural architectures.
