Search papers, labs, and topics across Lattice.
This study introduces a closed-loop evaluation framework for assessing the impact of compression techniques on learned driving policies, specifically focusing on structured pruning, knowledge distillation, and quantization. By modeling the driving task as a partially observable Markov decision process (POMDP) and employing proximal policy optimization (PPO) in a simulated environment, the authors systematically analyze how each compression stage affects driving capabilities. The findings reveal that structured pruning is the initial point of capability loss, while distillation can enhance performance, albeit constrained by rehearsal data, and that integer quantization can hinder specific driving tasks, highlighting the importance of careful evaluation in policy deployment.
Structured pruning is the first stage where driving capabilities degrade, challenging the effectiveness of standard compression techniques in automated driving.
Many automobile and mobility companies deploy learned driving policies on embedded computers with limited memory and power. Pruning, knowledge distillation, and quantization are the standard methods to reduce the size and the inference cost of these policies. However, these methods are commonly assessed by aggregate numerical scores, and such scores may not reflect the ability of the policy to drive safely when interacting with other road users. In this study, we propose a stage-wise closed-loop evaluation approach to follow a driving policy through a compression pipeline. We formulate the driving task as a partially observable Markov decision process (POMDP) and train a belief-state policy with proximal policy optimization (PPO) in Gym-Duckietown. We then extract the actor, compress it one stage at a time, and evaluate it on five driving curricula. We show that structured pruning is the stage at which the driving capability is first lost. Meanwhile, distillation improves the pruned actor, but the improvement is limited by its rehearsal data. Integer quantization of the improved actor loses some of the curricula that require the vehicle to stop and then resume. Interestingly, the same procedure on the unpruned actor preserves all five curricula. Our study thus provides an empirical analysis aiming to answer the currently active discussions on how to accept a compressed driving policy, so as to achieve a safe and statistically reliable deployment of automated driving functions.
