Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors investigate task-aware neural compression where the primary objective is reconstruction and the secondary objective is downstream classification under domain shift. They discover that perceptual distribution-matching constraints naturally emerge from this multi-task objective rather than needing to be handcrafted as explicit regularizers. Most notably, they prove that when downstream classifier decision boundaries are ill-defined for the source distribution, steering the reconstruction distribution toward a target domain simultaneously minimizes bit-rate and boosts classification accuracy.
Downstream classifier accuracy can actually improve when neural compressors intentionally distort reconstruction distributions away from mismatched source domains toward a target distribution.
With the recent advancements of neural compressors, explicitly incorporating perception constraints into the design of compression schemes has gained significant attention. Traditionally, these perception constraints ensure that the distribution of the reconstruction does not significantly deviate from the distribution of the source, thus attesting to the perceptual quality of the reconstruction. In this work, we uncover several perception constraints that are naturally present in task-aware compression. In particular, we consider a problem where the primary task is reconstruction and the secondary task is classification (i.e., a statistical test). We study this problem at varying levels of domain information available to us and discuss how to utilize the naturally emerging perception constraints to design rate-minimal compression schemes that also maximize the utility of our secondary task. We show that in this setting, if the decision boundaries of the classifier are ill-defined (mismatch) for our source distribution, then matching onto a target distribution enhances our classification accuracy.