Search papers, labs, and topics across Lattice.
This paper introduces DEUS, a novel framework for Open World Object Detection (OWOD) that improves unknown object detection and mitigates catastrophic forgetting. DEUS uses Equiangular Tight Frame (ETF)-Subspace Unknown Separation (EUS) to create orthogonal subspaces for known and unknown object representations, and an Energy-based Known Distinction (EKD) loss to minimize knowledge interference during memory replay. Experiments on OWOD benchmarks demonstrate that DEUS significantly improves unknown detection while maintaining competitive known class performance.
By separating known and unknown object representations into orthogonal subspaces, DEUS achieves state-of-the-art open world object detection, outperforming prior methods that struggle to learn distinct unknown object representations.
In this work, we tackle the problem of Open World Object Detection (OWOD). This challenging scenario requires the detector to incrementally learn to classify known objects without forgetting while identifying unknown objects without supervision. Previous OWOD methods have enhanced the unknown discovery process and employed memory replay to mitigate catastrophic forgetting. However, since existing methods heavily rely on the detector's known class predictions for detecting unknown objects, they struggle to effectively learn and recognize unknown object representations. Moreover, while memory replay mitigates forgetting of old classes, it often sacrifices the knowledge of newly learned classes. To resolve these limitations, we propose DEUS (Detecting Unknowns via energy-based Separation), a novel framework that addresses the challenges of Open World Object Detection. DEUS consists of Equiangular Tight Frame (ETF)-Subspace Unknown Separation (EUS) and an Energy-based Known Distinction (EKD) loss. EUS leverages ETF-based geometric properties to create orthogonal subspaces, enabling cleaner separation between known and unknown object representations. Unlike prior energy-based approaches that consider only the known space, EUS utilizes energies from both spaces to better capture distinct patterns of unknown objects. Furthermore, EKD loss enforces the separation between previous and current classifiers, thus minimizing knowledge interference between previous and newly learned classes during memory replay. We thoroughly validate DEUS on OWOD benchmarks, demonstrating outstanding performance improvements in unknown detection while maintaining competitive known class performance.
