Search papers, labs, and topics across Lattice.
This paper introduces AnomNOVIC, a two-stage framework that integrates a masked autoencoder (MAE) for anomaly detection with a prompt-free open vocabulary image classifier, NOVIC, enabling robots to recognize previously unseen objects in real-world environments. The system generates object-agnostic bounding boxes that allow for efficient classification of salient image regions without relying on a predefined class list. Evaluations show that AnomNOVIC outperforms existing open vocabulary baselines, achieving up to 82.6% accuracy in prompt-free detection and classification across diverse datasets, including a challenging in-the-wild test set.
AnomNOVIC achieves up to 82.6% accuracy in recognizing unseen objects without prompts, setting a new standard for open vocabulary anomaly detection in robotics.
Robots operating in real-world environments must in general be able to recognize previously unseen objects. As robotic systems move toward open-world autonomy, there is a growing, yet largely unmet, need for open vocabulary object detectors that are prompt-free and efficient enough for continuous deployment. We present AnomNOVIC, a two-stage known-workspace framework that combines a masked autoencoder (MAE) trained for anomaly detection, with NOVIC, a powerful real-time prompt-free open vocabulary image classifier. The MAE produces generic object-agnostic bounding boxes, allowing NOVIC to classify salient image regions without requiring a predefined candidate class list. We evaluate AnomNOVIC against strong open vocabulary baselines in a tabletop robot-object environment featuring the NICOL humanoid robot, reaching 47.1% AP / 57.5% AP50 for prompt-free recognition, and 59.0% AP / 72.5% AP50 if class candidates are provided. Across additional datasets, including an in-the-wild test set with 48 unique objects, AnomNOVIC reaches up to 82.6% prompt-free detection and classification accuracy. These results significantly surpass all tested open vocabulary baselines, including YOLO-World-v2, OWLv2, and YOLOE.
