Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces SemProbe, a tool for evaluating the semantic robustness of object detectors in safety-critical applications. SemProbe uses diffusion-based controlled inpainting to generate semantically meaningful probes based on user-defined masks and operational design domain factors. By automatically running model inference and displaying performance deltas before and after inpainting, SemProbe facilitates traceable robustness evidence aligned with safety evaluation workflows.
Find out how diffusion-based inpainting can expose critical vulnerabilities in object detectors that pixel-level corruptions miss, especially in safety-critical scenarios.
Testing object detectors in safety-critical domains requires semantically meaningful probes beyond pixel-level corruptions. We present SemProbe, a tool for semantic robustness probing: users upload deployment images, create masks manually or automatically, select operational design domain-derived factors (or custom prompts), and run diffusion-based controlled inpainting. The system supports batch jobs, parallel seed/workflow variations, and configurable generation parameters. After each output, model inference runs automatically and displays annotated before/after comparisons with performance deltas. All probes are logged as structured artifacts, enabling traceable robustness evidence aligned with safety evaluation workflows. We demonstrate \textsc{SemProbe} on hand detection for dimension saws, targeting factors from insurance-oriented test criteria.