Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The fourth Perception Test challenge extended its videoQA benchmarks to city-scale walking-tour videos (KilometerAudio and KilometerVision), focusing on spatial intelligence. Winning solutions for these new tracks relied on costly agentic pipelines, indicating that while complex spatial and multimodal reasoning is achievable, standalone multimodal models struggle. This edition highlights the current limitations of direct multimodal reasoning on large-scale, complex environments.
City-scale audio-visual reasoning is currently dominated by expensive agentic pipelines, not standalone multimodal models.
Continuing the Perception Test challenge series, we organised the fourth edition as a workshop at the European Conference on Computer Vision (ECCV) 2026 in Malm\"o, Sweden. This edition focused on spatial intelligence and featured four different tracks: unified multiple-choice videoQA and grounded videoQA from the original Perception Test benchmark, alongside two new tracks based on city-scale walking-tour videos (KilometerAudio and KilometerVision). In this report, we describe the new benchmarks used for the city-scale tracks and summarise the winning solutions across all tracks, including a generalist model that competed across all tracks with satisfactory performance. The winning solutions in the newly added city-scale tracks demonstrated that complex spatial and multimodal reasoning can be solved by expensive agentic pipelines, but remains difficult for multimodal models used standalone.