Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To provide faithful, black-box spatial rationales without relying on internal weights or post-hoc text explanations, the authors construct AnswerMap by taking the outer product of a frozen VLM's query-conditioned yes/no posteriors over isolated 1D row and column image bands. Across four VLMs, AnswerMap substantially outperforms internal attention baselines in faithfulness, matching model pointing with an AUC of 0.85 (versus 0.38) and flipping 53% of correct answers under region deletion (versus 19%). Crucially, applying fixed read-out functions over the resulting spatial maps bypasses discrete text generation for continuous tasks, enabling zero-generation hallucination detection, robust localization, and a 50% error reduction via targeted cropping.
Black-box output posteriors across 1D image slices expose where VLMs actually look far more faithfully than internal attention—and can be read out directly to fix half of a model's visual reasoning errors.
When a VLM answers a visual query, current interpretability tools rely on text rationales, which use a mismatched modality, or on internal read-outs, which originate too early to reflect the final output and require white-box access to the model. We introduce AnswerMap, a training-free, task-agnostic, black-box visual rationale constructed from the output head. The image is cut into K row and K column bands, each shown alone to the frozen model along with the query in the format of a yes/no relevance question. The outer product of the row and column ``yes'' posteriors gives the query-conditioned spatial map. Crucially, by defining a fixed read-out R (e.g., expectation, maximum) on top of AnswerMap, we can derive continuous outputs like location natively. This bypasses the reliance on discrete text tokens for continuous-output tasks and guarantees an image-dependent answer by construction. However, a rationale can be confabulated, so we validate AnswerMap across four models and three query distributions with two tests: (a) agreement with the model's own generated point and (b) deletion of the map's region. The map lands where the model points (AUC 0.85 against 0.38 for attention), and deleting its region flips 53% of correct answers (against 19% for attention's). Beyond establishing faithfulness, we demonstrate the map's task-agnostic utility through three distinct read-outs: its maximum flags hallucinated objects without generation, its expectation localizes correctly when the model's own pointing fails, and its top-mass region, fed back as a crop, fixes half of the model's wrong answers. AnswerMap thus offers a new lens on VLM interpretability and, through its read-outs, a new output interface for visual tasks beyond text tokens.