Search papers, labs, and topics across Lattice.
Affiliation:
2
0
6
1
Temporal reasoning benchmarks for Video-LLMs are often mediated by language, leaving room for linguistic shortcuts from option wording, answer correlations, or language priors, so TempCloze is introduced, a video cloze benchmark for evaluating visual temporal reasoning in Video-LLMs.
NL2SQL evaluation has a new champion: ROSE, an intent-centered metric that aligns 24% better with human judgment than existing metrics.