Wen Huang

Watching physical scenes change over time turns out to be an ideal supervisory signal for static visual features, allowing an independently encoded frame supervised across signed temporal intervals to excel at both single-image and multi-frame downstream tasks.

LALMs face significant challenges in audio comprehension, especially in extracting relevant facts from lengthy signals, with performance deteriorating as audio duration increases.