Yujun Wang

Missing sensory streams typically break audiovisual tracking, but routing audio, face, and mouth inputs through modality-agnostic query attention shatters previous active speaker detection records across five benchmarks by up to 5.1 mAP.

Internal visual modality entropy can serve as a reliable self-evaluation metric for action generation in heterogeneous VLA architectures, outperforming traditional methods.