William Chen

Instruction following learned in one modality transfers zero-shot to cross-modal editing tasks, enabling rich AV movie scene edits without paired training data.

LACE (Layer-Adaptive Codec Encoding), a dynamic frame rate codec that applies an independent compression step at each quantization layer, enabling layer-specific segmentation boundaries, is proposed.

Automatic music transcription models struggle with pop music, as evidenced by a mere 38% Onset F1 score on the new MulTTiPop dataset.