Tai-Xi Chen

TLP enables vision-language models to adapt on-the-fly to missing modalities, achieving significant performance gains without needing access to original training data.

Learnable latent prompts can stabilize multimodal models and maintain performance even when up to 90% of input modalities are missing.