Dongfang Han

Noise and distributional gaps in multimodal relation extraction can be effectively mitigated through uncertainty-guided techniques, leading to state-of-the-art performance.

A novel visual encoder is designed that aims to obtain summary-oriented visual features to help generate higher-quality summaries and introduces a minimum margin loss to suppress the overconfidence problem of the model when generating text during reasoning.