Search papers, labs, and topics across Lattice.
The paper introduces HDRAgent, an innovative agent-driven framework for multi-exposure HDR imaging that adapts reconstruction strategies based on dynamic scene conditions, addressing the common issue of ghosting artifacts. By integrating a fine-grained contextual knowledge matching (FCM) module and a perception-distortion feedback mechanism, HDRAgent enhances scene-specific prior knowledge and refines strategy selection through accumulated historical feedback. Experimental results show that HDRAgent significantly reduces ghosting and local artifacts while maintaining or improving visual quality compared to traditional methods.
Ghosting artifacts in HDR imaging are dramatically reduced by an adaptive, agent-driven framework that learns from past experiences and scene dynamics.
Most existing multi-exposure HDR methods follow a fixed feed-forward reconstruction paradigm, making them prone to ghosting artifacts in complex dynamic scenes. To address this issue, we propose HDRAgent, the first agent-driven framework for HDR imaging, which adaptively selects reconstruction strategies according to the current scene conditions. Specifically, to provide scene-specific prior knowledge, we introduce a fine-grained contextual knowledge matching (FCM) module. This module leverages multimodal large language model (MLLM)-derived scene perception to retrieve relevant historical cases and tool knowledge, organizing them into structured evidence for MLLM-based adaptive tool scheduling. In addition, we propose a perception--distortion feedback mechanism that transforms post-execution quality assessment and artifact diagnosis into structured feedback, which is accumulated in historical memory to help subsequent contextual knowledge refinement and strategy selection. Furthermore, considering that extreme motion can invalidate alignment methods, we design an agent-guided generative alignment strategy that uses MLLM-based dynamic-region parsing to reconstruct unreliable contents in non-reference frames under reference-frame guidance. Experiments demonstrate that HDRAgent effectively reduces ghosting and local artifacts while achieving competitive or superior objective performance and visual quality.
