Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
DVLA-RL++ enhances few-shot vision-language learning by introducing complementary semantic purification (CSP) to disentangle intrinsic object properties from incidental context, and counterfactual reinforcement-learning gating (CRG) to dynamically control semantic fusion. CSP utilizes ambiguity-dependent rejection margins and intrinsic semantic anchors to refine support prototypes, while CRG learns optimal layer-wise fusion strengths via a reward balancing recognition and nuisance exposure. This dual-level alignment achieves state-of-the-art accuracy across diverse benchmarks, outperforming its predecessor DVLA-RL by an average of 1.4%.
Contextual contamination in few-shot vision-language learning is mitigated by a novel semantic purification and reinforcement-learning gating mechanism, unlocking superior performance.
Few-shot learning aims to recognize novel categories from limited labeled examples. Recent studies incorporate textual semantics to compensate for limited visual observations and improve class representations. However, high image-text agreement may reflect both intrinsic object properties and incidental context, making support prototypes susceptible to contextual contamination. To address this problem, we propose DVLA-RL++, which extends DVLA-RL with complementary semantic purification (CSP) and counterfactual reinforcement-learning gating (CRG). Specifically, CSP generates intrinsic and nuisance descriptions from labeled supports and compares their agreement with each support token. An ambiguity-dependent rejection margin guides sparse evidence allocation, while an intrinsic semantic anchor fills the unassigned mass to provide a fallback when visual evidence is unreliable. CRG learns layer-wise semantic fusion strengths using a reward that balances recognition performance and nuisance exposure. An independently executed reference trajectory on the same episode provides a paired learning signal. Theoretical analysis relates retained evidence and anchor quality to prototype stability and establishes conditions for unbiased on-policy gradient estimation. Experiments on standard, fine-grained, and cross-domain benchmarks show state-of-the-art accuracy, with an average gain of 1.4% over DVLA-RL. The project page is available at https://peacelwh.github.io/TPAMI27-DVLA-RLpp/.