Search papers, labs, and topics across Lattice.
This paper introduces a two-stage framework for optimizing prompts in few-shot relation extraction, leveraging both reasoning-based and gradient-based methods. The first stage employs a reasoning-guided search to enhance prompts broadly, while the second stage utilizes a novel gradient-based optimization method, GradPO, to refine these prompts through targeted local edits. Experimental results demonstrate that this approach achieves state-of-the-art performance on the FS-TACRED dataset and maintains competitive results on FS-FewRel, highlighting the effectiveness of combining these optimization strategies.
Combining reasoning-guided and gradient-guided prompt optimization leads to significant performance improvements in few-shot relation extraction tasks.
Automatic prompt optimization is still underexplored for episodic few-shot relation extraction with smaller language models. We propose a two-stage framework that combines reasoning-based prompt optimization with gradient-based prompt optimization. The first stage can use any reasoning-based optimizer to make broadprompt improvements in natural language. The second stage applies our GradPO, which uses loss and gradient signals to identify high-impact prompt spans and refine them with local edits. Experiments on FS-TACRED and FS-FewRel show that local refinement usually improves prompts found by the first stage, and GradPO is the most consistent refiner. Our framework achieves state-of-the-art performance on FS-TACRED with Qwen3-4B and remains competitive on FS-FewRel.
