Search papers, labs, and topics across Lattice.
This paper introduces a multi-agent reinforcement learning framework for zero-shot document-level event argument extraction (ZS-DEAE). The framework consists of a generation agent that synthesizes data for unseen events using knowledge from seen events, and an evaluation agent that extracts arguments and assesses their semantic consistency. By converting evaluation results into reward signals and incorporating event structure constraints, the agents iteratively optimize data generation and argument extraction through reinforcement learning. Experiments on RAMS and WikiEvents datasets demonstrate improved data generation quality and argument extraction performance, also showing the generated data enhances other DEAE models.
Achieve better zero-shot event argument extraction by having two agents teach each other, one generating data and the other evaluating it with RL.
Document-level event argument extraction (DEAE) is essential for knowledge acquisition, aiming to extract participants of events from documents.In the zero-shot setting, existing methods employ LLMs to generate synthetic data to address the challenge posed by the scarcity of annotated data. However, relying solely on Event-type-only prompts makes it difficult for the generated content to accurately capture the contextual and structural relationships of unseen events. Moreover, ensuring the reliability and usability of synthetic data remains a significant challenge due to the absence of quality evaluation mechanisms. To this end, we introduce a multi-agent collaboration framework for zero-shot document-level event argument extraction (ZS-DEAE), which simulates the human collaborative cognitive process of"Propose-Evaluate-Revise."Specifically, the framework comprises a generation agent and an evaluation agent. The generation agent synthesizes data for unseen events by leveraging knowledge from seen events, while the evaluation agent extracts arguments from the synthetic data and assesses their semantic consistency with the context. The evaluation results are subsequently converted into reward signals, with event structure constraints incorporated into the reward design to enable iterative optimization of both agents via reinforcement learning.In three zero-shot scenarios constructed from the RAMS and WikiEvents datasets, our method achieves improvements both in data generation quality and argument extraction performance, while the generated data also effectively enhances the zero-shot performance of other DEAE models.
