Search papers, labs, and topics across Lattice.
The paper introduces AnnoABSA, a web-based annotation tool designed to support the full range of Aspect-Based Sentiment Analysis (ABSA) tasks with customizable sentiment elements. AnnoABSA incorporates Large Language Model (LLM)-based retrieval-augmented generation (RAG) to provide context-aware suggestions to annotators in a human-in-the-loop framework. By retrieving and incorporating the ten most similar already-annotated examples as few-shot examples in the prompt, the tool improves suggestion accuracy over time.
AnnoABSA slashes ABSA annotation time by using LLMs to suggest annotations, improving suggestion accuracy over time by retrieving similar, already-annotated examples.
We introduce AnnoABSA, the first web-based annotation tool to support the full spectrum of Aspect-Based Sentiment Analysis (ABSA) tasks. The tool is highly customizable, enabling flexible configuration of sentiment elements and task-specific requirements. Alongside manual annotation, AnnoABSA provides optional Large Language Model (LLM)-based retrieval-augmented generation (RAG) suggestions that offer context-aware assistance in a human-in-the-loop approach, keeping the human annotator in control. To improve prediction quality over time, the system retrieves the ten most similar examples that are already annotated and adds them as few-shot examples in the prompt, ensuring that suggestions become increasingly accurate as the annotation process progresses. Released as open-source software under the MIT License, AnnoABSA is freely accessible and easily extendable for research and practical applications.
