Search papers, labs, and topics across Lattice.
This paper introduces AutoSpecNER, a meticulously curated dataset designed for fine-grained named entity recognition (NER) in vehicle advertisements, comprising 659 listings and over 10,000 annotated entities across 15 categories. The dataset's annotation quality is robust, with an impressive inter-annotator agreement score of 91.5%. Benchmarking various extraction methods reveals that the DeBERTa model significantly outperforms both a rule-based baseline and a leading large language model, achieving a micro-F1 score of 90%.
DeBERTa's 90% F1 score in extracting vehicle specifications highlights the potential of fine-tuned models to surpass traditional rule-based approaches by a staggering margin.
Vehicle advertisements contain rich specification information, but automotive NER resources remain limited. We introduce AutoSpecNER, an expert-annotated dataset for fine-grained entity recognition in vehicle listings. The dataset includes 659 advertisements from a popular car-selling website, with over 10,000 entities annotated across 15 categories, including MODEL, ENGINE_SPEC, and BATTERY_CAPACITY. Annotation quality was validated through inter-annotator agreement, achieving an average score of 91.5%. We benchmark rule-based extraction, fine-tuned transformer encoders, and large language models. DeBERTa achieves the best performance with a 90% micro-F1 score, outperforming the rule-based baseline (43%) and the strongest large language model (77.8%).
