Search papers, labs, and topics across Lattice.
The WebKurator.de platform addresses the challenge of systematic web curation by implementing a two-dimensional model that separates topical categorization from geographic annotation, specifically targeting the German web. Utilizing a large-scale dataset of 5.54 million websites, the platform employs LLM-based topic classification and imprint-based address extraction to enhance the curation process. Key findings reveal that 85.17% of the curated websites are located in Germany and have assigned topic labels, demonstrating the platform's potential for effective regional and topical web preservation.
A revolutionary two-dimensional curation model enables precise web preservation by disentangling topical and geographic dimensions, setting a new standard for national libraries.
The systematic curation of the Web remains a central challenge for national libraries and memory institutions that aim to preserve culturally and regionally relevant content. Existing directory-based approaches such as Curlie implement a predominantly topic-centric, one-dimensional hierarchy, where geographic aspects are intertwined with topical and linguistic categories. To address this limitation, we present WebKurator.de, a collaborative platform for combined regional and topical web curation, initially focused on the German web. WebKurator introduces a two-dimensional curation model that explicitly separates topical categorization and geographic annotation. The system integrates LLM鈥揵ased topic classification and imprint-based address extraction with geocoding, and supports user suggestions together with moderated review. The platform is bootstrapped from the German Imprints Dataset, a large-scale collection of 5.54 million websites. Among them, 3.14 million contain imprint pages, for which we successfully extracted and geocoded postal addresses. Of these, 2.58 million (85.17%) are located in Germany and also have an assigned topic label. These websites form the initial foundation of WebKurator.de and can be continuously extended through user suggestions.
