Search papers, labs, and topics across Lattice.
This paper introduces a system for automated iconographic classification and content-based recommendation of digitized artworks, leveraging the Iconclass vocabulary. The system uses YOLOv8 for object detection, maps detected objects to Iconclass codes, and employs rule-based inference to derive abstract meanings. The system then provides recommendations using hierarchical proximity, IDF-weighted overlap, and Jaccard similarity, demonstrating the potential to improve cataloging and navigation in heritage repositories.
Marrying computer vision with symbolic knowledge graphs unlocks automated art cataloging and content recommendation.
We present a proof-of-concept system that automates iconographic classification and content-based recommendation of digitized artworks using the Iconclass vocabulary and selected artificial intelligence methods. The prototype implements a four-stage workflow for classification and recommendation, which integrates YOLOv8 object detection with algorithmic mappings to Iconclass codes, rule-based inference for abstract meanings, and three complementary recommenders (hierarchical proximity, IDF-weighted overlap, and Jaccard similarity). Although more engineering is still needed, the evaluation demonstrates the potential of this solution: Iconclass-aware computer vision and recommendation methods can accelerate cataloging and enhance navigation in large heritage repositories. The key insight is to let computer vision propose visible elements and to use symbolic structures (Iconclass hierarchy) to reach meaning.
