Search papers, labs, and topics across Lattice.
AmalthAI is an open-source computer vision platform designed to empower cultural heritage (CH) experts without machine learning backgrounds to analyze artifacts independently. By integrating tools for dataset management, model training, and inference, along with features like Grad-CAM for localization and a vision-language model for text descriptions, the platform facilitates archaeologically relevant findings while ensuring data privacy through self-hosting. In a practical application, CH experts successfully trained and validated segmentation and classification models on a custom dataset of clay textile imprints, demonstrating the platform's efficacy in hypothesis testing.
Non-ML cultural heritage experts can now independently analyze artifacts and validate findings using an intuitive, open-source computer vision platform.
Computer vision (CV) and machine learning (ML) offer new tools for cultural heritage (CH) artifact analysis, but the CV/ML pipeline remains largely inaccessible to CH domain experts, who lack the background to configure, train, or assess models. We present AmalthAI, an open-source CV platform that bridges this gap, enabling non-ML CH experts to independently produce and validate archaeologically meaningful findings. The interface covers dataset management, training, and inference for classification, segmentation, and object detection, with Kubeflow and Katib handling scalable training and hyperparameter search. Grad-CAM localizes the image region behind a prediction, and a vision-language model (VLM) adds a text description of it for expert review. Since archaeological data is often state-owned or rights-encumbered and cannot leave institutional custody, AmalthAI's self-hostable deployment ensures sensitive data is kept within premises. We test the platform on an archaeological use case built on a custom dataset of clay textile imprints, where CH experts trained and validated segmentation, and classification models for hypothesis testing. We provide the implementation code at https://github.com/TEXTaiLES/AmalthAI.
