Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SynGallery, a synthetic dataset designed to enhance instance-level artwork recognition by generating diverse 3D gallery scenes from catalog images of real paintings. The dataset, comprising 24,490 rendered views of 4,898 paintings, significantly outperforms traditional studio photographs in training models, achieving a recognition accuracy increase from 67.18 to 73.47 GAP$^-$. Key findings reveal that the performance improvement is primarily driven by geometric viewpoint variation rather than photographic realism, as factors like blur and sensor noise negatively impact results.
Synthetic gallery scenes can boost artwork recognition accuracy by over 6% compared to traditional training methods using real photographs.
Instance-level artwork recognition requires matching a handheld visitor photograph to a specific work in a large museum collection. This is challenging because painting datasets typically provide clean catalog images for training, while test queries are captured under oblique viewpoints, gallery lighting, reflections, frames, and other scene-level variations. We present SynGallery, a synthetic gallery dataset for artwork retrieval that addresses this gap without collecting additional real photographs. Starting from catalog images of real paintings, we place each artwork into a procedurally generated 3D gallery scene and render it from multiple viewpoints under varied geometric and appearance conditions, while preserving the exact identity of the original work. The resulting dataset contains 24,490 rendered views of 4,898 paintings from the Met benchmark. We show that these synthetic views provide a stronger training signal than the corresponding studio photographs. At the same number of training data points, training only on SynGallery improves art painting recognition from 67.18 to 73.47 GAP$^-$. When added to the full Met training set, SynGallery improves the published benchmark protocol from 35.97 to 38.48 GAP. Ablation experiments show that the gain comes primarily from geometric viewpoint variation rather than photographic realism: blur, sensor noise, and image compression consistently reduce performance.