Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the impact of stitching artifacts and patch dimensionality on the performance of generative models, specifically cycleGANs, applied to cryo-electron microscopy datasets. The research reveals that while FID scores do not capture the detrimental effects of stitching artifacts on downstream segmentation tasks, 3D models with artifact-free stitching show marginal performance improvements over 2D models, which are more stable during training. Notably, ensembling predictions from multiple directions enhances the quality of low-resolution volumes but does not benefit high-quality outputs, underscoring the need for careful artifact management in scientific image generation.
Stitching artifacts can significantly degrade segmentation performance, yet traditional metrics like FID fail to capture these subtle impacts.
Generating large images via deep learning requires patching input data to accommodate hardware memory limitations, then assembling output patches, a process that can introduce stitching artifacts when neighboring patches do not align at borders. While these artifacts are known to affect segmentation tasks, their impact on generative models for style-transfer remains poorly understood. We investigated three stitching approaches and two patch dimensionalities (2D vs 3D) using cycleGAN models trained on cryo-electron microscopy datasets. We evaluated both perceptual quality and performance on downstream mitochondria segmentation. Our key findings reveal that: (1) FID scores fail to detect subtle stitching artifacts that significantly impact downstream segmentation performance, (2) 3D models with artifact-free stitching marginally outperform 2D models on downstream tasks, though the improvement barely justifies the computational cost, and (3) 2D models train more stably due to larger batch sizes. Additionally, we demonstrate that ensembling predictions from three orthogonal directions can improve low-quality volumes but provides no benefit for high-quality outputs. These results demonstrate that maximizing generative model performance on large scientific datasets requires careful consideration and mitigation of stitching artifacts, and that perceptual metrics alone are insufficient for evaluating domain adaptation quality in biomedical imaging.