Search papers, labs, and topics across Lattice.
This paper introduces a computational framework, BrokenEyes, to simulate five common eye disorders and analyze their impact on feature representations learned by deep learning models trained on face detection tasks. The study reveals significant disruptions in feature maps, especially for cataract and glaucoma simulations, using both human and non-human datasets. The severity of these distortions was quantified using activation energy and cosine similarity, demonstrating the impact of degraded visual inputs on learned representations.
Simulating eye disorders on face detection models reveals that cataracts and glaucoma cause the most significant disruptions in learned feature representations, quantified by activation energy and cosine similarity.
Vision disorders significantly impact millions of lives, altering how visual information is processed and perceived. In this work, a computational framework was developed using the BrokenEyes system to simulate five common eye disorders: Age-related macular degeneration, cataract, glaucoma, refractive errors, and diabetic retinopathy and analyze their effects on neural-like feature representations in deep learning models. Leveraging a combination of human and non-human datasets, models trained under normal and disorder-specific conditions revealed critical disruptions in feature maps, particularly for cataract and glaucoma, which align with known neural processing challenges in these conditions. Evaluation metrics such as activation energy and cosine similarity quantified the severity of these distortions, providing insights into the interplay between degraded visual inputs and learned representations.