Search papers, labs, and topics across Lattice.
This paper introduces IRTTA, a test-time adaptation method for medical image segmentation that leverages intermediate representations from iterative optical coherence tomography (OCT) reconstruction algorithms. IRTTA adapts the normalization layers of a frozen segmentation network using a modulator network conditioned on the reconstruction timescale. By minimizing an averaged entropy loss across timesteps during test-time, IRTTA improves segmentation accuracy and provides uncertainty estimates without modifying the reconstruction or segmentation models.
Unlock hidden signal in your medical images: a simple test-time trick using intermediate reconstruction steps boosts segmentation accuracy and gives you free uncertainty estimates.
Primary health care frequently relies on low-cost imaging devices, which are commonly used for screening purposes. To ensure accurate diagnosis, these systems depend on advanced reconstruction algorithms designed to approximate the performance of high-quality counterparts. Such algorithms typically employ iterative reconstruction methods that incorporate domain-specific prior knowledge. However, downstream task performance is generally assessed using only the final reconstructed image, thereby disregarding the informative intermediate representations generated throughout the reconstruction process. In this work, we propose IRTTA to exploit these intermediate representations at test-time by adapting the normalization-layer parameters of a frozen downstream network via a modulator network that conditions on the current reconstruction timescale. The modulator network is learned during test-time using an averaged entropy loss across all individual timesteps. Variation among the timestep-wise segmentations additionally provides uncertainty estimates at no extra cost. This approach enhances segmentation performance and enables semantically meaningful uncertainty estimation, all without modifying either the reconstruction process or the downstream model.
