Search papers, labs, and topics across Lattice.
To enable task-agnostic active sensing under tight measurement budgets, this work formulates pixel acquisition as mutual information maximization conditioned on side information. The approach leverages a frozen discrete denoising diffusion model (D3PM) as a posterior entropy surrogate, driving both a sequential greedy selection policy and an end-to-end one-shot mask generator trained via unbiased binary gradient estimation. Across benchmarks, sequential acquisition cuts MNIST reconstruction errors by 8× at a 10% budget and yields 0.9–3.4 dB gains on CIFAR-10, while the static policy outperforms established MRI sampling baselines including LOUPE.
Pretrained discrete diffusion priors can serve as plug-and-play mutual information engines for optimal sensor placement, slashing reconstruction errors by 8× at a 10% sampling budget without model retraining.
Acquiring data is costly: higher measurement fidelity costs power and storage and risks collecting irrelevant content, while aggressive cost reduction can discard information that later analysis needs. We address this trade-off with an information-theoretic framework that acquires data relevant to a broad set of tasks rather than to one model. A mask policy, conditioned on side information, chooses which pixels to measure so as to maximize the mutual information between a discrete image and its partial observation under a budget; since the image entropy does not depend on the mask, this is equivalent to minimizing the conditional entropy. A frozen discrete denoising diffusion model (D3PM) supplies the posterior, and we use it in two ways: as an entropy surrogate for training a one-shot mask generator, and as the criterion for sequential greedy acquisition. The one-shot generator outperforms random masks only with care, including an unbiased gradient estimator for binary masks. With sequential acquisition, on MNIST the prior makes $8\times$ fewer errors than random at a $10\%$ budget, and on CIFAR-10 it gains $0.9$--$3.4$~dB. On fastMRI, our proposed technique using a static mask outperforms the well-known methods such as variable density and LOUPE.