Search papers, labs, and topics across Lattice.
This paper introduces an in-context learning approach to Multiple Instance Learning (MIL) that leverages a Perceiver-style architecture pretrained on synthetic data to enhance performance in low-label scenarios. By employing various synthetic data generators, the model captures diverse inductive biases, allowing it to effectively adapt to new tasks with minimal labeled data. The resulting model achieves superior performance across twelve MIL benchmarks, surpassing traditional supervised methods that necessitate extensive task-specific training.
Pretraining on diverse synthetic data allows a single model to excel across multiple MIL tasks with minimal labeled input, outperforming conventional supervised approaches.
Multiple Instance Learning (MIL) addresses problems where supervision is available at the level of bags of instances and has been successfully applied in fields ranging from computational pathology to satellite imagery. Nevertheless, existing algorithms struggle in the low-label regime that characterizes many real-world applications. Flexible models overfit and rigid ones fail to adapt to the task at hand. We show that pretraining an in-context learner with a Perceiver-style architecture on synthetic data yields a model that can solve new tasks from a handful of labeled bags. At inference time, classification happens in a single forward pass and requires no gradient updates. We propose and investigate different synthetic data generators for bag-structured data and find that they capture complementary inductive biases. A model pretrained on a mixture of these generators inherits their per-task strengths and achieves the best average performance across twelve MIL benchmarks, outperforming supervised baselines that require task-specific training.
