Search papers, labs, and topics across Lattice.
This paper reformulates multi-view learning by introducing SIMPLE, a reusable, task-conditioned inference procedure that leverages a synthetic task prior to enhance the utility of heterogeneous views across various downstream tasks. By generating diverse support-query episodes in embedding space, SIMPLE allows for effective reasoning within and across views, addressing challenges related to view relevance and missingness. Experimental results show that SIMPLE's frozen variant achieves competitive performance, while lightweight adapter calibration significantly improves results on multiple benchmarks, validating the hypothesis that multi-view reasoning can be pretrained and reused effectively.
Multi-view reasoning can be pretrained and reused, enabling competitive performance without the need for constant retraining on downstream tasks.
Modern pretrained encoders make representations from heterogeneous views increasingly reusable, but the procedure that determines view utility and combines evidence is still relearned for each downstream task. Consequently, knowledge about view relevance, complementarity, reliability, and missingness is repeatedly discarded rather than transferred across tasks. We therefore reformulate multi-view learning as learning a reusable, task-conditioned inference procedure rather than a fixed fusion function. Based on this perspective, we propose SIMPLE, a prior-fitted multi-view in-context learner that predicts query labels by conditioning on a small labeled support set. Since existing real-world datasets cover only a limited range of view configurations and task structures, we construct a controllable synthetic task prior in embedding space. It generates diverse support-query episodes with varying class structures, shared and view-specific factors, representation geometries, cross-view dependencies, reliability levels, missingness patterns, and distribution shifts. A hierarchical inference architecture then performs reasoning within views, across views, and across support and query samples. Experiments on multi-view and multi-omics benchmarks demonstrate that the frozen variant of SIMPLE achieves competitive performance without updating the inference backbone, while lightweight adapter calibration attains leading performance on most evaluated datasets. Together, the results under frozen, one-shot, and missing-view settings support the central hypothesis that multi-view reasoning itself can be pretrained and reused, while lightweight adapter calibration provides task-specific alignment when needed.
