Search papers, labs, and topics across Lattice.
This paper introduces Adaptive Binning, a novel self-supervised learning approach for medical tabular data that dynamically adjusts discretization during training to enhance feature representation. By employing a curriculum learning strategy that refines discretization based on feature characteristics and learning progress, the method achieves significant improvements in both linear probing and fine-tuning tasks across various public medical datasets. The results demonstrate that Adaptive Binning not only outperforms existing fixed discretization methods but also establishes a benchmark for reproducible research in this area.
Adaptive Binning transforms how we leverage unlabeled medical tabular data, achieving significant performance gains without the need for costly expert labels.
Medical tabular data are ubiquitous in clinical research, but deep learning for tables remains underexplored because reliable labels often require costly expert adjudication, even though structured clinical variables are routinely available in tabular form. Self-supervised learning can leverage these unlabeled tables, and recent binning-based pretexts offer a promising inductive bias, but existing objectives fix a single global quantile discretization and apply feature-agnostic supervision. We propose Adaptive Binning, a training-adaptive discretization pretext for tabular SSL that couples discretization to learning through a feature-wise coarse-to-fine curriculum. Motivated by the spectral bias of neural networks and the principles of curriculum learning, our method progressively refines discretization per feature upon plateau detection and selects representation-aware splits to jointly improve value-space concentration and representation-space coherence. A heterogeneity-aware objective unifies categorical reconstruction with ordinal supervision for numerical features, and experiments on public medical tabular datasets under unified evaluation protocols show consistent gains for linear probing and fine-tuning without dataset-specific discretization tuning. We further introduce a medical tabular SSL benchmark with standardized protocols to support reproducible progress in this underexplored domain. Our code is available at https://github.com/labhai/Adaptive-Binning.
