Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper reveals that tabular foundation models, often thought to be safe from privacy breaches due to their synthetic training data, are susceptible to Membership Inference Attacks (MIAs) through their attention mechanisms. By introducing the AMIA attack, the authors demonstrate that attention patterns can leak significant membership information, outperforming traditional confidence-based methods by an average of 7.7%. To counter this vulnerability, they propose a novel inference-time defense inspired by $k$-anonymity principles, which effectively reduces membership leakage by up to 50% while maintaining predictive accuracy with minimal performance degradation.
Attention mechanisms in tabular models can leak sensitive membership information, revealing a surprising vulnerability that traditional defenses overlook.
Tabular foundation models are commonly assumed to present limited privacy concerns as they are often pre-trained on large collections of synthetic data. However, these models leverage in-context learning, where sensitive records may be provided directly at inference time as labelled context examples. In this paper, we demonstrate that predictions generated via the attention mechanism leak sufficient information to enable effective Membership Inference Attacks (MIAs). To highlight this vulnerability, we propose AMIA (Attention-based Membership Inference Attack), a shadow-model-free attack that exploits the concentration of transformer attention patterns. Our results show that attention mechanisms reveal strong membership signals, which exceed classical confidence-based attacks, achieving an average gain of 7.7\%, specially in low false-positive regimes. To mitigate this risk, we introduce an inference-time defence inspired by $k$-anonymity principles. This approach reduces the uniqueness of context-key representations without introducing random noise or retraining the model. By targeting only high-risk queries identified through AMIA scores, the defence substantially reduces membership leakage of this attack by an average of 50\% and 25\% against confidence-based attacks, while preserving predictive utility with only 3.9\% performance degradation. Beyond showing that context examples are vulnerable, we further demonstrate that fine-tuning introduces an additional source of privacy risk. In particular, samples whose prediction confidence increases after fine-tuning become more susceptible to MIAs, indicating that fine-tuning can amplify memorisation and expose sensitive training information through confidence shifts.