Search papers, labs, and topics across Lattice.
This paper investigates the information bottleneck problem under the constraint of perfect privacy, focusing on the active-rate regime where representation-rate limitations directly impact utility. The authors develop an ADMM-based optimization method that ensures the representation remains statistically independent of sensitive variables while preserving utility-relevant information. Their results include global convergence guarantees and a characterization of the convergence rate, which is enhanced by the Kurdyka-Lojasiewicz exponent, even when employing inexact block updates.
Achieving perfect privacy in information bottleneck scenarios can be done without sacrificing utility, thanks to a novel optimization approach that guarantees independence from sensitive variables.
In this work, we study the information bottleneck under perfect privacy, with particular emphasis on the active-rate regime, where the representation-rate constraint is binding and directly limits the achievable utility. The goal is to construct a representation that preserves utility-relevant information while remaining statistically independent of a sensitive variable. This exact independence requirement introduces an additional constraint beyond the classical rate-relevance tradeoff and must be explicitly incorporated into the optimization. To this end, we develop an alternating direction method of multipliers (ADMM)-based method tailored to the resulting problem structure. Under suitable regularity conditions, we establish global convergence of the generated sequence, characterize its convergence rate through the Kurdyka-Lojasiewicz exponent, and extend the analysis to inexact block updates.
