Search papers, labs, and topics across Lattice.
The OpenAI Privacy Filter is a bidirectional token-classification model engineered to detect and redact personally identifiable information (PII) and secrets from unstructured text. Utilizing a constrained Viterbi decoder, the model achieves coherent labeling across eight privacy categories while allowing for adjustable precision-recall tradeoffs. With 1.5 billion parameters and a 128,000-token context window, it is optimized for efficient local deployment and domain-specific fine-tuning, positioning it as a critical tool in layered privacy workflows.
Achieving coherent PII detection across eight categories, the OpenAI Privacy Filter balances precision and recall while maintaining efficiency for local deployment.
OpenAI Privacy Filter is a compact, bidirectional token-classification model for detecting and redacting personally identifiable information (PII) and secrets in unstructured text. The model is derived from an autoregressively pretrained checkpoint and converted into a bidirectional, banded-attention classifier that labels an input sequence in a single forward pass. A constrained Viterbi decoder produces coherent spans across eight privacy categories and exposes configurable operating points for precision-recall tradeoffs. Privacy Filter has 1.5 billion total parameters, 50 million active parameters per token, and a 128,000-token context window. It is designed for efficient local deployment and domain-specific fine-tuning. Privacy Filter is intended as a configurable data-minimization component within layered privacy workflows, not as an anonymization or compliance guarantee.
