Ivan P. Yamshchikov

Forget expensive data annotation: this pipeline generates synthetic social media data that trains models to SOTA performance, all while preserving user privacy.

Code tokenizers are wasting tokens on source-specific noise, but a simple regularization technique can prune the fat and improve efficiency without sacrificing inference speed.