Elia Cunegatti

SubFit reveals that compressing LLMs at the submodule level can dramatically enhance performance, achieving better accuracy retention and lower perplexity than conventional layer-based methods.

Forget perplexity – ZipCal uses Zipf's law to curate calibration data for LLM compression, matching state-of-the-art performance at 240x the speed.