Kevin Chen

Shrinking an LLM's residual stream based on activation variance alone discards the wrong directions—weighting pruned subspaces by downstream output sensitivity dramatically improves compressed model performance without sacrificing closed-form computational efficiency.

LLMs are not just tools; they are reshaping the very fabric of research, but they also introduce systemic risks that could undermine scientific integrity.