Yuan Yang

LLMs have a fundamental Shannon capacity: scaling model size or data without preserving a sufficient signal-to-noise ratio inevitably degrades performance.

LLMs exhibit systematic gender bias and heteronormative assumptions when processing long-form text, even in the absence of explicit gender cues.