Xin-Chi Qiu

Language models encode task information in hidden states *before* their unembedding matrix can express it, suggesting current developmental timelines are misleading.

Traditional lens methods can mislead due to corpus dependence, but Sparse Readout Prism reveals stable readout features that enhance interpretability and accuracy in language model analysis.