Mor Geva

Language models encode knowledge in a task-specific manner, leading to inconsistent retrieval of facts across different tasks.

Existing "faithfulness" metrics for chain-of-thought reasoning are essentially useless, performing near chance at identifying whether a CoT actually reflects the model's computation.