Yuji Zhang

While long-tail knowledge is notoriously hard for LLMs to retain, structurally popular facts suffer the worst collateral damage during knowledge updates and act as super-spreaders of downstream hallucinations.

LLMs in medical diagnosis are alarmingly prone to jumping to conclusions, often answering before seeing all the evidence, but strategically delaying the question and evidence presentation can boost accuracy by up to 62.6%.