Jonghyun Song

LLM agents will pick a worse item from a "preferred" source over a better item from a "dispreferred" source two-thirds of the time, revealing a critical bias that can be reduced by providing more information.

Mathematical heuristics, not just reasoning paths, are the key to unlocking LLMs' accuracy in solving math problems.