Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the influence of momentum, commentary tone, and earnings surprise on LLM financial forecasts by constructing synthetic earnings announcements and querying six instruction/chat checkpoint conversions. The findings reveal that for most models, the magnitude of commentary tone and momentum inputs significantly exceeds that of EPS surprise in driving forecasts, with natural-word numerical diagnostic accuracy varying widely. The experiment quantifies observable input reliance and numerical recognition, providing valuable data for understanding LLM behavior in financial contexts.
LLMs' financial forecasts are more swayed by commentary tone and momentum than by the actual earnings surprise itself.
Which inputs drive a language model's financial forecast? We construct synthetic earnings announcements that independently reverse 20-day momentum, non-informational commentary tone, and whether fixed actual EPS beats a manipulated consensus. Six instruction/chat checkpoint conversions from four families (0.49-7.61B base parameters) receive 2,016 prompts each under a direct-answer Q8_0 protocol. The design includes 24 numerical blocks, six commentary pairs, profits and losses, rising and falling annual EPS, and two surprise sizes. Both A/B answer assignments and U/D cover all 384 primary scenarios per conversion. We estimate matched changes in conditional answer-prefix scores, not calibrated market probabilities. Across these checkpoints, the primary EPS contrast ranges from -0.19 to 86.80 percentage points. The magnitude of the primary signed tone contrast exceeds that of EPS in 5 of six models, and momentum exceeds it in 5. Natural-word numerical diagnostic accuracy ranges from 51.0 to 95.8 percent. Answer-encoding, wording, context, and conversion controls qualify these results. The experiment measures observable input reliance and numerical recognition; it establishes neither an internal reasoning mechanism nor realized return predictability. Public benchmark prompts, recorded scores, and an interactive recorded-results explorer accompany the study.