Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper investigates whether LLMs can generate useful features for RL trading agents by using a frozen LLM to transform news and filings into fixed-dimensional vectors for a PPO agent. An automated prompt-optimization loop tunes the extraction prompt against the Information Coefficient, discovering predictive features with IC above 0.15. However, these features degrade performance during macroeconomic shocks, highlighting a gap between feature validity and policy robustness, akin to transfer learning challenges.
LLM-derived features that show strong predictive power in isolation can actually *hurt* RL trading agent performance during macroeconomic shocks, revealing a surprising disconnect between feature validity and policy robustness.
Can large language models (LLMs) generate continuous numerical features that improve reinforcement learning (RL) trading agents? We build a modular pipeline where a frozen LLM serves as a stateless feature extractor, transforming unstructured daily news and filings into a fixed-dimensional vector consumed by a downstream PPO agent. We introduce an automated prompt-optimization loop that treats the extraction prompt as a discrete hyperparameter and tunes it directly against the Information Coefficient - the Spearman rank correlation between predicted and realized returns - rather than NLP losses. The optimized prompt discovers genuinely predictive features (IC above 0.15 on held-out data). However, these valid intermediate representations do not automatically translate into downstream task performance: during a distribution shift caused by a macroeconomic shock, LLM-derived features add noise, and the augmented agent under-performs a price-only baseline. In a calmer test regime the agent recovers, yet macroeconomic state variables remain the most robust driver of policy improvement. Our findings highlight a gap between feature-level validity and policy-level robustness that parallels known challenges in transfer learning under distribution shift.