Search papers, labs, and topics across Lattice.
This paper investigates whether LLM embeddings of news headlines can improve stock clustering compared to price-based and GICS-based methods, testing the semi-strong Efficient Market Hypothesis (EMH). They convert each clustering method into a synthetic factor model within the Arbitrage Pricing Theory (APT) framework for consistent out-of-sample evaluation. Results using S&P 500 constituents from 2022-2024 show that price-based clustering outperforms both GICS and LLM-based methods, suggesting that short-horizon return information is largely contained in prices, supporting the EMH.
Despite the hype, LLM embeddings of news headlines can't beat price-based clustering for predicting stock returns, reinforcing the Efficient Market Hypothesis.
This paper investigates whether artificial intelligence can enhance stock clustering compared to traditional methods. We consider this in the context of the semi-strong Efficient Markets Hypothesis (EMH), which posits that prices fully reflect all public information and, accordingly, that clusters based on price information cannot be improved upon. We benchmark three clustering approaches: (i) price-based clusters derived from historical return correlations, (ii) human-informed clusters defined by the Global Industry Classification Standard (GICS), and (iii) AI-driven clusters constructed from large language model (LLM) embeddings of stock-related news headlines. At each date, each method provides a classification in which each stock is assigned to a cluster. To evaluate a clustering, we transform it into a synthetic factor model following the Arbitrage Pricing Theory (APT) framework. This enables consistent evaluation of predictive performance in a roll forward, out-of-sample test. Using S&P 500 constituents from from 2022 through 2024, we find that price-based clustering consistently outperforms both rule-based and AI-based methods, reducing root mean squared error (RMSE) by 15.9% relative to GICS and 14.7% relative to LLM embeddings. Our contributions are threefold: (i) a generalizable methodology that converts any equity grouping: manual, machine, or market-driven, into a real-time factor model for evaluation; (ii) the first direct comparison of price-based, human rule-based, and AI-based clustering under identical conditions; and (iii) empirical evidence reinforcing that short-horizon return information is largely contained in prices. These results support the EMH while offering practitioners a practical diagnostic for monitoring evolving sector structures and provide academics a framework for testing alternative hypotheses about how quickly markets absorb information.
