Search papers, labs, and topics across Lattice.
This paper introduces Decisive, an interactive decision-making framework that enhances user decision processes by integrating document-grounded reasoning with Bayesian preference inference. By utilizing an objective option-scoring matrix and targeted pairwise tradeoff questions, Decisive effectively learns user preferences while minimizing cognitive load. Experimental results show that Decisive achieves up to a 20% improvement in decision accuracy compared to existing methods, including general-purpose large language models.
Users can make better decisions with 20% more accuracy by leveraging Decisive's innovative approach to preference elicitation from unstructured documents.
Decision-making is a cognitively intensive task that requires synthesizing relevant information from multiple unstructured sources, weighing competing factors, and incorporating subjective user preferences. Existing methods, including large language models and traditional decision-support systems, fall short: they often overwhelm users with information or fail to capture nuanced preferences accurately. We present Decisive, an interactive decision-making framework that combines document-grounded reasoning with Bayesian preference inference. Our approach grounds decisions in an objective option-scoring matrix extracted from source documents, while actively learning a user's latent preference vector through targeted elicitation. Users answer pairwise tradeoff questions adaptively selected to maximize information gain over the final decision. This process converges efficiently, minimizing user effort while ensuring recommendations remain transparent and personalized. Through extensive experiments, we demonstrate that our approach significantly outperforms both general-purpose LLMs and existing decision-making frameworks achieving up to 20% improvement in decision accuracy over strong baselines across domains.
