Search papers, labs, and topics across Lattice.
This paper benchmarks four LLM-based reasoning architectures—baseline LLM, RAG, structured long-term memory, and memory-augmented conversational reasoning—on financial QA tasks under SME compute constraints, using a locally hosted 8B-parameter model. The study reveals an architectural inversion: structured memory excels in deterministic tasks, while RAG is superior in conversational settings. Based on these findings, the authors propose a hybrid framework that dynamically selects reasoning strategies to optimize accuracy, auditability, and efficiency.
Forget scaling up; this study shows that the right reasoning architecture—structured memory for deterministic tasks, RAG for conversational ones—can dramatically outperform a baseline LLM even when compute is severely limited.
The rapid adoption of artificial intelligence (AI) and large language models (LLMs) is transforming financial analytics by enabling natural language interfaces for reporting, decision support, and automated reasoning. However, limited empirical understanding exists regarding how different LLM-based reasoning architectures perform across realistic financial workflows, particularly under the cost, accuracy, and compliance constraints faced by small and medium-sized enterprises (SMEs). SMEs typically operate within severe infrastructure constraints, lacking cloud GPU budgets, dedicated AI teams, and API-scale inference capacity, making architectural efficiency a first-class concern. To ensure practical relevance, we introduce an explicit SME-constrained evaluation setting in which all experiments are conducted using a locally hosted 8B-parameter instruction-tuned model without cloud-scale infrastructure. This design isolates the impact of architectural choices within a realistic deployment environment. We systematically compare four reasoning architectures: baseline LLM, retrieval-augmented generation (RAG), structured long-term memory, and memory-augmented conversational reasoning across both FinQA and ConvFinQA benchmarks. Results reveal a consistent architectural inversion: structured memory improves precision in deterministic, operand-explicit tasks, while retrieval-based approaches outperform memory-centric methods in conversational, reference-implicit settings. Based on these findings, we propose a hybrid deployment framework that dynamically selects reasoning strategies to balance numerical accuracy, auditability, and infrastructure efficiency, providing a practical pathway for financial AI adoption in resource-constrained environments.
