Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces INS-ActBench, a comprehensive benchmark designed to evaluate the professional actuarial capabilities of Large Language Models (LLMs) through 12,050 Q&A pairs sourced from public exams and actuarial associations. The benchmark assesses LLM performance across three critical areas: standardized actuarial knowledge, long-context case reasoning, and tool-executable tasks involving spreadsheets and R-code. Results show that while leading LLMs excel in standardized knowledge, they significantly underperform in complex case reasoning and practical applications, highlighting the need for improved models in professional settings.
Frontier LLMs ace actuarial knowledge but falter in real-world case reasoning and tool use, revealing a critical gap in their professional applicability.
Large Language Models (LLMs) have shown strong potential in financial reasoning, but existing benchmarks often evaluate domain knowledge, numerical reasoning, long-context understanding, and tool use in separate settings. This limits their ability to assess realistic professional workflows that require auditable, context-grounded, and tool-executable decisions. We introduce \textbf{INS-ActBench}, a comprehensive benchmark for evaluating professional actuarial capability in LLMs. INS-ActBench contains 12,050 Q\&A pairs from public exams and sample questions released by 16 actuarial associations. It covers three subsets: \textbf{INS-Act-Know} for standardized actuarial knowledge, \textbf{INS-Act-Case} for long-context insurance case reasoning, and \textbf{INS-Act-Practice} for spreadsheet and R-code tasks with verifiable numerical outputs. Experiments on nine representative LLMs and human actuarial experts reveal a clear capability boundary: frontier LLMs perform strongly on standardized knowledge, but remain much weaker in case reasoning, tool-based workflows, and jurisdiction-sensitive practice. INS-ActBench provides a reproducible foundation for developing actuarial LLMs toward reliable professional assistance. The code is available at https://github.com/FDU-INS/INS-ActBench.