Daniel Calloway

Thomson Reuters Foundational Research

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Eval Frameworks & Benchmarks (1)Natural Language Processing (1)

Frequent co-authors

Samuel J. Vincent (1)D. Calloway (1)Fangyi Yu (1)Andrew M. Bean (1)

Papers (1)

Aug 20, 2026

Samuel J. Vincent +51w ago·also Thomson Reuters Foundational Research

InsufficiencyBench: Evaluating LLM legal advice on underspecified user queries

No current LLM can accurately identify missing legal information in user queries, with all evaluated models struggling to balance responses to both deficient and complete questions.

Samuel J. Vincent, D. Calloway, Daniel Calloway +3

Eval Frameworks & Benchmarks Natural Language Processing

Search

Daniel Calloway

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)