Alimurtaza Mustafa Merchant

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Eval Frameworks & Benchmarks (1)Multimodal Models (1)Tool Use & Agents (1)

Frequent co-authors

Dhaval C. Patel (1)Kaoutar El Maghraoui (1)Shuxin Lin (1)Yusheng Li (1)

Papers (1)

Jun 18, 2026

Corresponding author:3w ago·also Corresponding author

Beyond Static Leaderboards: Predictive Validity for the Evaluation of LLM Agents

Aggregate-score leaderboards can mislead, as they fail to predict agent performance in real-world scenarios, revealing a critical flaw in current evaluation practices.

Dhaval C. Patel, Kaoutar El Maghraoui, Shuxin Lin +58

Eval Frameworks & Benchmarks Multimodal Models Tool Use & Agents

Search

Alimurtaza Mustafa Merchant

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)