Vijay S. Kalmath

Scale AI

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Eval Frameworks & Benchmarks (1)Tool Use & Agents (1)

Frequent co-authors

Varun Ursekar (1)Apaar Shanker (1)Yash Maurya (1)Shehab Yasser (1)

Papers (1)

Aug 6, 2026

2w ago

HarnessOpt-Bench: Evaluating LLMs at Harness Optimization

Harness optimization reveals that LLMs can significantly enhance their performance, but surprisingly, native harnesses aren't always the best choice for optimization.

Varun Ursekar, Apaar Shanker, Yash Maurya +4

Eval Frameworks & Benchmarks Tool Use & Agents

Search

Vijay S. Kalmath

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)