Veli Karakaya

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Code Generation & Program Synthesis (2)Eval Frameworks & Benchmarks (2)Natural Language Processing (1)

Frequent co-authors

U. B. Torun (2)Eray Tuzun (2)Ali Babar (1)Baykal Mehmet Uccar (1)

Papers (2)

Apr 27, 2026

Bilkent UniversityApr 27, 2026·also Adelaide University

Evaluation of LLM-Based Software Engineering Tools: Practices, Challenges, and Future Directions

Evaluating LLM-powered software engineering tools is fundamentally broken, as traditional metrics fail to capture the nuanced, non-deterministic nature of their outputs.

U. B. Torun, Veli Karakaya, Ali Babar +1

Code Generation & Program Synthesis Eval Frameworks & Benchmarks Natural Language Processing

Veli Karakaya +3Apr 27, 2026·also Bilkent University

Understanding the Limits of Automated Evaluation for Code Review Bots in Practice

Automated evaluations of code review bots disagree with developer feedback nearly 40% of the time, revealing that developer actions are driven by workflow pressures, not just code quality.

Veli Karakaya, U. B. Torun, Baykal Mehmet Uccar +1

Code Generation & Program Synthesis Eval Frameworks & Benchmarks

Search

Veli Karakaya

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (2)