Ryo Koshihara

Papers on Lattice

Total citations

Topics

h-index

Research focus

Code Generation & Program Synthesis (1)Eval Frameworks & Benchmarks (1)Natural Language Processing (1)

Frequent co-authors

Masumi Morishige (1)

Papers (1)

May 2, 2025

Masumi Morishige +1May 2, 2025

Ensuring Reproducibility in Generative AI Systems for General Use Cases: A Framework for Regression Testing and Open Datasets

Prompt engineering for conciseness delivers statistically significant gains (+12.37 pp) with minimal accuracy loss, while newer LLM versions show only marginal, statistically insignificant improvements on the GPR-bench benchmark.

Masumi Morishige, Ryo Koshihara

Code Generation & Program Synthesis Eval Frameworks & Benchmarks Natural Language Processing

Search

Ryo Koshihara

Research focus

Frequent co-authors

Papers (1)