Search papers, labs, and topics across Lattice.
This paper evaluates Prompt Coach (PC), an agentic tutor designed to enhance prompt engineering skills among software developers through Socratic questioning within their IDE. The study involved 15 professional developers and demonstrated statistically significant improvements in prompt quality after just one 60-minute session, particularly in dimensions often neglected by developers. Participants expressed strong trust in the system and a unanimous belief that PC effectively improved their prompt-writing abilities, highlighting its potential as a valuable educational tool in software development.
Developers improved their prompt engineering skills significantly after just one hour with Prompt Coach, a tutor that adapts to their coding context.
Prompt engineering has emerged as a critical yet undertaught skill for software developers, one that traditional learning approaches are ill-equipped to support given its evolving, interactive, and context-dependent nature. In this paper, we introduce Prompt Coach (PC), an agentic tutor that helps developers learn how to craft high-quality code-generation prompts through Socratic guidance embedded in-flow within their IDE. PC evaluates prompt quality across multiple dimensions and surfaces targeted questions to guide self-correction, grounded in the developer's codebase and the behavior of the target LLM. We present an early empirical study with 15 professional developers combining quantitative prompt quality scoring with qualitative perception measures. Participants showed statistically significant improvements after a single 60-minute session, with the largest gains across dimensions commonly overlooked by developers. They also reported strong trust, high adoption readiness, and unanimous agreement that PC improved their prompt-writing skills.
