Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The ICSE 2026 Shadow PC initiative redefines peer reviewer training by implementing a structured program focused on deliberate practice, involving calibration and peer feedback across multiple phases. This approach successfully trained 102 participants who reviewed 117 papers, with an impressive 97% recommending the experience and 67% of authors finding the reviews helpful. The findings underscore the feasibility of scalable, rigorous reviewer training and highlight the potential for developing future leaders in the field.
Rigorous reviewer training at scale is not only possible but also leads to significantly improved review quality and participant satisfaction.
Peer review is essential to software engineering research, yet reviewer training remains largely implicit. We describe the ICSE 2026 Shadow PC, a redesigned program emphasizing deliberate practice at scale. Key innovations include multi-phase structure with calibration and peer feedback, strict separation from the main PC, and a pathway toward leadership development. With 102 participants completing the program and reviewing 117 papers, 97% recommending the experience, and positive reception from authors (67% finding reviews helpful), the program demonstrates that rigorous reviewer training is achievable at scale. We share lessons learned and propose shadow PC area chairs as a mechanism for sustainable scaling and leadership development.
CMU ML