Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper details the implementation of puzzle-based learning activities to teach Critical Testing Literacy (CTL) through a framework called P4TEST, derived from a model of critical tester cognition. Conducted across thirteen workshops with diverse participants, the study found that while students tended to converge on solutions, professionals engaged in deeper exploration, highlighting differences in problem-solving approaches. The findings emphasize the importance of the entire sequence of solving, debriefing, and reflecting, rather than the puzzles themselves, in fostering critical testing skills.
Participants in puzzle-based workshops reported a shift from surface-level problem-solving to deeper critical thinking, revealing stark contrasts in learning dynamics between students and professionals.
In this paper, we report our experiences and takeaways from workshops using puzzles to learn CTL. Background: Software testing is important yet difficult to teach. We introduced a BoK of puzzle-based learning activities to teach CTL, based on a model of critical tester's cognition, leading to the pedagogical framework P4TEST. We conducted thirteen workshops with students, testers, teachers, and primary school pupils to assess puzzle-based teaching of critical testing literacy. Experience: Across eleven workshops, we used a semi-structured approach, varying puzzles, materials, and timing. In two additional workshops, we introduced workbooks and think-aloud sessions to gather more data on the learning experience. Observations: Participants consistently perceived themselves as experimenting while solving puzzles. Students tended to converge on solutions, while professionals continued exploring. Emotions were visible in behaviour but hard to surface through written reflection alone. Think-aloud sessions revealed immediate reasoning; written reflections elicited more meta-cognitive reflection. The theme Sensemaking / reflection-in-action captured how participants framed problems, navigated dead ends, and shifted strategies. Reflections: Puzzles are not the intervention: the entire sequence of solving, debriefing, and reflecting is. Designing that sequence more deliberately is the work ahead. We also developed an open-source web application with built-in analytics to customise workshops.