Search papers, labs, and topics across Lattice.
The paper introduces EduVideoBench, a new benchmark for evaluating the educational validity of video generation models (VGMs) based on the Knowledge-Skills-Attitude (KSA) framework. Results across five state-of-the-art VGMs reveal significant shortcomings in knowledge accuracy, skill demonstration, and attitude alignment, highlighting their unsuitability for classroom use. Qualitative analysis further identifies that educational validity is multi-faceted, with issues like pacing or notation critically impacting overall quality.
Current video generation models are far from ready to teach, stumbling on basic knowledge, skills, and attitudes needed for effective education.
Video generation models (VGMs) are rapidly entering classrooms, yet existing benchmarks evaluate only perceptual quality, intrinsic faithfulness, generic safety, or video as a reasoning medium, and none assesses whether the outputs are educationally valid. In this work, we present EduVideoBench, the first balanced benchmark in the education domain, grounded in the Knowledge-Skills-Attitude (KSA) framework so that pedagogical adequacy and educational safety are evaluated jointly rather than as ad-hoc quality dimensions. Across five frontier VGMs, our results show substantial room for improvement across knowledge, skills, and attitude before they are classroom-ready. We complement this with a qualitative analysis of expert comments, finding that educational validity is multi-component, where a single misaligned element such as pacing, legibility, or notation can invalidate an otherwise correct video. We hope EduVideoBench will guide the development of VGMs that are pedagogically grounded and safe for the classroom.
