Search papers, labs, and topics across Lattice.
KnowVis addresses the cognitive overload novice learners face when engaging with dense video lectures by transforming these linear formats into structured visual narratives. The framework extracts concept maps from multimodal content to identify key threshold concepts and synthesizes engaging visual summaries that enhance understanding. Extensive evaluations reveal that KnowVis significantly improves clarity and learning outcomes compared to existing summarization methods, effectively reducing cognitive load and enhancing knowledge retention.
Visual summaries from KnowVis not only clarify complex concepts but also boost student retention and understanding, outperforming traditional video summarization techniques.
Video lectures are valuable educational resources, but their dense and lengthy formats often overwhelm novice learners. This difficulty stems from a fundamental pedagogical mismatch: while videos deliver transient information linearly, human learning requires constructing interconnected cognitive networks, a task that induces severe cognitive overload for novice learners lacking prior domain knowledge. Existing video summarization methods fail to resolve this mismatch, as they primarily produce text-heavy, linear condensations that still demand high cognitive effort. To bridge this gap, we propose KnowVis, a framework that transforms linear video lectures into pedagogically grounded visual narratives. KnowVis first extracts a detailed concept map from multimodal video content to identify important and challenging threshold concepts, then constructs structured knowledge units, and finally synthesizes engaging visual summaries. Alongside the framework, we introduce a curated dataset of 125 educational videos across 10 academic disciplines, paired with 1,079 generated visual summaries. Extensive automated evaluations and a human study demonstrate that, compared to state-of-the-art baselines, KnowVis generates more accurate and clear visuals that successfully reduce cognitive load and significantly improve student learning effectiveness and knowledge retention.
