Search papers, labs, and topics across Lattice.
This study explores the intersection of qualitative education research and data visualization by examining how STEM education researchers utilize two platforms鈥擩ournal Data Dashboard and WordStream Maker鈥攖o analyze student journal responses. Through a mixed-methods expert study involving thematic analysis, the researchers identified divergent perspectives on the effectiveness of frequency-based visualizations, with some viewing them as beneficial for qualitative analysis while others warned they may overlook significant but infrequent responses. The findings yield critical design implications for developing visualization tools that harmonize quantitative methods with qualitative insights in educational contexts.
Frequency-based visualizations can either illuminate or obscure critical insights in qualitative education research, revealing a fundamental tension in tool design.
Data-driven learning analytics can surface trends across a student cohort over time, helping instructors improve the learning environment. WordStream, a visualization idiom for topic evolution, has been instantiated in two platforms toward this goal: the Journal Data Dashboard, for analyzing formative assessments, and WordStream Maker, for authoring custom visualizations. Where the prior work built these platforms for education (Vis4Ed), here we examine the reverse direction (Ed4Vis): what can qualitative education research tell us about building better visualization tools? We conducted a mixed-methods expert study (n=10) in which STEM education researchers with expertise in qualitative methods and classroom assessment used both platforms to analyze student journal responses from a data visualization course. Across two cycles of thematic analysis with confirmatory checking, we report themes spanning tool experience, disciplinary context of use, and, most importantly, a core epistemological dissensus. Some instructor-researchers regarded frequency-based visualization as a productive entry point to qualitative analysis; others cautioned it can obscure rare but critical responses. We synthesize these findings into design implications for future tools that better integrate quantitative technique with qualitative inquiry. All Supplementary Materials are available at https://osf.io/z2f8d.
