Search papers, labs, and topics across Lattice.
The AIriskEval-edu Demo is a platform designed to audit the pedagogical quality of instructional explanations by evaluating them against five dimensions of pedagogical risk, including factual accuracy and ideological bias. It utilizes both a cloud-based GPT-5.5 and a locally hosted Llama 3.1 8B evaluator, the latter of which is fine-tuned on a specialized dataset of K-12 explanations. Key findings reveal that the local evaluator consistently outperforms GPT-5.5, providing educational institutions with a robust tool for ensuring the quality and safety of their instructional content.
Local evaluations can surpass state-of-the-art models like GPT-5.5, offering a new standard for auditing educational content in real-time.
We present AIriskEval-edu Demo, a platform that audits the pedagogical quality of instructional explanations and provides explainable audit results. The platform evaluates an explanation against a rubric covering five dimensions of pedagogical risk: factual accuracy, depth and completeness, focus and relevance, student-level appropriateness, and ideological bias. For each dimension, it returns a binary decision and a confidence score. Detected risks also include a natural-language rationale and, except for Depth and Completeness, a localized evidence span. The platform integrates GPT-5.5 through an external API and a self-hosted Llama 3.1 8B evaluator that runs on consumer-grade GPUs. The local evaluator is fine-tuned on AIriskEval-edu, a dataset of K-12 instructional explanations with risk and explainability annotations. The platform operates in two modes: in AI mode, both evaluators assess stored explanations generated under six simulated teacher profiles, each representing a distinct pedagogical behavior and potential risk; in human mode, the local evaluator audits user-written explanations in real time. The local evaluator outperforms GPT-5.5 on most reported metrics, offering educational institutions a practical way to keep audited content within their own infrastructure.
