Search papers, labs, and topics across Lattice.
This paper introduces Stan, a suite of LLM-based tools designed to support both students and instructors in an undergraduate chemical engineering thermodynamics course. Stan leverages a shared data pipeline built from lecture transcripts and a structured textbook index, using retrieval-augmented generation (RAG) for student queries and structured analysis pipelines for instructor support. The system, built entirely on locally controlled hardware and open-weight models (Whisper large-v3, Llama~3.1 8B), provides features like per-lecture summaries, identification of student confusion, and cataloging of teaching anecdotes, offering a semester-scale record of teaching.
Forget cloud APIs and pricey SaaS: Stan proves you can build a powerful, private, and reproducible AI teaching assistant using open-weight LLMs and local hardware.
Discussions of AI in education focus predominantly on student-facing tools -- chatbots, tutors, and problem generators -- while the potential for the same infrastructure to support instructors remains largely unexplored. We describe Stan, a suite of tools for an undergraduate chemical engineering thermodynamics course built on a data pipeline that we develop and deploy in dual roles: serving students and supporting instructors from a shared foundation of lecture transcripts and a structured textbook index. On the student side, a retrieval-augmented generation (RAG) pipeline answers natural-language queries by extracting technical terms, matching them against the textbook index, and synthesizing grounded responses with specific chapter and page references. On the instructor side, the same transcript corpus is processed through structured analysis pipelines that produce per-lecture summaries, identify student questions and moments of confusion, and catalog the anecdotes and analogies used to motivate difficult material -- providing a searchable, semester-scale record of teaching that supports course reflection, reminders, and improvement. All components, including speech-to-text transcription, structured content extraction, and interactive query answering, run entirely on locally controlled hardware using open-weight models (Whisper large-v3, Llama~3.1 8B) with no dependence on cloud APIs, ensuring predictable costs, full data privacy, and reproducibility independent of third-party services. We describe the design, implementation, and practical failure modes encountered when deploying 7--8 billion parameter models for structured extraction over long lecture transcripts, including context truncation, bimodal output distributions, and schema drift, along with the mitigations that resolved them.
