Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study re-evaluates a validated protocol for classifying open-ended teaching-evaluation feedback by applying it to updated representation methods and testing its transferability to English. The findings reveal that while a state-of-the-art model achieves the highest thematic F1 score on Spanish data, it does not outperform simpler models in sentiment classification, indicating that model selection is more about deployment context than inherent methodological superiority. The research underscores the protocol's durability across different linguistic contexts and representation advancements, making it a reliable tool for educational feedback analysis.
A cutting-edge model achieves top thematic classification scores but reveals that simpler models can match sentiment performance, challenging assumptions about the necessity of advanced embeddings.
Institutions collect far more open-ended teaching-evaluation feedback than they read. A prior study introduced a validated protocol for classifying such comments by thematic category and sentiment, built from a documented annotation guide, an intra-annotator reliability measurement, stratified cross-validation, and a held-out evaluation on a Spanish institutional corpus with a frozen-encoder design. Two questions limit its reuse: whether a protocol fixed to 2019-era frozen embeddings stays competitive as representation methods advance, and whether it transfers to a second language. We re-run it on the original Spanish data across three representation generations, sparse lexical features, frozen transformer embeddings, and prompted large language models, and transfer its sentiment task to English with a balanced 45,000-comment corpus checked against an aspect-labeled education dataset. Treating paired comparisons as descriptive, we find the protocol durable: a 2026 frontier model posts the highest thematic F1 on the hardest Spanish task, yet shows no sentiment advantage over a cheap model and no descriptive separation from it on English, so model choice is a deployment decision, not a property of the method.