Search papers, labs, and topics across Lattice.
This paper introduces a Human-in/on-the-Loop (HiTL/HoTL) framework to improve the accessibility of LLM-generated text through iterative human guidance and post-generation review. The framework operationalizes user studies and accessibility standards into checklists, trigger rules for expert oversight, and accessibility KPIs. Results demonstrate that integrating human-centered mechanisms into both generation and evaluation leads to more transparent, reproducible, and inclusive NLP systems.
Human oversight can be systematically integrated into LLM-based text generation to improve accessibility, creating a traceable and auditable process.
Plain Language and Easy-to-Read formats in text simplification are essential for cognitive accessibility. Yet current automatic simplification and evaluation pipelines remain largely automated, metric-driven, and fail to reflect user comprehension or normative standards. This paper introduces a hybrid framework that explicitly integrates human participation into LLM-based accessible text generation. Human-in-the-Loop (HiTL) contributions guide adjustments during generation, while Human-on-the-Loop (HoTL) supervision ensures systematic post-generation review. Empirical evidence from user studies and annotated resources is operationalized into (i) checklists aligned with standards, (ii) Event-Condition-Action trigger rules for activating expert oversight, and (iii) accessibility Key Performance Indicators (KPIs). The framework shows how human-centered mechanisms can be encoded for evaluation and reused to provide structured feedback that improves model adaptation. By embedding the human role in both generation and supervision, it establishes a traceable, reproducible, and auditable process for creating and evaluating accessible texts. In doing so, it integrates explainability and ethical accountability as core design principles, contributing to more transparent and inclusive NLP systems.
