Search papers, labs, and topics across Lattice.
This paper introduces Trait-Aware Policy Optimization (TAPO), a post-training framework designed to improve autoregressive multi-trait essay scoring by decomposing rewards along sample and trait dimensions. TAPO incorporates global scoring consistency, trait-level accuracy, format validity, and inter-trait dependency preservation into the reward function. Experiments demonstrate that TAPO consistently outperforms supervised fine-tuning and scalar-reward optimization baselines across multiple backbone models, highlighting its effectiveness and transferability.
Fine-grained control over reward signals unlocks significant gains in multi-trait essay scoring, outperforming standard policy optimization techniques.
Multi-trait essay scoring aims to provide fine-grained evaluation of writing quality across multiple dimensions. However, how to effectively post-train autoregressive scoring models remains underexplored. In this paper, we propose Trait-Aware Policy Optimization (TAPO), a post-training framework tailored to autoregressive multi-trait scoring. Our method decomposes rewards along both the sample and trait dimensions, combining global scoring consistency, trait-level accuracy, format validity, and inter-trait dependency preservation. In addition, we enhance supervised fine-tuning with enhanced prompts, allowing the model to internalize trait semantics before preference optimization. Experiments across multiple backbone models show that our method consistently improves multi-trait scoring performance over supervised fine-tuning and scalar-reward optimization baselines, demonstrating the effectiveness and transferability of trait-aware post-training for essay scoring.
