Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the performance of a 2B parameter dialogue game agent in the LM Playschool Challenge, revealing that many failures stem from local decision-making issues rather than broad knowledge gaps. To address these challenges, the authors propose a three-step training recipe: acquiring game participation through supervised fine-tuning, repairing specific failures using targeted preference pairs, and preserving general capabilities across different dialogue contexts. The approach significantly enhances performance metrics, with clemscore improving from 10.67 to 38.92, while maintaining static performance levels, indicating effective targeted training strategies for small models.
Local decision failures, not just knowledge gaps, are the key to improving small-model dialogue agents, leading to a dramatic clemscore increase of over 200%.
Interactive dialogue games test a capability that static benchmarks largely leave implicit: a model must carry state across turns, interpret feedback, and choose valid actions under changing constraints. We study this setting in the LM Playschool Challenge with a 2B open-weight model, and find that many failures are not only broad knowledge failures but also local decision failures: repeated guesses, malformed actions, and violations of feedback that the model has just seen. These diagnostics motivate a training recipe organized around three steps: acquire broad game participation through supervised fine-tuning, repair mechanically verifiable failures within one targeted dialogue-game family using turn-local preference pairs, and preserve general capabilities beyond these dialogue games. In the official final evaluation, our submission improves public clemscore from 10.67 to 38.92 and closed in-domain score from 13.41 to 41.17, while approximately preserving aggregate static performance (44.14 vs. 44.24 for the baseline). Out-of-domain clemscore remains low at 7.88, with the largest gains concentrated in unseen variants of the targeted family. Our results suggest that broad SFT brings most of the model's capability improvement; turn-local supervision can be effective when failure detection is precise, with observed transfer concentrated primarily within-family.