Search papers, labs, and topics across Lattice.
This paper introduces SteerWrite, a training-free framework that enables personalized co-writing with Large Language Models (LLMs) by allowing token-level steering without the need for gradient updates. The method addresses the limitations of conventional fine-tuning and retrieval-augmented generation, particularly in handling specialized domain knowledge and small datasets. Experimental results show that SteerWrite not only outperforms existing methods across various datasets and metrics but also significantly reduces the human editing effort required in the co-writing process.
SteerWrite achieves state-of-the-art performance in personalized co-writing without the overhead of training, revolutionizing how LLMs can be adapted to specialized domains.
While Large Language Models (LLMs) show great promise for personalization, they often lack specialized domain knowledge. Conventional solutions like fine-tuning struggle with high computational costs and rapid data updates, while Retrieval-Augmented Generation fails to provide fine-grained, token-level steering. Furthermore, chat-based interfaces remain dominant, whereas productive co-writing paradigms have not yet been well exploited beyond the coding domain. To this end, we introduce SteerWrite, a training-free framework designed for personalized co-writing. Our method effectively adapts the base model to specialized domains without gradient updates, with specific designs tailored to small datasets. Experiments demonstrate that SteerWrite achieves state-of-the-art performance across diverse datasets, metrics, and models, significantly reducing human editing effort.
Tsinghua AI