Search papers, labs, and topics across Lattice.
This paper explores the use of steering vectors to exert control over language model behavior and introduces latent space-based model calibrators to enhance trust in their outputs. By analyzing the internal representations of large language models, the authors provide a framework for understanding how to manipulate these models effectively in high-stakes scenarios. The key finding is that these approaches significantly improve the reliability and interpretability of model outputs, addressing critical concerns about their deployment in real-world applications.
Steering vectors can transform how we control language models, paving the way for trustworthy AI interactions in high-stakes environments.
Language models have changed from unreliable text generators to highly-capable large models with trillions of parameters. Capability increases come hand-in-hand with increases in scale, making understanding the internal representations of models more challenging. Since millions of users increasing rely on language models to interact with external tools or make decisions in medium or high-stakes scenarios, we need to establish control over model behavior and know when to trust model outputs. In this paper, we discuss our contributions on harnessing the latent spaces by proposing steering vectors for control and developing latent space-based model calibrators for trust. Together, our contributions help demystify the latent spaces of language models and offer new insights into how to harness model internals to build more trustworthy language technology.
CMU ML