Search papers, labs, and topics across Lattice.
This paper introduces a framework for controlling LLM-based conversational agents by incorporating ontological definitions of key conversational aspects as constraints. They fine-tune LLMs to generate content aligned with these constraints, focusing on English proficiency level and content polarity. Experiments across seven open-weight LLMs demonstrate that this ontology-driven approach consistently outperforms pre-trained baselines, even with smaller models, offering modularity and explainability.
Ontology-driven constraints unlock modular, explainable control over LLM conversations, enabling targeted fine-tuning for specific aspects like English proficiency or content polarity.
Conversational agents based on Large Language Models (LLMs) have recently emerged as powerful tools for human-computer interaction. Nevertheless, their black-box nature implies challenges in predictability and a lack of personalization, both of which can be addressed by controlled generation. This work proposes an end-to-end method to obtain modular and explainable control over LLM outputs through ontological definitions of aspects related to the conversation. Key aspects are modeled and used as constraints; we then further fine-tune the LLM to generate content accordingly. To validate our approach, we explore two tasks that tackle two key conversational aspects: the English proficiency level and the polarity profile of the content. Using a hybrid fine-tuning procedure on seven state-of-the-art, open-weight conversational LLMs, we show that our method consistently outperforms pre-trained baselines, even on smaller models. Beyond quantitative gains, the framework remains model-agnostic, lightweight, and interpretable, enabling reusable control strategies that can be extended to new domains and interaction goals. This approach enhances alignment with strategy instructions and demonstrates the effectiveness of ontology-driven control in conversational systems.
