Search papers, labs, and topics across Lattice.
This paper presents a novel method for steering neural network training using interpretable constraints derived from partial dependence, aimed at aligning model responses with domain-specific knowledge. The authors empirically validate their approach across various regression tasks, showing that models trained with these constraints outperform unconstrained counterparts in both performance and data efficiency. Importantly, the interpretations generated by the constrained models are consistent with user-provided knowledge, highlighting the effectiveness of explanation-guided learning in enhancing model interpretability.
Models trained with explanation-guided constraints not only outperform traditional approaches but also produce interpretations that align with expert knowledge, bridging the gap between model performance and interpretability.
Over the last few years, there has been an increased interest in making machine learning models more interpretable. Although a great deal of effort goes into developing techniques for interpreting the interactions learned by a given model, fewer studies focus on assessing the quality of such explanations. Even fewer focus on how to adjust the model to produce explanations faithful to prior knowledge, a process known as explanation-guided learning. Furthermore, most approaches in this area focus on classification problems and usually assume prior knowledge about which input features or regions are most important. In this work, we introduce a new approach to steering neural networks based on partial dependence, such that their average response to certain features aligns with specific functional domain knowledge about the problem. We empirically demonstrate on a range of regression problems, including dynamical systems forecasting, that models whose training has been controlled using our method perform better than unconstrained models and are more data-efficient. Moreover, we highlight that interpretations obtained from the former actually align with the user-provided knowledge, whereas those obtained from the latter do not.
