Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study addresses the issue of cross-lingual factual inconsistency in Large Language Models (LLMs) by exploring inference-time interventions that align model outputs across different languages. Four strategies were evaluated, including zero-shot contextual steering, Contrastive Activation Addition (CAA), and Direct Preference Optimization (DPO), revealing that persona prompting was the most effective in maintaining factual accuracy while ensuring safety and generalization. The findings indicate that simpler contextual interventions can outperform more complex methods, suggesting that the inconsistency is primarily a selection issue rather than a fundamental limitation of the models.
Persona prompting outperforms complex interventions, revealing that cross-lingual factual inconsistency in LLMs is more about selection than inherent model limitations.
Although Large Language Models (LLMs) demonstrate remarkable multilingual fluency, their internal knowledge representations remain disproportionately biased toward high-resource languages. This leads to cross-lingual factual inconsistency, where they shift their empirical answer distributions based solely on the prompt language. We investigate whether these biases can be mitigated at inference time, forcing an English-prompted model to answer as if it were queried in target languages (German, Spanish, Bulgarian), and evaluate four intervention strategies: zero-shot contextual steering (persona prompting), internal representation manipulation via Contrastive Activation Addition (CAA), and lightweight weight modification via Direct Preference Optimization (DPO) trained on benchmark-derived factual data as well as conceptual generalization data. To assess alignment, we curate a multilingual factual dataset alongside a novel generalization benchmark comprising culturally rooted queries to determine whether factual interventions transfer to broader target-centric preferences. Experiments on Gemma 3 12B Instruct reveal persona prompting to be the strongest overall intervention, balancing efficacy, safety, and out-of-domain generalization. While CAA yields sharp inconsistency benchmark shifts, it is configuration-sensitive and risks knowledge degradation. DPO-based adapters offer permanent, yet narrower and less transferable gains. These findings suggest that cross-lingual inconsistency is at least partly a selection problem, and that simple contextual interventions may outperform more invasive methods for robust, transferable alignment.