Search papers, labs, and topics across Lattice.
This study investigates the accessibility of parametric knowledge in Large Language Models (LLMs) across different languages, revealing that standard inference methods often fail to retrieve localized facts. By exploring cross-lingual prompting strategies, the authors identify four key dimensions that enhance knowledge transfer and factual recall across 17 diverse languages. The findings indicate that cross-lingual exploration not only improves knowledge retrieval but also enhances consistency beyond mere accuracy improvements, suggesting a more efficient approach compared to traditional native-language scaling.
Cross-lingual exploration can unlock hidden knowledge in LLMs, improving factual recall and consistency across 17 languages.
Parametric knowledge in Large Language Models is not equally accessible across languages. As a result, standard inference techniques often struggle to surface localized facts, leading to failures in cross-lingual knowledge transfer and consistency. In this work, we investigate techniques for accessing hidden factual knowledge by exploring cross-lingual prompting strategies. We identify four inherent dimensions of cross-lingual exploration that directly govern parametric knowledge retrieval and evaluate them on multilingual factual benchmarks covering 17 typologically diverse languages. Our results demonstrate that cross-lingual exploration significantly improves knowledge transfer and factual recall, representing a more efficient compute Pareto frontier than native-language scaling. Furthermore, we observe corresponding improvements in cross-lingual consistency, exceeding what can be explained by accuracy gains alone. Overall, our work establishes multilingual prompt exploration as a highly effective inference-time strategy for unlocking latent parametric knowledge.
Google Research
MIT CSAIL