Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of detecting knowledge inconsistencies across text, tables, and knowledge graphs by introducing a taxonomy of cross-modal knowledge inconsistencies and presenting Kontrast, an automatic framework that utilizes Text-to-SPARQL and LLM reasoning for systematic comparison. The study reveals that such inconsistencies are prevalent and informative, highlighting not only direct knowledge conflicts but also issues like missing KG structure and temporal discrepancies. The findings underscore the potential for text, tables, and KGs to complement and correct each other, paving the way for improved knowledge auditing practices.
Cross-modal knowledge inconsistencies are not just errors; they expose critical gaps in knowledge graphs and reveal temporal mismatches that can enhance our understanding of information integrity.
Wikipedia and Wikidata are widely used for information access, LLM pre-training, and retrieval-augmented generation. Their knowledge is deeply connected but scattered across text, tables, and knowledge graphs. This raises a practical question: when these modalities disagree, how can we detect and explain the conflict? We study this problem as modality-level inconsistency detection. We first introduce a taxonomy of cross-modal knowledge inconsistencies, covering information granularity differences, direct conflicts, temporal changes, and KG incompleteness. We then present Kontrast, an automatic framework that uses Text-to-SPARQL and LLM reasoning to compare table-based answers with KG evidence and categorize the resulting inconsistencies. Experiments on various Table-QA datasets show that cross-modal inconsistencies are common and informative. They reveal not only true knowledge conflicts, but also missing KG structure and temporal mismatches while being limited by Text-to-SPARQL errors and noise. Our analysis shows that text, tables, and KGs can complement and correct one another through systematic comparison. Kontrast provides a practical tool for large-scale knowledge auditing and establishes a benchmark for future work on cross-modal knowledge consistency. Code and data are available at https://github.com/ECLADATTA/KONTRAST.