Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a structure-aware retrieval-augmented generation (RAG) framework tailored for Bengali, leveraging hierarchical graph modeling of textbooks and a contrastively trained graph neural network for effective passage retrieval. By focusing on the hierarchical structure, the framework enhances the contextual relevance for large language models, facilitating the generation of topic-specific multiple-choice questions (MCQs) and improving answer prediction accuracy. Experimental results show significant improvements over traditional dense retrieval methods, highlighting the framework's effectiveness in a low-resource language setting.
Hierarchical modeling in RAG frameworks can drastically enhance MCQ generation and answer prediction in low-resource languages like Bengali.
Traditional retrieval-augmented generation (RAG) frameworks process documents without attending to their hierarchical structure, leading to poor performance, especially in low-resource languages such as Bengali. To address this, we propose a structure-aware RAG framework that models Bengali textbooks as hierarchical graphs and uses a contrastively trained graph neural network to retrieve a small set of relevant passages. These passages provide focused context for a large language model, enabling topic-specific multiple-choice question (MCQ) generation and in-domain answer prediction. Experimental results demonstrate that our framework outperforms strong dense retrieval baselines across retrieval metrics, produces more relevant MCQs, and achieves superior answer prediction accuracy.