Search papers, labs, and topics across Lattice.
This study investigates how cultural cues influence language models' framework selection in the context of Islamic finance, introducing the concept of normative pluralism to differentiate between framework selection and correctness within those frameworks. The results show that cultural cues significantly affect the choice of framework, with large open-weight models selecting the Islamic framework 97% of the time, but revealing a high rate of incorrect answers (57-66%) within that framework. This highlights a critical stereotype trap where models are misled by cultural signals, leading to a mismatch between framework selection and the accuracy of responses, particularly in non-frontier models.
Cultural cues can mislead language models into choosing the wrong answers even when they select the correct normative framework, exposing a significant knowledge gap in AI systems.
When a question has valid answers under different normative frameworks, a language model must decide which framework to use and whether it can answer correctly within it. We call this setting normative pluralism and study it in Islamic finance using a four-choice taxonomy that separates framework selection from within-framework correctness. This separation reveals the stereotype trap: a cultural cue steers a model toward one framework, but the model selects an incorrect answer within that framework. Across twelve models, two languages, and fifty demographic signals, cultural cues change framework selection and reveal substantial differences in accuracy, especially among non-frontier models. Under the strongest signal, large open-weight models select the Islamic framework 97% of the time. A two-choice evaluation would report near-perfect alignment, although 57--66% of those selections are incorrect. These findings motivate, but do not directly test, the competence-conditioned routing hypothesis: models may favor frameworks where they are more accurate, while cultural cues may expose framework-specific competence gaps.
