Search papers, labs, and topics across Lattice.
The paper introduces Co-Refine, an AI-augmented qualitative coding platform designed to detect temporal drift in code application during qualitative analysis. Co-Refine employs a three-stage pipeline: deterministic embedding-based metrics, LLM grounding within a narrow error bound of the deterministic scores, and code definition generation from past patterns. Results show that deterministic scoring can effectively constrain LLM outputs to provide reliable, real-time audit signals for qualitative analysis.
AI can now provide real-time feedback on coding consistency in qualitative research, previously a manual and drift-prone process.
Qualitative coding relies on a researcher's application of codes to textual data. As coding proceeds across large datasets, interpretations of codes often shift (temporal drift), reducing the credibility of the analysis. Existing Computer-Assisted Qualitative Data Analysis (CAQDAS) tools provide support for data management but offer no workflow for real-time detection of these drifts. We present Co-Refine, an AI-augmented qualitative coding platform that delivers continuous, grounded feedback on coding consistency without disrupting the researcher's workflow. The system employs a three-stage audit pipeline: Stage 1 computes deterministic embedding-based metrics for mathematical consistency; Stage 2 grounds LLM verdicts within $\pm0.15$ of the deterministic scores; and Stage 3 produces code definitions from previous patterns to create a deepening feedback loop. Co-Refine demonstrates that deterministic scoring can effectively constrain LLM outputs to produce reliable, real-time audit signals for qualitative analysis.
