Search papers, labs, and topics across Lattice.
This paper introduces IntElicit, a framework designed to enhance the assessment of contextualized creativity through dialogue policy optimization. By utilizing a constrained adaptive AI interviewer that minimizes cognitive and agency confounders, IntElicit effectively encourages participants to engage in creative problem-solving without dictating responses. Experimental results demonstrate that this approach yields significantly improved creative outcomes compared to traditional expert-designed assessment methods, highlighting the importance of interactive elicitation in evaluating creativity in AI-mediated environments.
Interactive dialogue can unlock creative potential that static assessments overlook, leading to richer evaluations of creativity in AI contexts.
Contextualized assessment offers high ecological validity for evaluating creativity but introduces a critical challenge: observed performance may be confounded with cognitive proficiency (domain knowledge) and agency (willingness to engage). Meanwhile, in the age of generative AI, creative problem solving increasingly occurs in tool-mediated and human--AI interactive environments, making fully static assessment less aligned with contemporary creative practice. To address these issues, this paper proposes IntElicit, a framework for eliciting and assessing contextualized creativity via dialogue policy optimization. IntElicit functions as a constrained adaptive AI Interviewer: it provides non-directive knowledge and agency scaffolds in multi-turn interaction to reduce non-creative confounders, while preserving participants' responsibility for generating the creative content being evaluated. Specifically, to tackle sparse rewards and potential reward hacking (e.g., answer dictation) in open-ended educational dialogue, IntElicit introduces a decomposed process reward mechanism. This mechanism aligns the policy with pedagogical elicitation, rewarding prompts that draw out participant reasoning rather than producing optimal answers on their behalf. Extensive experiments, including participant simulation and a human subject study (N=64), show that IntElicit improves elicited creative outcomes over expert-designed baselines. Together, the results suggest that interactive elicitation can reveal creative potential that static FPSP-style assessment may miss, providing a formative and diagnostic lens for contextualized creativity assessment in AI-mediated learning contexts.
