Search papers, labs, and topics across Lattice.
The paper introduces KIDBench, a new benchmark designed to evaluate the safety of LLMs when interacting with children aged 7-11, using a developmental-psychology-grounded rubric. They find that implicit cues suggesting a child speaker significantly improve safety scores, and explicit age instructions provide further gains, but safety varies across languages and cultural contexts. Multi-turn simulations reveal a degradation in child-facing response quality over time, highlighting the need for improved safety mechanisms.
LLMs can be tricked into unsafe responses to children, but even subtle cues about the user's age can dramatically improve safety.
Children increasingly have access to Large Language Models (LLMs), which may expose them to responses that are developmentally inappropriate or require age-sensitive safety, guidance, and boundaries. Existing LLM safety evaluations largely focus on harmful-content avoidance and do not explicitly target child-facing safety. We introduce KIDBench, a benchmark for evaluating child-facing LLM safety for ages 7--11 using a developmental-psychology-grounded LLM-as-a-Judge rubric. KIDBench contains realistic child queries across ten categories, with single-turn prompts and multi-turn child-actor simulations. We compare no-cues prompts with no child context, implicit-cues prompts that suggest a child speaker, and explicit age instructions. Implicit-cues improve scores by 9--47% across models, while explicit age adds a further 10--30% gain. Cross-lingual and cultural evaluations show uneven safety behavior across languages and country contexts. Multi-turn simulations show that child-facing response quality can degrade by 6--24% from the first to worst turn. Beyond evaluation, we introduce KIDGuardLlama, a child-safety evaluator, and KIDLlama, a child-oriented response model, showing how KIDBench supports safer child-facing AI
