Search papers, labs, and topics across Lattice.
This paper investigates the emergence of dangerous tipping points in edge AI systems, where models running locally on devices can promote harmful content. It demonstrates that competition for attention between the conversation's context and competing output basins at the atomistic scale drives this tipping behavior. The authors derive a mathematical formula for the tipping point *n**, governed by dot-product competition, and validate it across multiple AI models, suggesting broad applicability for predicting and controlling harmful outputs.
A single mathematical formula can predict when edge AI systems will "tip" from safe to harmful outputs, offering new control levers for preemptive safety measures.
More than half the global population now carries devices that can run ChatGPT-like language models with no Internet connection and minimal safety oversight -- and hence the potential to promote self-harm, financial losses and extremism among other dangers. Existing safety tools either require cloud connectivity or discover failures only after harm has occurred. Here we show that a large class of potentially dangerous tipping originates at the atomistic scale in such edge AI due to competition for the machinery's attention. This yields a mathematical formula for the dynamical tipping point n*, governed by dot-product competition for attention between the conversation's context and competing output basins, that reveals new control levers. Validated against multiple AI models, the mechanism can be instantiated for different definitions of 'good' and 'bad' and hence in principle applies across domains (e.g. health, law, finance, defense), changing legal landscapes (e.g. EU, UK, US and state level), languages, and cultural settings.
