Search papers, labs, and topics across Lattice.
This paper introduces LLM-guided evolutionary computation using OpenEvolve to optimize prompts for LLM-based password guessing, significantly improving cracking rates. They employ MAP-Elites quality-diversity search with an island population model to evolve prompts that maximize cracking rate on a RockYou-derived dataset. Experiments with Qwen3 8B, Gemini-2.5 Flash, and a frontier LLM ensemble show an increase in cracking rates from 2.02% to 8.48%, demonstrating the effectiveness of automated prompt evolution.
LLMs can crack 4x more passwords with automatically evolved prompts, revealing a significant vulnerability in password security.
Passwords still remain a dominant authentication method, yet their security is routinely subverted by predictable user choices and large-scale credential leaks. Automated password guessing is a key tool for stress-testing password policies and modeling attacker behavior. This paper applies LLM-driven evolutionary computation to automatically optimize prompts for the LLM password guessing framework. Using OpenEvolve, an open-source system combining MAP-Elites quality-diversity search with an island population model we evolve prompts that maximize cracking rate on a RockYou-derived test set. We evaluate three configurations: a local setup with Qwen3 8B, a single compact cloud model Gemini-2.5 Flash, and a two-model ensemble of frontier LLMs. The approach raises the cracking rates from 2.02\% to 8.48\%. Character distribution analysis further confirms how evolved prompts produce statistically more realistic passwords. Automated prompt evolution is a low-barrier yet effective way to strengthen LLM-based password auditing and underlining how attack pipelines show tendency via automated improvements.
