Search papers, labs, and topics across Lattice.
Delft University of Technology
2
1
4
6
The competition reveals that many LLM evaluations may be fundamentally flawed due to undetected data contamination, challenging the validity of current benchmarks.
LLM agents are surprisingly inept at Capture The Flag challenges, with even the best models only completing 35% of checkpoints, revealing a significant gap in their ability to perform realistic offensive security tasks.
