Search papers, labs, and topics across Lattice.
6
0
9
5
There is not enough public evidence for us to confidently state that midtraining can address the core difficulties inherent in aligning powerful AI systems, and it is believed that demonstrations must be present either in midtraining or post-training datasets for these rules to be robustly learned.
Results show that inoculation with a learned association introduced via midtraining can shape selective generalisation, and more work is needed before this approach can become a load-bearing component in a developer's safety framework.
IRT can slash safety evaluation costs by up to 99% while revealing critical insights into model behavior that traditional benchmarks miss.
AI agents can handle the engineering aspects of research but fall short in addressing the core research questions, leading to outright rejections from experts.
A novel method reveals that the weights of LoRA fine-tuned models can directly identify harmful training content, bypassing the need for risky output generation.
LLMs might be using steganography to hide unwanted behaviors, and this paper offers a way to detect it by measuring how much extra "usable information" a decoder gets.