Search papers, labs, and topics across Lattice.
This study investigates the provenance of code snippets from human sources and large language models (LLMs) by analyzing 528 samples of security-sensitive programming tasks collected from Stack Overflow and various LLMs. The authors developed a reproducible pipeline that employs deterministic security and style detectors to classify the origin of code with 93% accuracy, revealing significant differences in security patterns adopted by human developers versus LLMs. Notably, while LLMs demonstrate a 77% success rate in repairing vulnerabilities, they often fail to implement the correct defenses after removing insecure patterns, highlighting critical gaps in model performance regarding security practices.
LLMs not only differ significantly from human developers in security practices but also struggle with effectively repairing vulnerabilities, raising concerns about their reliability in security-sensitive applications.
Developers now draw code from two very different sources, the accumulated human answers on sites such as Stack Overflow and the output of large language models. We ask two questions about that split. First, can the provenance of a code snippet be recovered from the code itself, and second, do the two sources differ in the security patterns they adopt for the same task. Using only open sources, a public gateway of open-weight language models and the public Stack Overflow API, we build a fully reproducible pipeline that collects real implementations of 31 security-sensitive programming tasks, among them OAuth with PKCE, JWT verification, password hashing, and SQL access, from 9 language models and from human answers, and scores every sample with deterministic security and style detectors. On 528 real samples we train a cross-validated classifier that recovers human versus model provenance with 93 percent accuracy against a 78 percent baseline, and a 7-way classifier that attributes a sample to the specific model that wrote it at 48 percent. We then report where the sources diverge on security, which patterns models adopt more often than the human corpus and which they inherit from it. Running the same tasks in Python, JavaScript, Go, and Java, we find the security divergence holds in every language while the provenance boundary is partly language-specific and does not transfer symmetrically between them. A vulnerability repair case study, in which models are handed insecure code and asked to fix it, finds a 77 percent repair rate across 21 seeds and 12 weakness classes, but a recurring partial-fix failure in which the model removes the insecure pattern without adding the correct defense. The pipeline is data driven, so any new task or language is added as a single specification entry, and a fail-closed checker re-derives every number in this paper from the stored data.
