Vulnerability Localization Benchmark: Measuring Agentic Security Analysis at Repository Scale
Language-model agents increasingly operate over complete software repositories, yet cybersecurity evaluations primarily measure whether they can detect, reproduce, or repair vulnerabilities rather than whether they can locate the relevant code. We study vulnerability localization: given a weakness class and an unfamiliar repository, identify the implementation files associated with that weakness.…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
