SOURCE-LINKED INTELLIGENCE

MobileCybench: Evaluating Agent Vulnerability Discovery via Executable Probes

arXiv · AI, language, vision and robotics · article · Sep 21, 2026 · UTC

AI agents now report vulnerabilities faster than maintainers can review them. Reports often depend on security properties specific to the application, and require considerable human labor to process. To mitigate this, we introduce a framework for evaluating vulnerability reports via probes, executable checks of security properties. A reported exploit is evaluated by replaying it against the application and running the probes: a triggered probe indicates both that the exploit succeeded and which security property it violated. As a probe encodes a security property rather than a known vulnerabil

Read original source ↗ Open in workspace

recordType

paper

region

Global