About AI Sec Bench

Published benchmarks of AI security tools, collected and compared.

What this site covers

AI Sec Bench aggregates published benchmark results for AI security tooling. It does not run its own test lab: it collects the numbers that vendors, academic groups and open-source maintainers have already published, records the conditions each result was produced under, and makes them comparable where the methodologies allow it.

• Published attack-success-rate and detection-rate figures
• Benchmark methodology and what each harness actually measures
• Reproducibility: what a published result does and does not prove
• Scanner and guardrail evaluations from primary sources
• Where benchmark numbers stop being comparable

19 articles are published so far. New ones are announced on the RSS feed.

How these articles are produced

Articles here are researched from primary sources: vendor and project documentation, published standards and specifications, research papers and preprints, and measurements published by whoever took them. Drafts are produced with AI assistance and then edited against those cited sources before anything is published.

No article on this site is based on first-hand testing in a private lab, and nothing here should be read as a measurement report of its own. Where a number appears, it comes from a source that is named, so you can check the original instead of taking this site's word for it.

Everything is published under a single editorial byline. That byline is a publishing identity for the site, not a claim about a named individual, and it does not carry professional credentials.

Corrections

Corrections are welcome. If something here is wrong, out of date, or attributed to the wrong source, email hello@aisecbench.com with the page address and what it should say. Substantive corrections are made in the article itself rather than quietly dropped.

How this site is funded

This site currently runs no affiliate links, sponsored posts, display advertising or paid placements. If that changes, the disclosure page will say so.

Contact

Email: hello@aisecbench.com
Site: aisecbench.com
Published by: AI Sec Bench Editorial

See also the privacy policy, the terms of use, and the editorial disclosure.