Benchmark Reference
OWASP LLM Top 10 Benchmark Mapping: What Tests Each Risk
Which public benchmarks and scanner probes test each OWASP LLM Top 10 2025 risk, where coverage is thin, and …
AI Sec Bench — Published benchmarks of AI security tools, collected and compared.
AI security tools, side by side.
Independent
Est. 2026
Est. 2026
Benchmark Methodology
RAID Benchmark AI Detector Results: What the Scores Mean
RAID scores AI-text detectors at a fixed 5% false-positive rate across 11 models and 11 attacks. What top scores mean and where they mislead.
Read the article →Latest reviews
AI Security
AI Jailbreak Benchmark Leaderboard: 2026 Results
Compare AI jailbreak benchmark results from FAR.AI, JailbreakBench, HarmBench, StrongREJECT, and MLCommons by…
Tool Comparisons
Prompt Injection Scanner Tools: Benchmarks & Evasion
How prompt injection scanners compare on published robustness and evasion benchmarks: cloud guardrails, Laker…
Tool Comparisons
AI Firewall Placement: Lakera, NeMo, Bedrock, Azure
Where Lakera Guard, NeMo Guardrails, Bedrock Guardrails, and Azure AI Content Safety sit in the LLM request p…
Benchmark Reference
10 AI and LLM Security Benchmarks Compared
Compare 10 AI security benchmarks for LLMs, agents, detectors, and software-security tasks, including their s…
Testing Guides
AI Security Testing: A Method for LLM and Agent Systems
AI security testing spans application, model, infrastructure, and data risks, with repeatable cases, calibrat…
Start here
The reference pages this site is built around, grouped by the question they answer.
Method
- AI security testing method
Scope an assessment across all four layers
- How to benchmark LLM security
Threat model, suite, pinned target, reported rate
- How to test AI agent security
Tool calls, memory, and inter-agent trust
Tool comparisons
- AI guardrail tools compared
Lakera, NeMo, Bedrock, Guardrails AI
- LLM red teaming tools compared
PyRIT, garak, Promptfoo and the test sets
- AI security tools directory
40 scanners, guardrails, and monitors
Benchmark reference
- AI security benchmark suites
What each public corpus measures, and where it stops
- AdvBench vs HarmBench vs JailbreakBench
Why the three are not interchangeable
Or start from a budget: the Scanner Tradeoff Explorer plots illustrative, editorially constructed operating curves (not measurements) against the detection, false-positive, latency and cost limits you set.
Independent, specialist, and free to read
AI Sec Bench publishes focused, sourced guides on a single topic. No paywall, no account, no ad tracking.
Subscribe
AI Sec Bench — in your inbox
Published benchmarks of AI security tools, collected and compared — delivered when there's something worth your inbox.
No spam. Unsubscribe anytime.