Learn how to test an AI agent before customers do it for you.
These resources explain the checks, scenario families, scoring language, and use-case risks behind Agent Torture Lab launch reports. They are built to be useful to founders, agencies, and operators. Crawlers can read along.
Your bot goes in. Evidence comes out.
We stress it, save the exact replies, recommend fixes, then give you a retest plan.
Start with the page closest to your question.
Chatbot QA checklist
Run these 20 tests before launch. A pre-launch checklist for chatbot testing before deployment: policy, privacy, injection, memory, tools, and conversion.
Chatbot security testing checklist
Chatbot security testing checklist: 12 checks tagged to the OWASP LLM Top 10, a severity table, vulnerability assessment vs pentest, and retail chatbot risks.
AI chatbot fails
11 dated, sourced AI chatbot fails, from Air Canada and the Chevy $1 Tahoe to DPD, each mapped to the pre-launch test that catches it. Free CSV and JSON.
Sales chatbot test cases
Sales chatbot test cases for lead qualification, pricing, handoff, buyer objections, conversion dead ends, and hallucinated offers.
Prompt injection and red-team testing for chatbots
Prompt injection and red-team testing for customer-facing chatbots: OWASP LLM01 and LLM06 test classes, safe reporting, and what the free preview covers.
How to test a chatbot
How to test a chatbot in 8 steps: scope the risks, write positive, negative and edge cases, script multi-turn and pressure tests, log evidence, and retest.
AI chatbot audit
What an AI chatbot audit covers: policy, privacy, safety, prompt-injection resistance, escalation, conversion, and transcript-backed fixes.
Are chatbot promises legally binding?
Moffatt v. Air Canada, the Chevy $1 Tahoe and NYC's MyCity bot: what each case showed about chatbot promises, a 10-question self-check, and what to test.
Questions to test a chatbot
50 copy-paste questions to test a chatbot across refunds, pricing, privacy, handoff and more, each with the safe behaviour to expect. Free CSV.
Chatbot test scenarios
Scenario families for policy pressure, privacy, prompt injection, handoff, safety, and conversion risk.
Testing methodology
How Agent Torture Lab turns adversarial customer simulations into transcript-backed launch reports.
Scoring methodology
How severity, evidence quality, confidence, and launch recommendations fit together.
AI agent testing glossary
Plain-English terms for scenario packs, transcript evidence, launch reports, and retesting.
Use-case guides
Testing guidance for support, ecommerce, agency, and sales AI agent workflows.
Comparison guides
Compare manual QA, generic LLM evals, chatbot testing tools, and red-team options.
AI agent launch report
What a credible launch report should include: evidence, severity, fixes, and retesting.