Stress-test autonomous agents with adversarial scenarios, multi-turn simulations, and AI-powered evaluation.
Run normal, edge-case, and adversarial conversations against any agent endpoint.
Preflight CheckPreflight runs normal and adversarial conversations in parallel, then turns the transcripts into a reliability score and a failure report.
One endpoint and a short description. Preflight runs the conversations, scores the transcripts, and shows you what broke.
// spin up a pre-flight run in one call import { preflight } from "@pre-flight/check"; const report = await preflight({ endpoint: "https://agent.example.com/chat", description: "Support agent for booking and refunds", scenarios: ["normal", "edge", "prompt_injection"], judge: "gemma", }); // review the score, failure reasons, and transcripts console.log(report.score, report.failures, report.transcripts);
Submit the endpoint URL plus a short note about what the agent is meant to do.
Create normal, edge-case, ambiguity, prompt-injection, and attack-intent conversations.
Score each transcript, roll it into one reliability number, and export the failure report.
From a local demo to a private deployment, every plan gives you the same scoring pipeline.
A quick solo check for one agent endpoint and a clean score.
Run the full harness with shared reports for the team.
Self-hosted, single-tenant, and ready for private workflows.
Turn your agent into something you can measure before users do. Start with a demo run or wire it into CI.