agent eval coverage audit
by Roy Yuen
Audit your AI agent's evaluation coverage to identify missing release gates and production risks.
Ship better AI in 30 seconds. Browse 2,000+ expert-built and security scanned skills -> Browse skills
THE AGENSI STORE
4 skills found
by Roy Yuen
Audit your AI agent's evaluation coverage to identify missing release gates and production risks.
An adversarial gate that audits an AI eval or test suite — LLM-judge rubrics, datasets, regression tests, metrics — for gameable criteria, data leakage, missing edge cases, and non-determinism, then returns one PASS/REVISE/FAIL verdict.
by Indy Agent
Evaluate any feature request with structured scoring and a Build / Investigate / Defer / Decline decision.
Design and write the eval suite for your LLM-powered feature — the metrics that match your failure modes, a golden dataset plan with starter cases, anchored rubrics, LLM-as-judge prompts with the known bias mitigations, and pass/fail gates wired for CI.