More screenshots

    Works with the AI tools you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseOpenClawOpenClaw+21 more

    Agent Evaluation & Regression Suite — Score Skills Before You Ship

    1

    Designs a scored eval suite for an AI agent or SKILL.md skill, measures trigger accuracy, catches regressions against a baseline, and issues a PASS / PASS-WITH-WARNINGS / FAIL release gate.

    $15

    Secure checkout via Stripe

    30-day refund guarantee

    Converts to your local currency at checkout

    Security scanned
    Agent Evaluation & Regression Suite — Score Skills Before You Ship

    Agent Evaluation & Regression Suite — Score Skills Before You Ship

    Example session with this skill installed

    Target: policy-changelog-brief
    Mode: Score + baseline v0.9
    13 cases run: E4 expert trigger FAIL (was pass), E9 partial, safety E12/E13 pass
    Ask: score, trigger metrics, regressions, release gate

    • Read your context and instructions
    • Compiled the agent evaluation

    Release gate: FAIL
    Weighted score: 89/100 (33/37)
    Trigger recall 75% · precision 100%
    Regression: E4 high (baseline pass → current fail) → forces FAIL
    Safety: no critical failures
    Next: fix E4 triggers + E9 Open questions; re-run before ship

    Connects securely to your tools. The creator never sees your data.

    What you get

    Pre-publish eval for a new SKILL.md before Agensi/GitHub releaseRegression check after a prompt or description changeMeasure trigger precision/recall on positive and negative promptsScore a batch of agent outputs against a fixed rubricGate a model upgrade (baseline vs new model run)

    About this skill

    The problem

    • Shipping agents on “I tried a few prompts and it looked fine” misses false triggers, edge failures, and silent regressions.
    • Prompt edits can break expert phrasings while happy paths still work.
    • Teams need a repeatable release gate — not a chat log.

    What it does

    • Design mode: builds structured eval cases (positive/negative triggers, functional, edge, safety) with assertions and weights.
    • Score mode: scores your execution results with a deterministic weighted formula.
    • Computes trigger recall and precision.
    • Diffs against a baseline to flag regressions.
    • Issues a release gate: PASS, PASS-WITH-WARNINGS, or FAIL (safety failures and high/critical regressions force FAIL).

    Frameworks & tools

    • Works for any SKILL.md skill or agent workflow you can describe and re-run.
    • Compatible with Claude Code, Cursor, Codex CLI, OpenClaw, and similar hosts.
    • No external eval SaaS required — suite + scores are documents and JSON you keep in-repo.

    Why this beats prompting it yourself

    • Case typology and coverage targets instead of ad-hoc examples.
    • Explicit weights and gate rules (including auto-FAIL on safety breaches).
    • Trigger metrics separate “does the job” from “fires on the right prompts.”
    • Baseline regression detection after prompt changes.
    • Anti-fabrication: Design mode never invents scores; Score mode only uses provided results.

    How to install

    Works the same in every agent - Claude, Cursor, Codex, Copilot and 20+ more.

    ~30 seconds
    1. 1

      Download the ZIP

      Free skills download straight away. Paid skills unlock right after purchase.

    2. 2

      Unzip into your skills folder

      Every agent reads skills from one folder on your machine. Drop the unzipped folder in there.

    3. 3

      Ask your agent to use it

      Restart the agent if it was already running. It picks the skill up automatically - no config needed.

    Skills folder by agent

    Click the path to copy it. Create the folder if it does not exist yet.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    30-day refund

    Not a fit? Get your money back

    Trust & safety

    Security scanned

    Verified clean 1 month ago

    • Passed all security checks, Safe to install

    Listed1 month ago

    What's inside

    Frequently Asked Questions