Works with the AI tools you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+22 more

    Test Flake Hunter

    2

    Detect and analyze flaky tests across multiple frameworks with automated repeated execution and severity reporting.

    $7

    Secure checkout via Stripe

    30-day refund guarantee

    Converts to your local currency at checkout

    Security scanned
    test-flake-hunter

    test-flake-hunter

    Example session with this skill installed

    I've noticed some intermittent failures in our authentication tests. Can you run the tests in tests/auth/ 20 times and tell me which ones are flaky?

    • Read your context and instructions
    • Compiled the test-flake-hunter

    Found 1 flaky test in tests/auth/:

    • test_session_expiry: 14 passes, 6 failures (30% flake ratio).
      Severity: High.
      Suggested cause: Race condition in session cleanup timing.
      Detailed reports saved to flake-report.md and flake-report.json.
    Detailed reports saved to flake-report.md and flake-report.json

    Connects securely to your tools. The creator never sees your data.

    What you get

    Locate intermittent failures that pass on local but fail in CI pipelines.Quantify test reliability using flake ratios and severity classifications.Generate structured JSON reports of test stability for engineering dashboards.Debug race conditions by isolating and repeatedly running specific test files.

    About this skill

    What it does

    Test Flake Hunter is a diagnostic tool designed to identify non-deterministic test failures. It automatically detects your testing framework—supporting pytest, Jest, and Go test—and executes your suite or specific test files multiple times to uncover "flaky" behavior. By comparing pass/fail patterns across runs, it calculates flake ratios and provides structured reports on test reliability.

    Why use this skill

    Manually re-running tests to catch intermittent failures is tedious and prone to human error. This skill automates the repetition, normalizes output from different runners, and applies severity scoring to help you prioritize fixes. It goes beyond simple "pass/fail" by analyzing error messages and execution patterns to suggest likely root causes, such as network timeouts or race conditions.

    Supported Tools

    • Python: pytest, py.test
    • JavaScript/TypeScript: Jest
    • Go: go test
    • Generic: Any runner with standard exit codes via Makefile or custom commands

    Output format

    The skill produces two primary artifacts: a human-readable flake-report.md summary for quick review, and a structured flake-report.json for integration into CI/CD pipelines or further data analysis. Reports include flake ratios, failure message snippets, and suggested remediation steps.

    How to install

    Works the same in every agent - Claude, Cursor, Codex, Copilot and 20+ more.

    ~30 seconds
    1. 1

      Download the ZIP

      Free skills download straight away. Paid skills unlock right after purchase.

    2. 2

      Unzip into your skills folder

      Every agent reads skills from one folder on your machine. Drop the unzipped folder in there.

    3. 3

      Ask your agent to use it

      Restart the agent if it was already running. It picks the skill up automatically - no config needed.

    Skills folder by agent

    Click the path to copy it. Create the folder if it does not exist yet.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    30-day refund

    Not a fit? Get your money back

    Trust & safety

    Security scanned

    Verified clean 3 months ago

    • Passed all security checks, Safe to install

    Listed3 months ago

    What's inside

    Frequently Asked Questions