Works with the AI tools you already use
Test Flake Hunter
by Roy Yuen
Detect and analyze flaky tests across multiple frameworks with automated repeated execution and severity reporting.
Secure checkout via Stripe
See it in action
You say
I've noticed some intermittent failures in our authentication tests. Can you run the tests in tests/auth/ 20 times and tell me which ones are flaky?
Your agent does
Found 1 flaky test in tests/auth/:
- test_session_expiry: 14 passes, 6 failures (30% flake ratio). Severity: High. Suggested cause: Race condition in session cleanup timing. Detailed reports saved to flake-report.md and flake-report.json.
What you get
About this skill
What it does
Test Flake Hunter is a diagnostic tool designed to identify non-deterministic test failures. It automatically detects your testing framework—supporting pytest, Jest, and Go test—and executes your suite or specific test files multiple times to uncover "flaky" behavior. By comparing pass/fail patterns across runs, it calculates flake ratios and provides structured reports on test reliability.
Why use this skill
Manually re-running tests to catch intermittent failures is tedious and prone to human error. This skill automates the repetition, normalizes output from different runners, and applies severity scoring to help you prioritize fixes. It goes beyond simple "pass/fail" by analyzing error messages and execution patterns to suggest likely root causes, such as network timeouts or race conditions.
Supported Tools
- Python: pytest, py.test
- JavaScript/TypeScript: Jest
- Go: go test
- Generic: Any runner with standard exit codes via Makefile or custom commands
Output format
The skill produces two primary artifacts: a human-readable flake-report.md summary for quick review, and a structured flake-report.json for integration into CI/CD pipelines or further data analysis. Reports include flake ratios, failure message snippets, and suggested remediation steps.
How to install
Drop the file into your AI Agent. Works with Claude, Cursor, ChatGPT, and 20+ more.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill passes our trust checks below.
Security scanned
Passed our 8-point scan before listing
Fresh listing
Recently published to Agensi
30-day refund
Not a fit? Get your money back
Trust & safety
Security scanned
Verified clean 1 month ago
- 30-day refund guarantee
- One-time purchase, yours forever
- Secure checkout via Stripe
Creator
1075+ total installs · 111 skills on Agensi
Frequently Asked Questions
Popular in Testing & QA
api-contract-tester
Turn OpenAPI specs into exhaustive, framework-ready test suites covering happy paths, edge cases, and security gaps.
✅ AI Code Verification Gate
One-line summary description Stop your agent from claiming "done" before it's proven. A verification gate that classifies each change by risk (payment, auth, database, user-facing), picks the tests that actually cover it, demands evidence, maps regression risk, and outputs an honest pass/fail report. Turns "looks good to me" into "here's what I ran, and here's what's still unverified."
test-failure-analyzer
Automatically triage test failures, detect cascading root causes, and get prioritized fix suggestions across 10+ languages.
Unit & Integration Test Generator
Generate a real test suite for any function, module, or file — meaningful edge cases, error paths, boundary conditions, and proper mocks, not happy-path stubs. Detects your project's framework and conventions, plans the cases deliberately before writing, and hands back runnable tests plus a summary of what's covered. Built to write the tests that actually catch bugs.