- Home
- Skills
- Agents & Orchestration
- Training Pipeline Failure Forensics
Works with the AI tools you already use
Training Pipeline Failure Forensics
Rank evidence-backed causes of ML training crashes or silent degradation, then design the cheapest discriminating test and minimal reproduction.
$19.99
Training Pipeline Failure Forensics
Example session with this skill installed
A nightly training job still completes, but validation MAE increased from about 6.2 to 9.8 after a warehouse schema migration. Join-step row counts doubled for one day, dependencies are loosely pinned, and the last code merge was three weeks earlier. Build an evidence-ranked RCA and the smallest test that separates the leading causes.
- Read your context and instructions
- Compiled the training pipeline failure
ARTIFACT: TRAINING-FAILURE-RCA
MODE: FORENSICS
SURFACE: SILENT DEGRADATION
-
Data contract / leakage — Highly likely
Evidence: one-day join fan-out aligned with the schema migration; duplicates may persist in the rolling training window.
Cheapest test: count duplicate trip IDs in the affected join output. -
Dependency drift — Weak signal
Evidence: loose version pins keep it possible; timing is weaker.
Cheapest test: diff the last-good and current environment locks.
MINIMAL REPRODUCTION
Check the affected partition, deduplicate the window, retrain once with the same seed, and compare MAE.
BOUNDARY
The cause remains unconfirmed until a discriminating test passes.
Connects securely to your tools. The creator never sees your data.
What you get
About this skill
Turn a failed training run into a ranked investigation
Training failures appear in two forms: loud crashes and silent degradation. This skill separates the symptom from the cause, timelines what changed since the last good run, and tests six failure classes against supplied evidence.
What it produces
- A loud-versus-silent failure classification
- A change-set timeline across data, code, dependencies, infrastructure, configuration, and orchestration
- Ranked hypotheses with evidence for and against each one
- A confidence label and cheapest discriminating test per hypothesis
- A minimal reproduction path for the leading hypothesis
- A prevention line that can become a pipeline gate
Failure classes covered
Data-contract breaks, leakage, environment or dependency drift, resource and numerical failures, code defects, and orchestration faults.
Best for
- Training jobs that crash with partial logs
- Runs that complete but produce worse metrics
- Teams comparing the last good run with a failed one
- Reviewers who need a minimal test before authorizing a rerun
Boundaries
The skill ranks hypotheses; it does not prove causality, execute SQL or training jobs, repair code, access infrastructure, or guarantee that the leading hypothesis is correct. Confirmation requires the named discriminating test.
How to install
Works the same in every agent - Claude, Cursor, Codex, Copilot and 20+ more.
- 1
Download the ZIP
Free skills download straight away. Paid skills unlock right after purchase.
- 2
Unzip into your skills folder
Every agent reads skills from one folder on your machine. Drop the unzipped folder in there.
- 3
Ask your agent to use it
Restart the agent if it was already running. It picks the skill up automatically - no config needed.
Skills folder by agent
Click the path to copy it. Create the folder if it does not exist yet.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill passes our trust checks below.
Security scanned
Passed our 8-point scan before listing
Fresh listing
Recently published to Agensi
30-day refund
Not a fit? Get your money back
Trust & safety
Security scanned
Verified clean 1 month ago
- Passed all security checks, Safe to install