Works with the AI Agents you already use
RAG Failure Diagnostics & Architect
This skill transforms your AI agent into a Retrieval Architect capable of diagnosing why RAG systems fail.
$7
RAG Failure Diagnostics & Architect
Example session with this skill installed
Our internal assistant (Pinecone, 512-token chunks, top-k 5, GPT-4o) answers "Which customers are still on the v1 pricing plan?" confidently with three names. The real list has eleven, and one of the three moved to v2 last quarter. Should we raise top-k or change the chunking?
- Read your context and instructions
- Compiled the rag failure diagnostics
Mode: DIAGNOSE. This is a structural miss, not a tuning problem. Raising top-k or re-chunking will not make the list complete or current.
Five-question triage
| # | Question | Answer for this query |
|---|---|---|
| 1 | Multi-hop? | No |
| 2 | Sequence or time? | Yes: "still on" needs the current plan, not any mention |
| 3 | Causation? | No |
| 4 | Aggregate or negative? | Yes: "which customers" is an exhaustive list |
| 5 | In the corpus, retrievable? | Probably yes, spread across many docs |
Failure pattern: rows "How many / which don't" (aggregation over top-k) and "Misses latest" (no temporal index). Top-k 5 can never return eleven customers, and similarity ranks an old "moved to v1" note as highly as the newer "moved to v2" note.
Fix
- Answer plan membership from a structured source: a
customer_plantable (customer_id, plan, effective_from, effective_to) fed by billing or CRM. - Add a router: list, count and "current state" questions go to SQL; "explain the v1 terms" questions stay on vector RAG.
- Have the model phrase the SQL result, not reconstruct it from chunks.
Honest effort
A router plus one typed table is moderate work. Tuning is the pragmatic choice only for single-passage lookups, which this query is not.
Next steps
- List your ten most common questions and tag each with its triage row.
- Confirm billing or CRM has plan history with dates.
- Keep this query as a regression test with the known answer of eleven.
Connects securely to your tools. The creator never sees your data.
About this skill
What it does
This skill transforms your AI agent into a Retrieval Architect capable of diagnosing why RAG systems fail. Instead of blindly tuning chunk sizes or embedding models, it analyzes whether a query's failure is structural (requiring a Knowledge Graph, temporal index, or structured query) or merely a tuning issue. It provides three specialized modes: DIAGNOSE to classify failing queries, ARCHITECT to design hybrid retrieval pipelines, and SCHEMA to build institutional memory layers that capture causal relationships vector search ignores.
Why use this skill
RAG systems often fail "quietly"—returning plausible but incorrect answers because vector search cannot handle multi-hop reasoning, temporal changes, or aggregations. This skill prevents the common mistake of over-indexing on semantic similarity. It helps developers move beyond basic vector stores to build sophisticated, production-ready context engines that understand "why" and "when," not just "what."
What it supports
- RAG & Vector DBs: Hybrid search, reranking, and chunking strategies.
- Knowledge Graphs: Designing GraphRAG architectures for multi-hop and causal reasoning.
- Hybrid Routers: Building logic to dispatch queries between SQL, Vector, and Graph stores.
- Metadata & Temporal Ops: Constructing schemas for event-sourced or time-aware retrieval.
Find more skills like this on the Claude Skills Marketplace, the Codex Skills Marketplace and the Gemini Skills Marketplace, or browse Claude Skills for LLM Ops.
- Does not provide code for specific database drivers.
- Cannot fix missing source data.
- Architectural advice requires human implementation.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before buying a skill.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
Fresh listing
Recently published to Agensi
Money-back guarantee
Doesn't do what its page promises? You get your money back.
Trust & safety
Security scan
Security scan passed 5 months ago
Permissions
No special permissions declared or detected