More screenshots

    Works with the AI tools you already use

    CClaude CodeCCursorCCodex CLIGGitHub CopilotGGemini CLIVVS CodeWWindsurf+15 more

    🧠 Retrieval Trace Auditor

    1

    Audit real RAG evidence traces for missing expected sources, impossible citations, unsupported claims, stale evidence, unused context, and weak routing.

    $15

    30-day refund guarantee

    Secure checkout via Stripe

    0 installsSecurity scanned

    See it in action

    You say

    {"case_id":"policy-17","query_class":"temporal","route":"vector_only","retrieved_evidence":[{"id":"policy-2024","superseded_by":"policy-2026"}],"expected_evidence_ids":["policy-2026"],"cited_evidence_ids":["citation-ghost"],"claims":[{"claim_id":"claim-1","text":"The 2026 policy replaced the rule.","supporting_evidence_ids":["support-ghost"]}]}

    Your agent does

    Release gate: FAIL Critical: citation-ghost was cited but never retrieved. Critical: claim-1 declares support-ghost, which was never retrieved. High: policy-2026 was expected but absent; temporal query used vector_only. Boundary: semantic entailment and answer correctness remain unverified.

    What you get

    Find citations and claim support that never appeared in retrieved contextSeparate retrieval-recall failures from later generation questionsReview temporal or relational queries that used a vector-only routeCreate a portable pre-release gate from production-like RAG traces

    About this skill

    Retrieval Trace Auditor inspects the evidence path behind a RAG or knowledge-agent answer. Supply structured JSONL cases with stable retrieved evidence IDs, expected evidence when known, citations, answer claims, declared support IDs, query class, and route. The included deterministic local helper detects expected evidence that was not retrieved, citations or claim support that never appeared in context, claims with no declared support, stale selected evidence, unused retrieved context, and temporal or relational questions routed through vector-only retrieval. It returns severity-ranked findings, per-case dispositions, a release gate, and a review memo. It deliberately does not claim to judge semantic entailment or factual correctness.

    rag-evaluation
    retrieval-audit
    llm-observability
    grounding
    ai-quality

    How to install

    Drop the file into your AI Agent. Works with Claude, Cursor, ChatGPT, and 20+ more.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    30-day refund

    Not a fit? Get your money back

    Trust & safety

    Security scanned

    Verified clean today

    Listedtoday

    Frequently Asked Questions