Works with the AI Agents you already use

    Claude CodeClaude CodeCursorCursorCodex CLICodex CLIMuseMuseDotsDots+22 more

    Context Fidelity Preflight — Prompt & RAG QA

    1

    Compare prompt, retrieval, or context-pruning changes against versioned, source-backed fixtures before release.

    Free

    Security scanned
    Context Fidelity Preflight — Prompt & RAG QA

    Context Fidelity Preflight — Prompt & RAG QA

    Example session with this skill installed

    Illustrative request: “We shortened the context sent to our support agent. Compare it with the current version on six approved FAQ cases. Preserve cited policy facts and the JSON response contract. We have not connected a model runner yet.”

    • Read your context and instructions
    • Compiled the context fidelity preflight

    Illustrative planning receipt; no model call or behavioral evaluation occurred.

    Baseline version: supplied current context, to be hashed when available. Candidate version: proposed shortened context, also to be hashed. Fixture set: six approved FAQ questions, each with a stable ID, exact input, policy-corpus snapshot, expected facts or allowed uncertainty, citation rule, JSON fields, and severity. Answerable cases need exact passage anchors. For the corpus-silent case, record a negative retrieval or coverage check, expected uncertainty, and no supporting citation, so unsupported invention is visible. Keep the same model release, decoding settings, tools, and source snapshot for baseline and candidate. Declare the repeat count and failure thresholds before seeing candidate outputs; for stochastic responses, the default small check is at least three runs per version per fixture.

    Run manifest: not available because no authorized model runner is connected. No raw outputs, citation matches, token counts, cost, or latency are reported. Behavioral verdict: HOLD / not run. The next proof is an approved runner plus answerable-case passage anchors, corpus-silent negative evidence, and comparable version settings; only then can paired results be recorded. This receipt does not describe a passed prompt, a measured saving, or a production outcome.

    Connects securely to your tools. The creator never sees your data.

    About this skill

    A prompt edit or shorter agent context can look good in one answer while losing a fact, citation, or required output field elsewhere.

    Context Fidelity Preflight compares a baseline and candidate using versioned cases with passage anchors for answerable questions, negative corpus evidence for unanswerable questions, and output or tool constraints. It keeps the model, settings, tools, and source corpus comparable, applies a declared repeat policy, and returns a receipt for fact and citation fidelity, schema failures, and measured cost or latency when available. The gate is PASS, REVISE, or HOLD.

    Missing applicable source evidence or model runs produce HOLD / not run, never a hypothetical pass. The package includes no model provider, API key, or evaluation service. It does not promise hallucination-free answers, token savings, or production performance.

    How to use

    Skills on Agensi run inside your AI agent. Copy the prompt, paste it into your agent, and it connects to Agensi and installs this skill for you. If a payment is needed, your agent shows it to you first.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    Free forever

    No account required to browse

    Trust & safety

    Security scanned

    Verified clean 5 days ago

    • Free to download with an account

    Listed5 days ago

    What's inside

    Frequently Asked Questions