Works with the AI Agents you already use
Context Fidelity Preflight — Prompt & RAG QA
Compare prompt, retrieval, or context-pruning changes against versioned, source-backed fixtures before release.
Free
Context Fidelity Preflight — Prompt & RAG QA
Example session with this skill installed
Illustrative request: “We shortened the context sent to our support agent. Compare it with the current version on six approved FAQ cases. Preserve cited policy facts and the JSON response contract. We have not connected a model runner yet.”
- Read your context and instructions
- Compiled the context fidelity preflight
Illustrative planning receipt; no model call or behavioral evaluation occurred.
Baseline version: supplied current context, to be hashed when available. Candidate version: proposed shortened context, also to be hashed. Fixture set: six approved FAQ questions, each with a stable ID, exact input, policy-corpus snapshot, expected facts or allowed uncertainty, citation rule, JSON fields, and severity. Answerable cases need exact passage anchors. For the corpus-silent case, record a negative retrieval or coverage check, expected uncertainty, and no supporting citation, so unsupported invention is visible. Keep the same model release, decoding settings, tools, and source snapshot for baseline and candidate. Declare the repeat count and failure thresholds before seeing candidate outputs; for stochastic responses, the default small check is at least three runs per version per fixture.
Run manifest: not available because no authorized model runner is connected. No raw outputs, citation matches, token counts, cost, or latency are reported. Behavioral verdict: HOLD / not run. The next proof is an approved runner plus answerable-case passage anchors, corpus-silent negative evidence, and comparable version settings; only then can paired results be recorded. This receipt does not describe a passed prompt, a measured saving, or a production outcome.
Connects securely to your tools. The creator never sees your data.
About this skill
A prompt edit or shorter agent context can look good in one answer while losing a fact, citation, or required output field elsewhere.
Context Fidelity Preflight compares a baseline and candidate using versioned cases with passage anchors for answerable questions, negative corpus evidence for unanswerable questions, and output or tool constraints. It keeps the model, settings, tools, and source corpus comparable, applies a declared repeat policy, and returns a receipt for fact and citation fidelity, schema failures, and measured cost or latency when available. The gate is PASS, REVISE, or HOLD.
Missing applicable source evidence or model runs produce HOLD / not run, never a hypothetical pass. The package includes no model provider, API key, or evaluation service. It does not promise hallucination-free answers, token savings, or production performance.
How to use
Skills on Agensi run inside your AI agent. Copy the prompt, paste it into your agent, and it connects to Agensi and installs this skill for you. If a payment is needed, your agent shows it to you first.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill passes our trust checks below.
Security scanned
Passed our 8-point scan before listing
Fresh listing
Recently published to Agensi
Free forever
No account required to browse
Trust & safety
Security scanned
Verified clean 5 days ago
- Free to download with an account