- Home
- Skills
- Research & Analysis
- Evidence Synthesis Traceability & Extraction QA
Evidence Synthesis Traceability & Extraction QA
Generates source-traceable evidence matrices and extraction QA reports from research papers and technical documents.
Free
Works with the AI Agents you already use
Evidence Synthesis Traceability & Extraction QA
Example session with this skill installed
Run an extraction on the three PDFs in /papers using the intervention-schema.md. Identify any conflicting values between reports and prepare an adjudication queue for the primary investigator.
- Read your context and instructions
- Compiled the evidence synthesis traceability
- Generated the data export
I have completed the extraction for the three papers in the /papers directory. The extraction followed the intervention-schema.md protocol, identifying one potential study duplication and two conflicting outcome values.
Evidence Synthesis Package
Manifest Summary
| File | Status | Page Count | Extraction Mode |
|---|---|---|---|
| smith_2023_primary.pdf | Success | 14 | pdf-text |
| smith_2023_appendix.pdf | Success | 5 | pdf-text |
| jones_2022_pilot.pdf | Success | 8 | pdf-text |
Evidence Matrix (Excerpt)
| Study ID | Field | Value | Status | Anchor |
|---|---|---|---|---|
| SMITH-23 | Sample Size | 450 | reported | p. 4, Table 1 |
| SMITH-23 | Intervention | CBT-i | reported | p. 2, Methods |
| JONES-22 | Sample Size | 42 | reported | p. 3, para. 2 |
| JONES-22 | Mean Outcome | 12.4 | conflicting | p. 5, Table 2 |
Adjudication Queue
| Ref ID | Field | Value A (Anchor) | Value B (Anchor) | Conflict Type |
|---|---|---|---|---|
| ADJ-001 | Mean Outcome | 12.4 (Table 2) | 12.8 (Results text) | Within-report discordance |
| ADJ-002 | Study Identity | SMITH-23 Primary | SMITH-23 Appendix | Potential companion reports |
Next steps
- Review the
adjudication-queue.csvto resolve the mean outcome discrepancy for JONES-22. - Confirm the study family link between the Smith 2023 primary paper and its appendix.
- Inspect
qa-report.mdfor a full breakdown ofnot_reportedfields across the corpus.
smith_2023_primary.pdf
CSV · data export
Example file from a real run - the skill writes it into your workspace.
Connects securely to your tools. The creator never sees your data.
About this skill
Extracting intervention and outcome data from academic papers or technical reports often results in "black box" summaries that hide uncertainty and lack traceability. This skill solves the trust problem in evidence synthesis by generating a source-traceable evidence matrix where every cell is anchored to a specific page, table, or quote.
What it does
- Anchor-backed extraction ensures every data point includes a source ID and precise location (page, section, or figure).
- Status-aware logging preserves explicit states like
not_reported,unclear, orconflictinginstead of using blanks or zeros. - Conflict adjudication flags disagreements between independent extraction passes or companion reports for human review.
- Duplicate detection links related reports via DOI, registry IDs, and recruitment periods to prevent double-counting.
- Automated QA validation runs integrity checks on sample sizes, units, and effect estimates to catch extraction errors.
How it works
- Initialize scope by defining the review question, target fields, and eligible source set in a formal extraction schema.
- Inventory sources using
scripts/manifest.pyto generate a file manifest with SHA-256 hashes and page counts. - Execute extraction in
pdf-text,ocr-review, orstructured-recordsmode depending on the source material quality. - Generate QA package including the evidence matrix, data dictionary, adjudication queue, and reproducibility manifest.
Frameworks & tools
The skill utilizes Python scripts for manifest generation and matrix validation (scripts/manifest.py, scripts/validate_matrix.py). It produces standard outputs in Markdown, CSV, and XLSX formats, following structured schemas defined in YAML.
Why this beats prompting it yourself
Standard prompts often hallucinate missing values or guess at sample sizes when data is ambiguous. This skill enforces a "fail-closed" logic that requires a specific evidence anchor for every populated cell, making the output audit-ready and reproducible.
Use cases
- Systematic reviews to build a first-pass extraction matrix for intervention and outcome data.
- Technical audits to reconcile independent extractions and flag discrepancies for a senior reviewer.
- Evidence mapping to identify gaps in reporting across a corpus of clinical or technical papers.
- Data cleaning to link companion reports and companion registry entries into a single study family.
Known limitations
Does not perform clinical interpretation, meta-analysis, or risk-of-bias certification. Requires expert review for all interpretation and sign-off. Source files must be text-readable or OCR-ready.
Find more skills like this on the Claude Skills Marketplace, the Codex Skills Marketplace and the Gemini Skills Marketplace, or browse Claude Skills for Research & Analysis.
Requires expert review for interpretations. Not for clinical sign-off or meta-analysis. Page anchors depend on source document formatting.
How to use
- 1
Connect your agent to the Agensi MCP
Copy the prompt and paste it into Claude, ChatGPT, Cursor or any agent that supports MCP. It sets up the connection for you. Manual setup
- 2
Sign in to Agensi
Your agent shows a sign-in link. Sign in and click Allow.
- 3
Ask for what you need
Your agent loads this skill and uses it on your task. It always asks before buying a skill.
Reviews
No reviews yet
Be one of the first to try it. Every listed skill goes through the trust checks below.
Security scanned
Checked by our 8-point scan before listing
1 use
Times used to date
Free to use
No account required to browse
Trust & safety
Security scan
Security scan passed 27 days ago
- Free with an Agensi account