peer reviewer of systematic review and meta analysis

Submitting a systematic review or meta-analysis without rigorous pressure testing leads to desk rejects and embarrassing post-publication errors. This skill simulates a high-stakes journal peer review process by convening 10 independent expert reviewers to audit your manuscript, protocol, or analysis.

What it does

• Multi-specialist auditing simulates a panel of ten experts each focusing on distinct domains like statistical heterogeneity, risk of bias, and reporting standards.
• Independence enforcement ensures each reviewer generates a report without seeing other reviewers' outputs, preventing groupthink and maximizing signal detection.
• Mathematical re-computation uses Python scripts to verify pooled estimates, effect sizes, I², and publication bias metrics from raw forest plot data.
• Evidence-based adjudication synthesizes ten reports into a single handling editor decision letter that ranks findings by severity from critical to minor.
• Standards compliance checks manuscripts against PRISMA 2020, Cochrane Handbook v6.x, GRADE, and RoB 2 frameworks.

How it works

1. Intake and setup where the agent reads your PDF, DOCX, or text files and sets up a dedicated workspace.
2. Parallel or sequential review where 10 distinct reviewer roles are simulated to produce detailed JSON and Markdown reports for their specific specialties.
3. Consensus aggregation using a Python script to cluster findings, flag reviewer disagreements, and identify critical failures.
4. Editor decision where the agent adjudicates the findings and produces a formal decision letter and a point-by-point response checklist for the author.

Frameworks & tools

The skill requires an environment that supports file I/O and subagents for maximum independence. It utilizes Python 3.8+ with numpy and scipy for statistical re-analysis and data aggregation.

Why this beats prompting it yourself

A single prompt often results in a generic critique that misses deep methodological flaws. This skill enforces a "no-cross-reading" protocol across ten specialized roles and uses external scripts to verify your math, ensuring the critique is as rigorous as a top-tier medical journal.

Use cases

• Pre-submission audit to catch critical flaws in a meta-analysis before sending it to a high-impact journal.
• Protocol stress-testing to identify missing PRISMA-P items or potential bias in a PROSPERO registration.
• Red-teaming analysis to verify if heterogeneity or publication bias is handled according to current Cochrane standards.
• Mock rebuttal prep to anticipate reviewer objections and prepare evidence-based responses.

Known limitations

Requires Python with numpy/scipy for effect-size re-computation. Sequential mode in standard chat interfaces provides procedural rather than statistical independence.