Works with the AI tools you already use

    CClaude CodeCCursorCCodex CLIGGitHub CopilotGGemini CLIVVS CodeWWindsurf+15 more

    Psychometrician — Scale Development, Validation & Measurement

    by nSight Analytics

    1

    Turns your agent into a psychometrician that builds, validates, and troubleshoots measures — reliability, validity, factor analysis, IRT, and measurement invariance.

    Secure checkout via Stripe

    0 installsSecurity scanned

    See it in action

    You say

    My 12-item scale has Cronbach's alpha of .74, and my CFA has CFI = .91 and RMSEA = .09. Is the scale fine?

    Your agent does

    Not yet — two things to fix first. Reliability: alpha assumes equal loadings, which your CFA loadings probably violate, so report McDonald's omega with a confidence interval instead; if the scale is multidimensional, check omega-hierarchical and ECV before trusting a single total score. Fit: CFI = .91 and RMSEA = .09 both sit outside the usual guideline range (CFI around .95+, RMSEA around .06 or lower), so the model likely misfits — read the largest residual correlations and modification indices to see where, and if the items are ordinal, estimate with WLSMV on polychoric correlations rather than ML. Treat any respecification as exploratory and confirm it in a fresh sample.

    What you get

    Apply psychometric standards like McDonald's omega to scale validationDiagnose a badly fitting CFA — estimator, global vs. local fit, respecificationTest configural / metric / scalar invariance before comparing groups or time pointsLay out a validation plan for a new scale, from item pool to invariancePick the right reliability coefficient (omega variant, ICC model) and report it with a CIScreen for careless responding with pre-specified, multi-indicator rules

    About this skill

    A score is an inference about something you can't observe directly, and most measurement mistakes come from treating that inference as if it were the thing itself. This skill gives your agent a psychometrician's judgment for building measures that mean the same thing across people, groups, and time — and for deciding whether an existing measure is good enough for the use you're putting it to.

    The core frames validity as an argument, with reliability, dimensionality, and invariance as the evidence behind it. Five reference files go deep: reliability in all its forms (omega, ICC, generalizability theory, standard error of measurement), the five sources of validity evidence, factor analysis (EFA, CFA, ESEM, bifactor, network/EGA), item response theory and Rasch, measurement invariance and differential item functioning, and the full scale-development lifecycle with reporting standards.

    Use it to develop a new scale, validate or adapt an existing one, plan a reliability or invariance analysis, or work out why a factor model is fitting badly. It's calibrated to current practice — omega over alpha, fit indices as guidelines rather than gates, partial invariance and alignment when exact invariance fails — and it keeps cutoffs honest as context-dependent guidance. Includes a source-verified list of canonical references across every subfield it touches.

    Written for researchers, scale developers, assessment and I/O professionals, clinical and educational measurement teams, and graduate students.

    How to install

    Drop the file into your AI Agent. Works with Claude, Cursor, ChatGPT, and 20+ more.

    Reviews

    No reviews yet

    Be one of the first to try it. Every listed skill passes our trust checks below.

    Security scanned

    Passed our 8-point scan before listing

    Fresh listing

    Recently published to Agensi

    30-day refund

    Not a fit? Get your money back

    Trust & safety

    Security scanned

    Verified clean 19 days ago

    Listed19 days ago

    Creator

    Most agent skills come from someone who studies people, someone who knows the stats, or someone who can write the code. I'm all three. I'm Dr. Daniel Relihan, a social psychologist with fifteen years running experiments and turning human data into answers you can trust. Now I build the AI tools to match. That mix is the point: the psychology and the code don't fight each other, so the tool does its job and flags what it's unsure of instead of bluffing you. Two are live now. One gives your agent the judgment of a survey methodologist. The other, of a psychometrician: how to build a measure and design the evidence to validate it. More are coming. National study or one-person business, you get the same high scientific rigor. The methods behind it have gone into behavioral interventions used by millions, and I hold the smallest skill here to that bar. No hype, no hallucinations. Take a look, and check the work.

    Frequently Asked Questions

    Browse More Skills