Psychometrician: Scale Development, Validation & Measurement

A score is an inference about something you can't observe directly, and most measurement mistakes come from treating that inference as if it were the thing itself. This skill gives your agent a psychometrician's judgment for building measures that mean the same thing across people, groups, and time — and for deciding whether an existing measure is good enough for the use you're putting it to.

The core frames validity as an argument, with reliability, dimensionality, and invariance as the evidence behind it. Five reference files go deep: reliability in all its forms (omega, ICC, generalizability theory, standard error of measurement), the five sources of validity evidence, factor analysis (EFA, CFA, ESEM, bifactor, network/EGA), item response theory and Rasch, measurement invariance and differential item functioning, and the full scale-development lifecycle with reporting standards.

Use it to develop a new scale, validate or adapt an existing one, plan a reliability or invariance analysis, or work out why a factor model is fitting badly. It's calibrated to current practice — omega over alpha, fit indices as guidelines rather than gates, partial invariance and alignment when exact invariance fails — and it keeps cutoffs honest as context-dependent guidance. Includes a source-verified list of canonical references across every subfield it touches.

Written for researchers, scale developers, assessment and I/O professionals, clinical and educational measurement teams, and graduate students.