Normal gains: estimators of learning rates in pretest-posttest settings.

Introduction: Nonlinear transformations of pretest and posttest scores are widely used in educational and psychological measurement to estimate group-level change, yet the statistical behavior of estimators derived from such transformations under measurement error remains poorly understood. We examine this problem in the context of normalized gains (ngains), a ratio-based transformation used to estimate group-level "learning rates" in pretest-posttest designs. Two standard estimation methods - the Methods: Using Classical Test Theory along with a rencently proposed statistical framework to analize ngains, we show that measurement error is one common cause behind both phenomena. Results: When measurement errors are absent, both Discussion: Such correlations may reflect insufficient instrument reliability rather than any inherent flaw in the transformation. These findings generalize beyond ngains: any nonlinear derived score computed from fallible instruments is susceptible to the same bias structure, and the analytical approach developed here offers a methodological template applicable to other ratio-based metrics in educational and psychological measurement. For applied researchers, we recommend computing both estimators and treating a large discrepancy as a warning sign, reporting instrument reliability alongside ngain estimates, and interpreting pretest-ngain correlations conditionally on reliability.