Comparing N = 1 effect size indices in presence of autocorrelation

Abstract

Generalization from single-case designs can be achieved by means of replicating individual studies across different experimental units and settings. When replications are available, their findings can be summarized using effect size measurements and integrated through meta-analyses. Several procedures are available for quantifying the magnitude of treatment"s effect in N = 1 designs and some of them are studied in the current paper. Monte Carlo simulations were employed to generate different data patterns (trend, level change, slope change). The experimental conditions simulated were defined by the degrees of serial dependence and phases" length. Out of all the effect size indices studied, the Percent of nonoverlapping data and standardized mean difference proved to be less affected by autocorrelation and perform better for shorter data series. The regression-based procedures proposed specifically for single-case designs did not differentiate between data patterns as well as simpler indices.