Volume 22, Number 2 (Spring) 1987
Fraker, Thomas and Rebecca Maynard. 1987. "The Adequacy of Comparison Group Designs for Evaluations of Employment-Related Programs." Journal of Human Resources 22(2):194-227.
This study investigates empirically the strengths and limitations of using experimental versus nonexperimental designs for evaluating employment and training programs. The assessment involves comparing results from an experimental-design study-the National Supported Work Demonstration-with the estimated impacts of Supported Work based on analyses using comparison groups constructed from the Current Population Surveys. The results indicate that nonexperimental designs cannot be relied on to estimate the effectiveness of employment programs. Impact estimates tend to be sensitive both to the comparison group construction methodology and to the analytic model used. There is currently no way a priori to ensure that the results of comparison group studies will be valid indicators of the program impacts.
Fraker is a senior economist and Maynard is vice president of Mathematica Policy Research, Inc. They are grateful to Robinson Hollister and an anonymous referee for very helpful comments on an earlier version of this paper. This paper is based, in part, on research funded under U.S. Department of Labor contract number 20-11-82-15. However, this paper does not necessarily represent the official opinion or policy of the Department of Labor.
© 2002 by the Board of Regents of the University of Wisconsin System
US ISSN 0022-166X