Sensitivity Testing of Net Impact Estimates of Workforce Development Programs Using Administrative Data

Authors

Kevin M. Hollenbeck, W.E. Upjohn Institute for Employment ResearchFollow

Publication Date

2-1-2008

Series

Upjohn Institute Working Paper No. 08-139

DOI

10.17848/wp08-139

Abstract

This paper addresses the question of whether administrative data sources, such as performance monitoring data, can be used for program evaluation purposes. It argues that under certain circumstances, such data can be used. In particular, program performance data that are routinely gathered and monitored by administrators of many workforce development programs meet these circumstances. The paper goes on to demonstrate the point by using administrative data from the state of Washington to examine the net impact on earnings and employment of services provided to adults under the Workforce Investment Act (WIA). Because of a lack of consensus about appropriate net impact estimators, the strategy of this paper is to examine the sensitivity of the results to various estimation techniques. The paper describes the various estimation techniques, and it summarizes the net impact estimates that are generated for the State of Washington. For the most part, the results are fairly stable across the techniques, which the paper argues adds a degree of confidence in them. The final section of the paper offers guidance to policymakers and program administrators who may not be familiar with the technical details of various analytical approaches about how empirical results that may appear to be complex or unstable can be used for program improvement.

Issue Date

February 2008

Note

Revised version of a paper presented at the 3rd Annual IZA Conference on the Evaluation of Labor Market Programs, at IZA, Bonn, on October 19, 2007; Paper draws on results presented at the 2004 National Workforce Investment Research Colloquium, sponsored by the U.S. Dept. of Labor, Employment and Training Administration, Arlington, VA: May 2004; supported by the U.S. Dept. of Labor

Subject Areas

WORKFORCE DEVELOPMENT; Public training programs; WIA, JTPA, and CETA