Upjohn Institute working paper ; 20-324
The analysis compares estimates of the incremental impact for those who receive HPOG with a program enhancement to the standard HPOG program. The experimental benchmark for the incremental impact comes from two-stage least squares with random assignment as an instrumental variable for enhancement take-up. Then, ignoring the randomly assigned conditions, the analysis estimates the counterfactual for those who “take up” the enhancement using ordinary least squares and inverse propensity weighting. The analysis also tests whether adding information that is only available due to the experiment—who complied with their randomization status and who did not—improves the nonexperimental estimates. The analysis compares these estimates using statistical tests recommended by the within-study comparison literature.
The author gratefully acknowledges support from the Abt Associates Work in Progress Seminar and the W.E. Upjohn Institute for Employment Research through W.E. Upjohn Institute for Employment Research Early Career Research Grant No. 18-156-09. The Office of Planning, Research, and Evaluation (U.S. Department of Health and Human Services, Administration for Children and Families) provided access to study data.
Get in touch with the expert
Want to arrange to discuss this work with the author(s)? Contact our .
Litwok, Daniel. 2020. "Using Nonexperimental Methods to Address Noncompliance." Upjohn Institute Working Paper 20-324. Kalamazoo, MI: W.E. Upjohn Institute for Employment Research. https://doi.org/10.17848/wp20-324