Andy Handouyahia - Academia.edu (original) (raw)
Papers by Andy Handouyahia
Recent quasi-experimental evaluation of the Canadian Active Labour Market Policies (ALMP) by Huma... more Recent quasi-experimental evaluation of the Canadian Active Labour Market Policies (ALMP) by Human Resources and Skills Development Canada (HRSDC) has provided an opportunity to examine alternative methods to estimating the incremental effects of Employment Benefits and Support Measures (EBSMs) on program participants. The focus of this paper is to assess the efficiency and robustness of inverse probability weighting (IPW) relative to kernel matching (KM) in the estimation of program effects. To accomplish this objective, the authors compare pairs of 1,080 estimates, along with their associated standard errors, to assess which type of estimate is generally more efficient and robust. In the interest of practicality, the authors also document the computational time it took to produce the IPW and KM estimates, respectively. Keywords—Treatment effect, causal inference, observational studies, Propensity score based matching, Kernel Matching, Inverse Probability Weighting, Estimation meth...
In this paper, we discuss the impacts of Employment Benefit and Support Measures delivered in Can... more In this paper, we discuss the impacts of Employment Benefit and Support Measures delivered in Canada under the Labour Market Development Agreements. We use linked rich longitudinal administrative data covering all LMDA participants from 2002 to 2005. We Apply propensity score matching as in Blundell et al. (2002), Gerfin and Lechner (2002), and Sianesi (2004), and produced the national incremental impact estimates using difference-in-differences and Kernel Matching estimator (Heckman and Smith, 1999). The findings suggest that, both Employment Assistance Services and employment benefit such as Skills Development and Targeted Wage Subsidies had positive effects on earnings and employment.
Canadian Journal of Program Evaluation, Dec 4, 2017
This note describes how Employment and Social Development Canada evaluation staff transformed the... more This note describes how Employment and Social Development Canada evaluation staff transformed the Labour Market Development Agreement (LMDA) evaluation process to make it more timely, cost-effective, and relevant for policy development. The note provides background on the LMDAs and discusses key drivers for changing the evaluation approach. In particular, it describes the benefits of using small targeted studies, rich administrative panel data, and building in-house evaluation capacity. It concludes with some lessons learned for the evaluation practice.
Recent quasi-experimental evaluation of the Canadian Active Labour Market Policies (ALMP) by Huma... more Recent quasi-experimental evaluation of the Canadian Active Labour Market Policies (ALMP) by Human Resources and Skills Development Canada (HRSDC) has provided an opportunity to examine alternative methods to estimating the incremental effects of Employment Benefits and Support Measures (EBSMs) on program participants. The focus of this paper is to assess the efficiency and robustness of inverse probability weighting (IPW) relative to kernel matching (KM) in the estimation of program effects. To accomplish this objective, the authors compare pairs of 1,080 estimates, along with their associated standard errors, to assess which type of estimate is generally more efficient and robust. In the interest of practicality, the authors also document the computational time it took to produce the IPW and KM estimates, respectively. Keywords—Treatment effect, causal inference, observational studies, Propensity score based matching, Kernel Matching, Inverse Probability Weighting, Estimation meth...
In this paper, we discuss the impacts of Employment Benefit and Support Measures delivered in Can... more In this paper, we discuss the impacts of Employment Benefit and Support Measures delivered in Canada under the Labour Market Development Agreements. We use linked rich longitudinal administrative data covering all LMDA participants from 2002 to 2005. We Apply propensity score matching as in Blundell et al. (2002), Gerfin and Lechner (2002), and Sianesi (2004), and produced the national incremental impact estimates using difference-in-differences and Kernel Matching estimator (Heckman and Smith, 1999). The findings suggest that, both Employment Assistance Services and employment benefit such as Skills Development and Targeted Wage Subsidies had positive effects on earnings and employment.
Canadian Journal of Program Evaluation, Dec 4, 2017
This note describes how Employment and Social Development Canada evaluation staff transformed the... more This note describes how Employment and Social Development Canada evaluation staff transformed the Labour Market Development Agreement (LMDA) evaluation process to make it more timely, cost-effective, and relevant for policy development. The note provides background on the LMDAs and discusses key drivers for changing the evaluation approach. In particular, it describes the benefits of using small targeted studies, rich administrative panel data, and building in-house evaluation capacity. It concludes with some lessons learned for the evaluation practice.