02.06.2014 Views

Evaluation of the Australian Wage Subsidy Special Youth ...

Evaluation of the Australian Wage Subsidy Special Youth ...

Evaluation of the Australian Wage Subsidy Special Youth ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

222<br />

7: Study 5 Sensitivity analysis<br />

In this chapter, <strong>the</strong> specifications modelled so far are fur<strong>the</strong>r investigated. Firstly,<br />

specification <strong>of</strong> <strong>the</strong> Heckman bivariate probit is examined. As a part <strong>of</strong> this, a potential<br />

source <strong>of</strong> confounding for <strong>the</strong> results is initially considered. Then <strong>the</strong> reliance <strong>of</strong> <strong>the</strong><br />

exclusion restriction on <strong>the</strong> variable CEP referrals is explored. These analyses test some<br />

<strong>of</strong> <strong>the</strong> limitations <strong>of</strong> <strong>the</strong> Heckman bivariate probit modelling. The robustness <strong>of</strong> <strong>the</strong><br />

propensity score matching (PSM) is <strong>the</strong>n looked at by varying <strong>the</strong> specification <strong>of</strong> <strong>the</strong><br />

probit used to estimate <strong>the</strong> propensity. This explores <strong>the</strong> importance <strong>of</strong> <strong>the</strong><br />

parameterisation <strong>of</strong> <strong>the</strong> propensity to <strong>the</strong> measured employment outcome.<br />

7.1 Sensitivity <strong>of</strong> Heckman specification<br />

The Heckman modelling in Chapter 6, where weighting for attrition was applied, showed<br />

a big fall in <strong>the</strong> size <strong>of</strong> <strong>the</strong> SYETP coefficient and a dramatic loss <strong>of</strong> it’s statistical<br />

significance. Although <strong>the</strong> size <strong>of</strong> <strong>the</strong> probit coefficient is not directly interpretable, it<br />

does impact on <strong>the</strong> marginal effect calculable from <strong>the</strong> coefficient as a measure <strong>of</strong> <strong>the</strong><br />

employment impact <strong>of</strong> SYETP. Mostly <strong>the</strong> impact <strong>of</strong> weighting was not found to affect<br />

o<strong>the</strong>r coefficients, and where o<strong>the</strong>r coefficients were affected, <strong>the</strong> change was not so<br />

dramatic. The first sensitivity check examines a possible source <strong>of</strong> this effect.<br />

7.1.1 Potential heteroskedasticity<br />

It is <strong>of</strong> interest to briefly consider <strong>the</strong> possibility <strong>of</strong> one <strong>of</strong> <strong>the</strong> modelling assumptions<br />

being violated. One way <strong>of</strong> allowing for this is through considering <strong>the</strong> Huber-White<br />

variance estimation for <strong>the</strong> equation. The Huber-White estimates <strong>of</strong> variance 157 provide a<br />

more conservative estimate that can allow for potential heteroskedasticity <strong>of</strong> undefined<br />

form amongst <strong>the</strong> residuals. Homoskedasticity is <strong>the</strong> standard assumption in modelling,<br />

such that <strong>the</strong> disturbances have <strong>the</strong> same variance. The variance <strong>of</strong> each disturbance term<br />

conditional for <strong>the</strong> chosen values <strong>of</strong> <strong>the</strong> explanatory variables is constant.<br />

157 Also known as <strong>the</strong> ‘sandwich estimator <strong>of</strong> variance’, or ‘robust estimator <strong>of</strong> variance’, key recent<br />

development papers are White (1980) and White (1982).

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!