Evaluation of the Australian Wage Subsidy Special Youth ...

Evaluation of the Australian Wage Subsidy Special Youth ... Evaluation of the Australian Wage Subsidy Special Youth ...

02.06.2014 Views

242 The magnitude of the employment effect falls, but only slightly. The dramatic changes to the statistical significance of the employment effect when CEP referrals is dropped might be attributed to the relatively large fall in the number of comparison cases used to match against the SYETP. This has a role in reducing the efficiency that in turn causes the fall in statistical significance. However, further discussion of the results is now deferred until after the estimation of a new specification. Table 7.5 Matching results, Single nearest neighbour with replacement, within caliper, weighting the propensity with combined weights: vary specification Match with caliper width 0.001 Original specification Match with caliper width 0.001 Original specification, Don’t include cep referrals Match with caliper width 0.001 New reduced specification Difference in employment 163 for 0.08 0.06 0.18 matched treated and comparisons t statistic 1.57 164 0.53 4.72** Total SYETP available 104 104 109 Number of SYETP matched 87 85 104 % SYETP matched 84% 82% 95% Number of comparison which satisfy 80 75 93 the caliper rule Number of times used 1 73 68 83 2 7 5 9 More than 2 2 1 Mean difference in propensity score 0.0002 0.0002 0.0002 between single nearest neighbour matched treated and comparisons Standard deviation 0.0002 0.0003 0.0002 Mean standardized bias 11.04 16.15 14.48 Common support cases dropped from syetp before matching 1 1 0 Number of observations 1283 1283 1389 Weighting protocol: weight propensity, weight the match using the treated weight only. The weighted mean bias is calculated using svymean in Stata. * significant at 10 % l.o.s., ** 5% l.o.s. 163 Ever employed in 1986 survey. 164 Probability of (0.22).

243 7.2.2 Propensity score matching and the effect of reduced specification Augurzky and Schmidt (2001) argue that although all available variables that rule the selection process are usually included in the participation equation, it may be better to remove variables of lesser importance from the specification. Their analysis showed that only including variables that were strongly significant could help combat the unnecessary effort of trying to balance these variables, which they found came at the expense of balance of the most relevant variables. In light of this, variables with low significance, or with only a theoretically minor role in employment, are candidates for exclusion from the probit for participation. Heckman, Ichimura and Todd (1997) also suggest that it is useful to compare the matching results from a reduced model of participation to that of the fuller model, in order to better assess the different approach to modelling entailed. In light of this a reduced specification of the probit for the propensity is proposed. The new matching results are shown in column 3 of Table 7.5, already shown. Only those variables with a potentially strong role in both employment and programme participation are included in the probit. Labour market outcomes for programmes are most often based on gender, age and unemployment experience which are included in the reduced model. The human capital effects of education, represented by highest qualification, and work experience are added. Marital status, children and partner’s labour market behaviour are included as variables that usually influence labour supply. Health, ethnicity and location are other factors commonly entered as constraints to labour supply or demand. The variation by location (state) was found to strongly influence SYETP participation [see section 2.2.6]. The rural/urban location is based on background prior to programme entry, retained from the former specification, because it is highly related to location in 1984 and later surveys. But this variable might act as a better instrument for the influences of personal background on labour market behaviour because location for young people is mostly due to parental choice. All of these variables form a subgroup of the fuller original specification. Note that CEP referrals is not included. Only one variable that was formerly statistically significant in the full model was excluded: nature of schooling (private, government, overseas, Roman Catholic). All other variables excluded from the reduced model were not statistically significant in the estimated probit.

242<br />

The magnitude <strong>of</strong> <strong>the</strong> employment effect falls, but only slightly. The dramatic changes to<br />

<strong>the</strong> statistical significance <strong>of</strong> <strong>the</strong> employment effect when CEP referrals is dropped might<br />

be attributed to <strong>the</strong> relatively large fall in <strong>the</strong> number <strong>of</strong> comparison cases used to match<br />

against <strong>the</strong> SYETP. This has a role in reducing <strong>the</strong> efficiency that in turn causes <strong>the</strong> fall<br />

in statistical significance. However, fur<strong>the</strong>r discussion <strong>of</strong> <strong>the</strong> results is now deferred until<br />

after <strong>the</strong> estimation <strong>of</strong> a new specification.<br />

Table 7.5 Matching results, Single nearest neighbour with replacement, within caliper,<br />

weighting <strong>the</strong> propensity with combined weights: vary specification<br />

Match with<br />

caliper width<br />

0.001<br />

Original<br />

specification<br />

Match with<br />

caliper width<br />

0.001<br />

Original<br />

specification,<br />

Don’t include<br />

cep referrals<br />

Match with<br />

caliper width<br />

0.001<br />

New reduced<br />

specification<br />

Difference in employment 163 for 0.08 0.06 0.18<br />

matched treated and comparisons<br />

t statistic 1.57 164 0.53 4.72**<br />

Total SYETP available 104 104 109<br />

Number <strong>of</strong> SYETP matched 87 85 104<br />

% SYETP matched 84% 82% 95%<br />

Number <strong>of</strong> comparison which satisfy 80 75 93<br />

<strong>the</strong> caliper rule<br />

Number <strong>of</strong> times used<br />

1 73 68 83<br />

2 7 5 9<br />

More than 2 2 1<br />

Mean difference in propensity score 0.0002 0.0002 0.0002<br />

between single nearest neighbour<br />

matched treated and comparisons<br />

Standard deviation 0.0002 0.0003 0.0002<br />

Mean standardized bias 11.04 16.15 14.48<br />

Common support cases dropped from<br />

syetp before matching<br />

1 1 0<br />

Number <strong>of</strong> observations 1283 1283 1389<br />

Weighting protocol: weight propensity, weight <strong>the</strong> match using <strong>the</strong> treated weight only. The weighted mean<br />

bias is calculated using svymean in Stata. * significant at 10 % l.o.s., ** 5% l.o.s.<br />

163 Ever employed in 1986 survey.<br />

164 Probability <strong>of</strong> (0.22).

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!