16.05.2014 Views

Australia's Gambling Industries - Productivity Commission

Australia's Gambling Industries - Productivity Commission

Australia's Gambling Industries - Productivity Commission

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Respondent selection method<br />

A commonly used and recommended procedure for selecting individuals randomly<br />

within households is some variant of the birthday approach — such as the individual<br />

having the ‘nearest’ birthday or the ‘last’ birthday. For this survey, once a household<br />

was contacted, the respondent was selected randomly as the adult (aged 18 years or<br />

older) normally living in the household who had the last birthday.<br />

As advised by some of the survey consultants approached by the <strong>Commission</strong>, while<br />

the last birthday method is a rigorous method of respondent selection, it can have a<br />

limitation. If used on its own, without sufficient callbacks, it can result in an<br />

undersampling of younger people and an oversampling of older people, because<br />

younger people (especially younger males) are more often ‘not at home’ and<br />

therefore more difficult to contact. It is therefore important that survey protocols<br />

using the last birthday method also allow for a sufficiently large number of<br />

callbacks.<br />

One survey consultant (ACNielsen) noted that with a last birthday selection method,<br />

there will inevitably be some under-representation of young males, but that:<br />

In any case, the distortion can be corrected [by] age/gender weighting ... and while the<br />

extent of the need to correct a distortion with weighting will impact in terms of<br />

increasing the sampling error of any estimates from the sample, it is arguable that this<br />

increase in sampling error is still appreciably less than the increase in non-sampling<br />

error that comes from the non-response bias inherent in quota sampling systems<br />

(personal communication).<br />

ACNielsen also argued that from its experience, the last birthday method is<br />

preferable to alternatives such as Kish-grid type selection methods:<br />

... over a series of tests we conducted ... we found that anything approaching a Kishtype<br />

grid, or a last birthday method which started with asking the number of people in<br />

the household was ultimately unproductive, as refusals and mid-screening terminations<br />

increased, and overall the process slowed down interviewing significantly (personal<br />

communication).<br />

F.7 Quotas and weighting<br />

While the last birthday method of respondent selection coupled with an adequate<br />

number of callbacks should generate a sample that is generally random and<br />

representative, it is still likely that adjustments will be needed either by the use of<br />

quotas, or weighting or both. This study used an approach of:<br />

• having ‘strict’ quotas based on area (by state/territory and metropolitan/country),<br />

and ‘loose’ quotas based on age and gender; and<br />

F.20 GAMBLING

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!