SAE Manual Sections 1 to 4_1 (May 06).pdf - National Statistical ...

SAE Manual Sections 1 to 4_1 (May 06).pdf - National Statistical ... SAE Manual Sections 1 to 4_1 (May 06).pdf - National Statistical ...

12.11.2014 Views

A Guide to Small Area Estimation - Version 1.1 05/05/2006 1.2 Background to the Small Area Practice Manual The small area practice manual project was developed to give a simple and clear guide of how to undertake small area estimation. The ABS has previously carried out a number of small area estimates projects (See Appendix 1). In recent years user demand for these kinds of statistics has increased. Most of this increase in demand has become apparent during specific consultations between the ABS and key government users to gauge and assess users’ medium and long term statistical data requirements. Consolidated examples of these can be found in the Information Development Plan (IDP) (ABS, 2005) (Catalogue 1362.0 to be released in early 2006) and State Statistical Priorities (ABS Corporate Information - State Statistical Forum 16 February 2005) This reflects the growing statistical sophistication of users. Also local government bodies such as cities, councils and shires are taking on a greater role in the long term planning and socio-economic development of their regions. This increase in demand for small area data is occurring globally. In response, more advanced methods for producing reliable small area statistics are being developed and are gaining methodological acceptance. This was recognised at an international conference held on small area statistics in Riga, Latvia in 1999 where the Deputy Australian Statistician encouraged National Statistical Organisations to make greater use of model-based methods to produce small area statistics (Trewin 1999). The paper also noted that explaining quality is an especially important issue for a National Statistics Office when producing these types of estimates and products. Various areas within the ABS have been involved in the provision of small area estimates to varying levels of sophistication in both the methods used and the quality of the estimates produced. Table A.1 of Appendix 1 contains a selection of the major pieces of small area work that have been conducted to date. In addition, there has been no definitive set of clear, ABS wide guidelines on how to assess the quality of small area estimates and what should be the agreed minimum level of quality required before releasing small area statistics to external clients. In other words, what needs to be developed is a cohesive, coordinated approach to the production of small area estimates. There is a strong need to set up a framework for the practice of small area estimation at all levels of involvement in the small area statistical process. These include client services areas in regional offices or Central Office (CO), Methodology Division, National Statistical Centres and senior managers responsible for clearing and releasing small area output. Such a framework is important for ensuring that consistent practices are used across the ABS in producing small area estimates and that these practices accord with best practices used both in the ABS and in statistical agencies overseas. Australian Bureau of Statistics 6

A Guide to Small Area Estimation - Version 1.1 05/05/2006 A consistent approach to the production of small area estimates is important for the following reasons: o o o o a need for the ABS to more precisely understand users' small area needs, ie how they utilise small area estimates in their decision making. Getting this right at the outset will ensure effort is efficiently directed to producing small area estimates that are fit for purpose. to ensure that small area estimates are produced with sufficient quality and are appropriate to user requirements. to ensure that users fully understand the assumptions and conditions underpinning output data and the fitness for use. to ensure small area estimation methodologies are sound, robust and practicable for a large range of small area estimation problems. Linked to this is the broader issue of the circumstances in which the ABS should or should not be producing small area estimates. These decisions need to be made by determining the risk that the provision of such data will detract from informed decision making. This manual has been prepared on the basis of work done on small area estimates of disability. Although the wording of the manual inadvertently reflects the context of a household based population survey, the small area methods described can also be applied to the context of economic/business collections. As further empirical studies are applied to other data contexts we anticipate that the manual will be expanded and adapted to include examples relating to economic data. 1.3 Purpose This volume of the manual, which is the first of two volumes, the second of which will contain a more technical treatment, aims to provide a simple non-technical guide on the production, uses, quality and validation of small area estimates. The intended audience includes survey practitioners, consultants, methodologists and users of small area data. The broad objectives of the Small Area Estimation Practice Manual are as follows: o o o o To build a stable bridge between the knowledge, the theory and the practice of small area estimation while taking account of ABS priorities and policies with regards to the production of small area statistics. This should result in a more consistent and quality assured approach to producing small area estimates within the ABS. To realise a quantum increase in the level of ABS knowledge and understanding of small area estimation techniques, how and under what conditions they can be applied, and how to measure or assess the quality of the small area estimates produced. To provide coherent, relevant, accurate and accessible information on small area estimation practices and techniques which are used regularly by their intended audiences and updated to reflect increases in knowledge and understanding. To ensure that practitioners within the ABS have a clear understanding of the quality and assumptions underpinning the small area estimates produced and that these are clearly communicated to users so that small area estimates are used appropriately and for the purposes intended. Intended audience Australian Bureau of Statistics 7

A Guide <strong>to</strong> Small Area Estimation - Version 1.1 05/05/20<strong>06</strong><br />

A consistent approach <strong>to</strong> the production of small area estimates is important for the<br />

following reasons:<br />

o<br />

o<br />

o<br />

o<br />

a need for the ABS <strong>to</strong> more precisely understand users' small area needs, ie how they<br />

utilise small area estimates in their decision making. Getting this right at the outset<br />

will ensure effort is efficiently directed <strong>to</strong> producing small area estimates that are fit<br />

for purpose.<br />

<strong>to</strong> ensure that small area estimates are produced with sufficient quality and are<br />

appropriate <strong>to</strong> user requirements.<br />

<strong>to</strong> ensure that users fully understand the assumptions and conditions underpinning<br />

output data and the fitness for use.<br />

<strong>to</strong> ensure small area estimation methodologies are sound, robust and practicable for<br />

a large range of small area estimation problems.<br />

Linked <strong>to</strong> this is the broader issue of the circumstances in which the ABS should or<br />

should not be producing small area estimates. These decisions need <strong>to</strong> be made by<br />

determining the risk that the provision of such data will detract from informed decision<br />

making.<br />

This manual has been prepared on the basis of work done on small area estimates of<br />

disability. Although the wording of the manual inadvertently reflects the context of a<br />

household based population survey, the small area methods described can also be<br />

applied <strong>to</strong> the context of economic/business collections. As further empirical studies are<br />

applied <strong>to</strong> other data contexts we anticipate that the manual will be expanded and<br />

adapted <strong>to</strong> include examples relating <strong>to</strong> economic data.<br />

1.3 Purpose<br />

This volume of the manual, which is the first of two volumes, the second of which will<br />

contain a more technical treatment, aims <strong>to</strong> provide a simple non-technical guide on the<br />

production, uses, quality and validation of small area estimates. The intended audience<br />

includes survey practitioners, consultants, methodologists and users of small area data.<br />

The broad objectives of the Small Area Estimation Practice <strong>Manual</strong> are as follows:<br />

o<br />

o<br />

o<br />

o<br />

To build a stable bridge between the knowledge, the theory and the practice of small<br />

area estimation while taking account of ABS priorities and policies with regards <strong>to</strong><br />

the production of small area statistics. This should result in a more consistent and<br />

quality assured approach <strong>to</strong> producing small area estimates within the ABS.<br />

To realise a quantum increase in the level of ABS knowledge and understanding of<br />

small area estimation techniques, how and under what conditions they can be<br />

applied, and how <strong>to</strong> measure or assess the quality of the small area estimates<br />

produced.<br />

To provide coherent, relevant, accurate and accessible information on small area<br />

estimation practices and techniques which are used regularly by their intended<br />

audiences and updated <strong>to</strong> reflect increases in knowledge and understanding.<br />

To ensure that practitioners within the ABS have a clear understanding of the quality<br />

and assumptions underpinning the small area estimates produced and that these are<br />

clearly communicated <strong>to</strong> users so that small area estimates are used appropriately<br />

and for the purposes intended.<br />

Intended audience<br />

Australian Bureau of Statistics 7

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!