Is headspace making a difference to young people’s lives?

Evaluation-of-headspace-program Evaluation-of-headspace-program

05.12.2016 Views

Appendix B of expansion. It is important to note here that the alternative models component represented by Part 3 has been provided in addition to the evaluation requirements. Further investigation would require separate project funding to complete if pursued externally to the Department or hNO. While the current model of expansion can be costed based on detailed information regarding current headspace grant funding and estimates of MBS contributions at a centre level being available to the evaluation team, costing alternative models requires additional information not provided for the evaluation. These alternative models of centre allocation propose the use of smaller sites and make use of different geographic boundaries. For example, spoke sites may be identified by a defined catchment area much smaller than the SA4/SA3 regions currently used; they are likely to have reduced service capacity, and may run on a part-time basis. There is no information on which to base the costing for these smaller or part-time sites which diverge from the traditional model. We lack enough cost information for such sites to make even indicative estimates, and attempting to do so with the information made available for this evaluation would risk misleading evaluation stakeholders and undermine the confidence of the public in the integrity of other results of the evaluation. In addition, the population size required to justify either a full or smaller headspace centre is unknown. The region which contains the smallest youth population and an existing headspace centre has a youth population of around 3,500 12-25 year olds. It is unknown whether this can be interpreted as a lower limit on efficient service provision, or whether smaller populations could support a centre. In addition, the upper service capacity is unknown and difficult to estimate. This is largely due to the paucity of information regarding additional, non-government funds and in-kind support provided to existing centres. These additional funds have the potential to substantially increase the capacity of a centre. Additional information regarding non-government funding input would provide insight into centre capacity. Further, the impact of smaller region sizes on the ability of the model to leverage off existing services and partners is not able to be evaluated but has significant implications for site allocation. The impact of competing and complementary services is unknown. This variable is likely to be evaluated in the current model within the ‘human intelligence’ component. This factor has substantial implications for service need and, as a result, likely centre allocation. This may have greater impact when region sizes are small. Additional information required to allow for robust estimates of costs of centre expansion under the alternative models include: • defined lower and upper bound on the population size of a region to allow for efficient centre allocation. This is closely related to centre service capacity. • costing information for smaller sites (e.g. part-time centres, centres with limited services) • information regarding alternative and complementary mental health services within in-scope areas. Conclusions Summary of factors for consideration in the future roll-out of headspace • flexibility in the headspace funding allocation to tailor allocation to relevant factors such as rurality, demand and service requirements • investigation of the use of alternatives to traditional sites. For example, hub and spoke sites, part-time or centres staffed by fly-in fly-out staff • potential use of alternative modes of service delivery such as online treatment methods • prioritisation of centre allocation based on direct measures of service need. The report provides a data driven approach to evaluation of the current model of centre expansion and the assumptions that underpin this model. It identifies weaknesses and proposes a number of alternative models of centre expansion, which alter components of the existing model with the aim Social Policy Research Centre 2015 headspace Evaluation Final Report 164

Appendix B of achieving more efficient and equitable mental health service delivery for young people across Australia. Limitations This analysis contains a number of limitations which should be considered when evaluating results. These relate to assumptions made in the evaluation and data limitations. A number of assumptions were made in the analysis, and the results of the evaluation should be interpreted in light of this. Firstly, the evaluation team was unable to take into account competing and complementary mental health services such as acute child and adolescent mental health services. These additional mental health services are likely to impact on the service requirements of headspace centres. These factors need to be considered in future centre allocation, but are beyond the scope of this analysis. A second assumption relates to the definition of access. Access was defined by geographical proximity and centre capacity alone. Additional factors may impact on youth access to service, but these were not explored in detail. Finally, the evaluation team were unable to account for changes in demand and spill-over effects with a large number of additional centres in relatively close proximity. There are a number of limitations of the data. Population estimates are based on 2011 Census data. There is likely to be some migration into and out of small areas. This will impact on estimates of population access. In addition, these changes are likely to impact on the demographic profiles of small areas and therefore small area estimates of mental health need. In addition, the reader should be cognisant of errors associated with modelling, including small area estimates of population mental health prevalence. Further, variables which are relevant to needs in the community were unable to be included in modelling as included variables are limited to those collected in the Census. The evaluation team were unable to cost alternative models and methods of service delivery that are outlined in the chapter. This is due to a lack of information to allow costing of alternatives, and in particular, the cost of alternatives to physical centres and full-time models of service delivery. Finally, the modelling did not take into account economies of scale. For example, savings in the hNO administration associated with expansion beyond the current centre allocation and economies of scale which may be associated with larger headspace centres in high need urban areas. In addition, the evaluation team were unable to evaluate factors such as greater clinical staff salaries in remote locations with small service populations. Overall outcomes of investigation into the headspace centre allocation models This section of the headspace evaluation has provided an analysis of centre expansion under the current model of headspace centre allocation, examined the effectiveness of the current model of centre allocation to provide youth access to services, and discussed alternative methods of achieving national coverage for headspace services. This has been completed in order to address the following two evaluation components: • Assessment of the overall cost-effectiveness of expanding headspace beyond 100 centres; and • Estimation of the maximum funding requirements for headspace to achieve national coverage. We remind readers that these components build on the preceding cost effectiveness section. In addressing both evaluation components shown above, the evaluation team used the following methodological and design features: • The analyses considered the costs and effects of headspace services in different geographical locations and the current geographic and demographic coverage of headspace. • The main metric used in considering the effects of headspace expansion was current and potential youth coverage of headspace. • We estimated the costs of national coverage using the current Departmental costing mechanisms for the establishment of headspace sites based on headspace grant funds and Social Policy Research Centre 2015 headspace Evaluation Final Report 165

Appendix B<br />

of achieving more efficient and equitable mental health service delivery for <strong>young</strong> people across<br />

Australia.<br />

Limitations<br />

This analysis contains a number of limitations which should be considered when evaluating results.<br />

These relate <strong>to</strong> assumptions made in the evaluation and data limitations.<br />

A number of assumptions were made in the analysis, and the results of the evaluation should be<br />

interpreted in light of this. Firstly, the evaluation team was unable <strong>to</strong> take in<strong>to</strong> account competing<br />

and complementary mental health services such as acute child and adolescent mental health<br />

services. These additional mental health services are likely <strong>to</strong> impact on the service requirements of<br />

<strong>headspace</strong> centres. These fac<strong>to</strong>rs need <strong>to</strong> be considered in future centre allocation, but are beyond<br />

the scope of this analysis. A second assumption relates <strong>to</strong> the definition of access. Access was<br />

defined by geographical proximity and centre capacity alone. Additional fac<strong>to</strong>rs may impact on youth<br />

access <strong>to</strong> service, but these were not explored in detail. Finally, the evaluation team were unable <strong>to</strong><br />

account for changes in demand and spill-over effects with a large number of additional centres in<br />

relatively close proximity.<br />

There are a number of limitations of the data. Population estimates are based on 2011 Census data.<br />

There is likely <strong>to</strong> be some migration in<strong>to</strong> and out of small areas. This will impact on estimates of<br />

population access. In addition, these changes are likely <strong>to</strong> impact on the demographic profiles of<br />

small areas and therefore small area estimates of mental health need. In addition, the reader should<br />

be cognisant of errors associated with modelling, including small area estimates of population mental<br />

health prevalence. Further, variables which are relevant <strong>to</strong> needs in the community were unable <strong>to</strong> be<br />

included in modelling as included variables are limited <strong>to</strong> those collected in the Census.<br />

The evaluation team were unable <strong>to</strong> cost alternative models and methods of service delivery that<br />

are outlined in the chapter. This is due <strong>to</strong> a lack of information <strong>to</strong> allow costing of alternatives, and in<br />

particular, the cost of alternatives <strong>to</strong> physical centres and full-time models of service delivery.<br />

Finally, the modelling did not take in<strong>to</strong> account economies of scale. For example, savings in the hNO<br />

administration associated with expansion beyond the current centre allocation and economies of<br />

scale which may be associated with larger <strong>headspace</strong> centres in high need urban areas. In addition,<br />

the evaluation team were unable <strong>to</strong> evaluate fac<strong>to</strong>rs such as greater clinical staff salaries in remote<br />

locations with small service populations.<br />

Overall outcomes of investigation in<strong>to</strong> the <strong>headspace</strong> centre allocation models<br />

This section of the <strong>headspace</strong> evaluation has provided an analysis of centre expansion under the<br />

current model of <strong>headspace</strong> centre allocation, examined the effectiveness of the current model of<br />

centre allocation <strong>to</strong> provide youth access <strong>to</strong> services, and discussed alternative methods of achieving<br />

national coverage for <strong>headspace</strong> services. This has been completed in order <strong>to</strong> address the following<br />

two evaluation components:<br />

• Assessment of the overall cost-effectiveness of expanding <strong>headspace</strong> beyond 100 centres;<br />

and<br />

• Estimation of the maximum funding requirements for <strong>headspace</strong> <strong>to</strong> achieve national<br />

coverage.<br />

We remind readers that these components build on the preceding cost effectiveness section. In<br />

addressing both evaluation components shown above, the evaluation team used the following<br />

methodological and design features:<br />

• The analyses considered the costs and effects of <strong>headspace</strong> services in different<br />

geographical locations and the current geographic and demographic coverage of<br />

<strong>headspace</strong>.<br />

• The main metric used in considering the effects of <strong>headspace</strong> expansion was current and<br />

potential youth coverage of <strong>headspace</strong>.<br />

• We estimated the costs of national coverage using the current Departmental costing<br />

mechanisms for the establishment of <strong>headspace</strong> sites based on <strong>headspace</strong> grant funds and<br />

Social Policy Research Centre 2015<br />

<strong>headspace</strong> Evaluation Final Report<br />

165

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!