Is headspace making a difference to young people’s lives?
Evaluation-of-headspace-program Evaluation-of-headspace-program
Appendix B of expansion. It is important to note here that the alternative models component represented by Part 3 has been provided in addition to the evaluation requirements. Further investigation would require separate project funding to complete if pursued externally to the Department or hNO. While the current model of expansion can be costed based on detailed information regarding current headspace grant funding and estimates of MBS contributions at a centre level being available to the evaluation team, costing alternative models requires additional information not provided for the evaluation. These alternative models of centre allocation propose the use of smaller sites and make use of different geographic boundaries. For example, spoke sites may be identified by a defined catchment area much smaller than the SA4/SA3 regions currently used; they are likely to have reduced service capacity, and may run on a part-time basis. There is no information on which to base the costing for these smaller or part-time sites which diverge from the traditional model. We lack enough cost information for such sites to make even indicative estimates, and attempting to do so with the information made available for this evaluation would risk misleading evaluation stakeholders and undermine the confidence of the public in the integrity of other results of the evaluation. In addition, the population size required to justify either a full or smaller headspace centre is unknown. The region which contains the smallest youth population and an existing headspace centre has a youth population of around 3,500 12-25 year olds. It is unknown whether this can be interpreted as a lower limit on efficient service provision, or whether smaller populations could support a centre. In addition, the upper service capacity is unknown and difficult to estimate. This is largely due to the paucity of information regarding additional, non-government funds and in-kind support provided to existing centres. These additional funds have the potential to substantially increase the capacity of a centre. Additional information regarding non-government funding input would provide insight into centre capacity. Further, the impact of smaller region sizes on the ability of the model to leverage off existing services and partners is not able to be evaluated but has significant implications for site allocation. The impact of competing and complementary services is unknown. This variable is likely to be evaluated in the current model within the ‘human intelligence’ component. This factor has substantial implications for service need and, as a result, likely centre allocation. This may have greater impact when region sizes are small. Additional information required to allow for robust estimates of costs of centre expansion under the alternative models include: • defined lower and upper bound on the population size of a region to allow for efficient centre allocation. This is closely related to centre service capacity. • costing information for smaller sites (e.g. part-time centres, centres with limited services) • information regarding alternative and complementary mental health services within in-scope areas. Conclusions Summary of factors for consideration in the future roll-out of headspace • flexibility in the headspace funding allocation to tailor allocation to relevant factors such as rurality, demand and service requirements • investigation of the use of alternatives to traditional sites. For example, hub and spoke sites, part-time or centres staffed by fly-in fly-out staff • potential use of alternative modes of service delivery such as online treatment methods • prioritisation of centre allocation based on direct measures of service need. The report provides a data driven approach to evaluation of the current model of centre expansion and the assumptions that underpin this model. It identifies weaknesses and proposes a number of alternative models of centre expansion, which alter components of the existing model with the aim Social Policy Research Centre 2015 headspace Evaluation Final Report 164
Appendix B of achieving more efficient and equitable mental health service delivery for young people across Australia. Limitations This analysis contains a number of limitations which should be considered when evaluating results. These relate to assumptions made in the evaluation and data limitations. A number of assumptions were made in the analysis, and the results of the evaluation should be interpreted in light of this. Firstly, the evaluation team was unable to take into account competing and complementary mental health services such as acute child and adolescent mental health services. These additional mental health services are likely to impact on the service requirements of headspace centres. These factors need to be considered in future centre allocation, but are beyond the scope of this analysis. A second assumption relates to the definition of access. Access was defined by geographical proximity and centre capacity alone. Additional factors may impact on youth access to service, but these were not explored in detail. Finally, the evaluation team were unable to account for changes in demand and spill-over effects with a large number of additional centres in relatively close proximity. There are a number of limitations of the data. Population estimates are based on 2011 Census data. There is likely to be some migration into and out of small areas. This will impact on estimates of population access. In addition, these changes are likely to impact on the demographic profiles of small areas and therefore small area estimates of mental health need. In addition, the reader should be cognisant of errors associated with modelling, including small area estimates of population mental health prevalence. Further, variables which are relevant to needs in the community were unable to be included in modelling as included variables are limited to those collected in the Census. The evaluation team were unable to cost alternative models and methods of service delivery that are outlined in the chapter. This is due to a lack of information to allow costing of alternatives, and in particular, the cost of alternatives to physical centres and full-time models of service delivery. Finally, the modelling did not take into account economies of scale. For example, savings in the hNO administration associated with expansion beyond the current centre allocation and economies of scale which may be associated with larger headspace centres in high need urban areas. In addition, the evaluation team were unable to evaluate factors such as greater clinical staff salaries in remote locations with small service populations. Overall outcomes of investigation into the headspace centre allocation models This section of the headspace evaluation has provided an analysis of centre expansion under the current model of headspace centre allocation, examined the effectiveness of the current model of centre allocation to provide youth access to services, and discussed alternative methods of achieving national coverage for headspace services. This has been completed in order to address the following two evaluation components: • Assessment of the overall cost-effectiveness of expanding headspace beyond 100 centres; and • Estimation of the maximum funding requirements for headspace to achieve national coverage. We remind readers that these components build on the preceding cost effectiveness section. In addressing both evaluation components shown above, the evaluation team used the following methodological and design features: • The analyses considered the costs and effects of headspace services in different geographical locations and the current geographic and demographic coverage of headspace. • The main metric used in considering the effects of headspace expansion was current and potential youth coverage of headspace. • We estimated the costs of national coverage using the current Departmental costing mechanisms for the establishment of headspace sites based on headspace grant funds and Social Policy Research Centre 2015 headspace Evaluation Final Report 165
- Page 123 and 124: 7. Conclusion treatment); however,
- Page 125 and 126: 7. Conclusion Overall the evaluatio
- Page 127 and 128: Appendix A Evaluation scope areas h
- Page 129 and 130: Appendix B The current model of hea
- Page 131 and 132: Appendix B and each SA3 in non-capi
- Page 133 and 134: Appendix B chapter 39 . To determin
- Page 135 and 136: Appendix B While there is an overal
- Page 137 and 138: Appendix B Figure B3 describes the
- Page 139 and 140: Appendix B Figure B5 Cost per young
- Page 141 and 142: Appendix B The concept of access as
- Page 143 and 144: Appendix B Figure B7 Heard of heads
- Page 145 and 146: Figure B10 Proportion of headspace
- Page 147 and 148: Appendix B Table B5 Females 18-25 y
- Page 149 and 150: Appendix B following section. Figur
- Page 151 and 152: Appendix B and less access to mains
- Page 153 and 154: Appendix B Figure B17 Estimated pre
- Page 155 and 156: Appendix B Figure B18 SA1s within 1
- Page 157 and 158: Figure B20 Hypothetical allocation
- Page 159 and 160: Appendix B The current model of cen
- Page 161 and 162: Appendix B Current centre funding m
- Page 163 and 164: Appendix B Evaluation of the curren
- Page 165 and 166: Appendix B Level of funding availab
- Page 167 and 168: Appendix B provide a method for ide
- Page 169 and 170: Appendix B centres and Localities i
- Page 171 and 172: Appendix B for greater flexibility
- Page 173: Appendix B Additional consideration
- Page 177 and 178: Appendix B • Used the simulation
- Page 179 and 180: Appendix C information relating to
- Page 181 and 182: Appendix C Regarding gender, in bot
- Page 183 and 184: Appendix C Figure C5 Total number o
- Page 185 and 186: Appendix C Table C1 Information Sum
- Page 187 and 188: Appendix C Data Cleaning and Analys
- Page 189 and 190: Appendix C groups. The age and sex
- Page 191 and 192: Appendix C Figure C8 Demographic ch
- Page 193 and 194: Appendix C The KeySurvey software s
- Page 195 and 196: Appendix C different client groups.
- Page 197 and 198: Appendix D Round State Centre Name
- Page 199 and 200: Appendix E Characteristics HS clien
- Page 201 and 202: Table E4 Cell Sizes for Figure 3.4
- Page 203 and 204: Appendix F Figure F1 Changes in K10
- Page 205 and 206: Appendix F three SEIFA quintiles. A
- Page 207 and 208: Appendix F Occasion of service inte
- Page 209 and 210: Appendix F Table F1 Cell sizes for
- Page 211 and 212: Appendix F Table F4 Cell sizes for
- Page 213 and 214: Appendix F Table F9 Cell sizes for
- Page 215 and 216: Appendix G Supplementary material f
- Page 217 and 218: Appendix G Table G3 Round 3 (10 cen
- Page 219 and 220: Appendix G Table G7 Round 7 (10 cen
- Page 221 and 222: State (youth population) a headspac
- Page 223 and 224: State (youth population) a headspac
Appendix B<br />
of achieving more efficient and equitable mental health service delivery for <strong>young</strong> people across<br />
Australia.<br />
Limitations<br />
This analysis contains a number of limitations which should be considered when evaluating results.<br />
These relate <strong>to</strong> assumptions made in the evaluation and data limitations.<br />
A number of assumptions were made in the analysis, and the results of the evaluation should be<br />
interpreted in light of this. Firstly, the evaluation team was unable <strong>to</strong> take in<strong>to</strong> account competing<br />
and complementary mental health services such as acute child and adolescent mental health<br />
services. These additional mental health services are likely <strong>to</strong> impact on the service requirements of<br />
<strong>headspace</strong> centres. These fac<strong>to</strong>rs need <strong>to</strong> be considered in future centre allocation, but are beyond<br />
the scope of this analysis. A second assumption relates <strong>to</strong> the definition of access. Access was<br />
defined by geographical proximity and centre capacity alone. Additional fac<strong>to</strong>rs may impact on youth<br />
access <strong>to</strong> service, but these were not explored in detail. Finally, the evaluation team were unable <strong>to</strong><br />
account for changes in demand and spill-over effects with a large number of additional centres in<br />
relatively close proximity.<br />
There are a number of limitations of the data. Population estimates are based on 2011 Census data.<br />
There is likely <strong>to</strong> be some migration in<strong>to</strong> and out of small areas. This will impact on estimates of<br />
population access. In addition, these changes are likely <strong>to</strong> impact on the demographic profiles of<br />
small areas and therefore small area estimates of mental health need. In addition, the reader should<br />
be cognisant of errors associated with modelling, including small area estimates of population mental<br />
health prevalence. Further, variables which are relevant <strong>to</strong> needs in the community were unable <strong>to</strong> be<br />
included in modelling as included variables are limited <strong>to</strong> those collected in the Census.<br />
The evaluation team were unable <strong>to</strong> cost alternative models and methods of service delivery that<br />
are outlined in the chapter. This is due <strong>to</strong> a lack of information <strong>to</strong> allow costing of alternatives, and in<br />
particular, the cost of alternatives <strong>to</strong> physical centres and full-time models of service delivery.<br />
Finally, the modelling did not take in<strong>to</strong> account economies of scale. For example, savings in the hNO<br />
administration associated with expansion beyond the current centre allocation and economies of<br />
scale which may be associated with larger <strong>headspace</strong> centres in high need urban areas. In addition,<br />
the evaluation team were unable <strong>to</strong> evaluate fac<strong>to</strong>rs such as greater clinical staff salaries in remote<br />
locations with small service populations.<br />
Overall outcomes of investigation in<strong>to</strong> the <strong>headspace</strong> centre allocation models<br />
This section of the <strong>headspace</strong> evaluation has provided an analysis of centre expansion under the<br />
current model of <strong>headspace</strong> centre allocation, examined the effectiveness of the current model of<br />
centre allocation <strong>to</strong> provide youth access <strong>to</strong> services, and discussed alternative methods of achieving<br />
national coverage for <strong>headspace</strong> services. This has been completed in order <strong>to</strong> address the following<br />
two evaluation components:<br />
• Assessment of the overall cost-effectiveness of expanding <strong>headspace</strong> beyond 100 centres;<br />
and<br />
• Estimation of the maximum funding requirements for <strong>headspace</strong> <strong>to</strong> achieve national<br />
coverage.<br />
We remind readers that these components build on the preceding cost effectiveness section. In<br />
addressing both evaluation components shown above, the evaluation team used the following<br />
methodological and design features:<br />
• The analyses considered the costs and effects of <strong>headspace</strong> services in different<br />
geographical locations and the current geographic and demographic coverage of<br />
<strong>headspace</strong>.<br />
• The main metric used in considering the effects of <strong>headspace</strong> expansion was current and<br />
potential youth coverage of <strong>headspace</strong>.<br />
• We estimated the costs of national coverage using the current Departmental costing<br />
mechanisms for the establishment of <strong>headspace</strong> sites based on <strong>headspace</strong> grant funds and<br />
Social Policy Research Centre 2015<br />
<strong>headspace</strong> Evaluation Final Report<br />
165