PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ...
PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ... PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ...
empirically based assessment of the effectiveness and sustainability of the strategy, andreasoned assessment of the extent and circumstances under which some or allcomponents of the Strategy could be effectively implemented elsewhere (29) .The information gained could then be used by: those implementing and managing the strategy policy-makers engaged in improving Indigenous health and/or in developing policies, and programs for the prevention, early detection and management of chronic diseases.The evaluation framework is laid out in Table 2.1 below. The evaluation draft report addressedthose parts of the framework that are highlighted in the table.Table 2.1Overview of evaluation frameworkEvaluation type/level of analysisProcess evaluation ofimplementationprocessesOutcome evaluationPublic policyenvironmentMonitoring of policychanges with thepotential to affect theimplementation and/oroutcomes ofstrategies.*Need to includebroader policyenvironmentHealth system levelAnalysis of documentarysources;In-depth interviews.Analysis of documentarysources;Interviews;Quantitative outcome(performance) indicatorsEconomic evaluation Development of ITservices/resources; Screening activities; Workforce developmentPHC/community levelAnalysis ofdocumentary sources;In-depth interviews;Systems mappingusing modified ACICtool.Clinical chart audits;Quantitative outcome(performance)indicators;Process mapping ofclient care processes;Interviews;Ethnographic researchto elicit clients‟perceptions ofchanges in healthservices.The RhED Consulting team reviewed the material collected by the NTDH&CS. They included thismaterial in the draft report and collated it with the results from the stakeholder interviews, whichwere undertaken to inform the health systems level discussions for the evaluation of theimplementation process.Chapter 2: Evaluation Methodology – Evaluation of the NT Preventable Chronic Disease Strategy 2007 14
2.2 Evaluation StagesThe NTPCDS evaluation has occurred in a number of stages. They included a document reviewand analysis, the development of a draft report, a gap analysis, interviews with stakeholders,collation and analysis of materials, and the restructure and redevelopment of the draft report.Step 1. Document review and analysisA non-systematic document review was undertaken in 2005-06. It examined all of thedocuments that could be found in the NTDH&CS that related to chronic disease and any otherliterature that had been produced for, or had been fed into, the development or implementationof the NTPCDS.In 2007 additional documents were collected from government and non-government sectororganisations as part of the interviewing process undertaken by RhED Consulting and additionalinformation and data was sourced. These documents were reviewed and collated under 6 corereportingareas that together reflect the objectives of the NTPCDS and the Evaluation Frameworkfor the NTPCDS and the Integrated Chronic Disease Care Framework developed by Wagner (30) .These core-reporting areas also guided the redrafting of this evaluation report.The six core reporting areas identified are:1. Clinical systems2. Workforce3. Programs4. Prevention5. Funding6. Clinical outcomes.Step 2. Development of the draft reportThe Community Physician and the PCD Project Officer drafted an evaluation report in November2006. They used the objectives of the NTPCDS as major reporting sections. It was recognisedthat there were a number of information gaps in the report, particularly from the nongovernmentsector, due to limited data that had been collected from this sector. At this timeboth officers moved onto other roles and the incomplete report was left with the PCDS SteeringCommittee to finish.Chapter 2: Evaluation Methodology – Evaluation of the NT Preventable Chronic Disease Strategy 2007 15
- Page 1 and 2: Pty LtdABN 82 147 637 101AN EVALUAT
- Page 3 and 4: TABLE OF CONTENTSList of figuresLis
- Page 5 and 6: 6.6 Indigenous workforce 996.7 Prev
- Page 7 and 8: List of AbbreviationsABCDACCHOsACIC
- Page 9 and 10: ACKNOWLEDGEMENTSWe would like to ac
- Page 11 and 12: However the extraordinary number of
- Page 13 and 14: the establishment of the Sunrise He
- Page 15 and 16: RECOMMENDATIONSGeneral recommendati
- Page 17 and 18: Exploration of joint funding arrang
- Page 19 and 20: CHAPTER 1. INTRODUCTION1.1 Backgrou
- Page 21 and 22: Choosing the 5 chronic conditionsTh
- Page 23 and 24: Table 1.1Key Result Areas + Best Bu
- Page 25 and 26: prior to the launch of NTPCDS, such
- Page 27 and 28: Year * Action Outcome1999 S NT Prev
- Page 29 and 30: Year * Action Outcome2005 P Aborigi
- Page 31: CHAPTER 2.EVALUATION METHODOLOGYThe
- Page 35 and 36: chronic disease activities funded t
- Page 37 and 38: internal project team. It was very
- Page 39 and 40: Situation at Baseline1. The Guideli
- Page 41 and 42: 3.1.2 Patient information and recal
- Page 43 and 44: Ferret Miwatj, Numbulwar, Marngarr,
- Page 45 and 46: Medicare information is not for pub
- Page 47 and 48: was in place in Central Australia i
- Page 49 and 50: What orientation and ongoing traini
- Page 51 and 52: programs focus on chronic disease p
- Page 53 and 54: The information collected as part o
- Page 55 and 56: Assessment against objectiveMost se
- Page 57 and 58: career development, and retention i
- Page 59 and 60: are. Indigenous employment is NTDH&
- Page 61 and 62: NTDH&CS Programs that encourage Hea
- Page 63 and 64: 2002 Aboriginal and Torres Strait I
- Page 65 and 66: delivering any prevention and healt
- Page 67 and 68: The Community Services Division - A
- Page 69 and 70: 1 x AHW Central Australia 2001 S100
- Page 71 and 72: One clinic stated it had no care pl
- Page 73 and 74: Identifies priority practices to in
- Page 75 and 76: There has been a significant growth
- Page 77 and 78: about 25 per cent of the hospital b
- Page 79 and 80: The level of funding provided by th
- Page 81 and 82: Central Australia and two zones cur
empirically based assessment of the effectiveness and sustainability of the strategy, andreasoned assessment of the extent and circumstances under which some or allcomponents of the <strong>Strategy</strong> could be effectively implemented elsewhere (29) .The information gained could then be used by: those implementing and managing the strategy policy-makers engaged in improving Indigenous health and/or in developing policies, and programs for the prevention, early detection and management of chronic diseases.The evaluation framework is laid out in Table 2.1 below. The evaluation draft report addressedthose parts of the framework that are highlighted in the table.Table 2.1Overview of evaluation framework<strong>Evaluation</strong> type/level of analysisProcess evaluation ofimplementationprocessesOutcome evaluationPublic policyenvironmentMonitoring of policychanges with thepotential to affect theimplementation and/oroutcomes ofstrategies.*Need to includebroader policyenvironment<strong>Health</strong> system levelAnalysis of documentarysources;In-depth interviews.Analysis of documentarysources;Interviews;Quantitative outcome(performance) indicatorsEconomic evaluation Development of ITservices/resources; Screening activities; Workforce developmentPHC/community levelAnalysis ofdocumentary sources;In-depth interviews;Systems mappingusing modified ACICtool.Clinical chart audits;Quantitative outcome(performance)indicators;Process mapping ofclient care processes;Interviews;Ethnographic researchto elicit clients‟perceptions ofchanges in healthservices.The RhED Consulting team reviewed the material collected by the <strong>NT</strong>DH&CS. They included thismaterial in the draft report and collated it with the results from the stakeholder interviews, whichwere undertaken to inform the health systems level discussions for the evaluation of theimplementation process.Chapter 2: <strong>Evaluation</strong> Methodology – <strong>Evaluation</strong> of the <strong>NT</strong> Preventable Chronic Disease <strong>Strategy</strong> 2007 14