PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ...

PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ... PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ...

digitallibrary.health.nt.gov.au
from digitallibrary.health.nt.gov.au More from this publisher
13.07.2015 Views

empirically based assessment of the effectiveness and sustainability of the strategy, andreasoned assessment of the extent and circumstances under which some or allcomponents of the Strategy could be effectively implemented elsewhere (29) .The information gained could then be used by: those implementing and managing the strategy policy-makers engaged in improving Indigenous health and/or in developing policies, and programs for the prevention, early detection and management of chronic diseases.The evaluation framework is laid out in Table 2.1 below. The evaluation draft report addressedthose parts of the framework that are highlighted in the table.Table 2.1Overview of evaluation frameworkEvaluation type/level of analysisProcess evaluation ofimplementationprocessesOutcome evaluationPublic policyenvironmentMonitoring of policychanges with thepotential to affect theimplementation and/oroutcomes ofstrategies.*Need to includebroader policyenvironmentHealth system levelAnalysis of documentarysources;In-depth interviews.Analysis of documentarysources;Interviews;Quantitative outcome(performance) indicatorsEconomic evaluation Development of ITservices/resources; Screening activities; Workforce developmentPHC/community levelAnalysis ofdocumentary sources;In-depth interviews;Systems mappingusing modified ACICtool.Clinical chart audits;Quantitative outcome(performance)indicators;Process mapping ofclient care processes;Interviews;Ethnographic researchto elicit clients‟perceptions ofchanges in healthservices.The RhED Consulting team reviewed the material collected by the NTDH&CS. They included thismaterial in the draft report and collated it with the results from the stakeholder interviews, whichwere undertaken to inform the health systems level discussions for the evaluation of theimplementation process.Chapter 2: Evaluation Methodology – Evaluation of the NT Preventable Chronic Disease Strategy 2007 14

2.2 Evaluation StagesThe NTPCDS evaluation has occurred in a number of stages. They included a document reviewand analysis, the development of a draft report, a gap analysis, interviews with stakeholders,collation and analysis of materials, and the restructure and redevelopment of the draft report.Step 1. Document review and analysisA non-systematic document review was undertaken in 2005-06. It examined all of thedocuments that could be found in the NTDH&CS that related to chronic disease and any otherliterature that had been produced for, or had been fed into, the development or implementationof the NTPCDS.In 2007 additional documents were collected from government and non-government sectororganisations as part of the interviewing process undertaken by RhED Consulting and additionalinformation and data was sourced. These documents were reviewed and collated under 6 corereportingareas that together reflect the objectives of the NTPCDS and the Evaluation Frameworkfor the NTPCDS and the Integrated Chronic Disease Care Framework developed by Wagner (30) .These core-reporting areas also guided the redrafting of this evaluation report.The six core reporting areas identified are:1. Clinical systems2. Workforce3. Programs4. Prevention5. Funding6. Clinical outcomes.Step 2. Development of the draft reportThe Community Physician and the PCD Project Officer drafted an evaluation report in November2006. They used the objectives of the NTPCDS as major reporting sections. It was recognisedthat there were a number of information gaps in the report, particularly from the nongovernmentsector, due to limited data that had been collected from this sector. At this timeboth officers moved onto other roles and the incomplete report was left with the PCDS SteeringCommittee to finish.Chapter 2: Evaluation Methodology – Evaluation of the NT Preventable Chronic Disease Strategy 2007 15

empirically based assessment of the effectiveness and sustainability of the strategy, andreasoned assessment of the extent and circumstances under which some or allcomponents of the <strong>Strategy</strong> could be effectively implemented elsewhere (29) .The information gained could then be used by: those implementing and managing the strategy policy-makers engaged in improving Indigenous health and/or in developing policies, and programs for the prevention, early detection and management of chronic diseases.The evaluation framework is laid out in Table 2.1 below. The evaluation draft report addressedthose parts of the framework that are highlighted in the table.Table 2.1Overview of evaluation framework<strong>Evaluation</strong> type/level of analysisProcess evaluation ofimplementationprocessesOutcome evaluationPublic policyenvironmentMonitoring of policychanges with thepotential to affect theimplementation and/oroutcomes ofstrategies.*Need to includebroader policyenvironment<strong>Health</strong> system levelAnalysis of documentarysources;In-depth interviews.Analysis of documentarysources;Interviews;Quantitative outcome(performance) indicatorsEconomic evaluation Development of ITservices/resources; Screening activities; Workforce developmentPHC/community levelAnalysis ofdocumentary sources;In-depth interviews;Systems mappingusing modified ACICtool.Clinical chart audits;Quantitative outcome(performance)indicators;Process mapping ofclient care processes;Interviews;Ethnographic researchto elicit clients‟perceptions ofchanges in healthservices.The RhED Consulting team reviewed the material collected by the <strong>NT</strong>DH&CS. They included thismaterial in the draft report and collated it with the results from the stakeholder interviews, whichwere undertaken to inform the health systems level discussions for the evaluation of theimplementation process.Chapter 2: <strong>Evaluation</strong> Methodology – <strong>Evaluation</strong> of the <strong>NT</strong> Preventable Chronic Disease <strong>Strategy</strong> 2007 14

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!