PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ...

PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ... PCD Strategy Evaluation 2007.pdf - NT Health Digital Library ...

digitallibrary.health.nt.gov.au
from digitallibrary.health.nt.gov.au More from this publisher
13.07.2015 Views

2.3 LimitationsLack of an implementation strategyA key limitation of this evaluation was the absence of an implementation plan for the NTPCDS,upon which this evaluation could be based. Multiple initiatives have occurred nationally andwithin the NT during this 7-year timeframe. Therefore it was not possible to determine howimplementation was expected to occur, and to assess if this occurred – a fundamentalcomponent of any process evaluation. To address this the RhED team decided to discuss allprogress achieved, regardless of whether this was influenced by the NTPCDS or not. The reasonfor this is the NTPCDS is an Northern Territory wide strategy, and as such all progress with theimprovement in chronic disease and prevention that was identified in the evaluation process hasbeen reported.Evaluating progress against baseline dataA Statistical Report for the NTPCDS was produced in 2000 (8) . It formed a baseline upon which tomeasure the impact of the NTPCDS and provides excellent baseline data within the PCDSreporting framework (8) . There has however not been another report, using the same methods,since this date, though several reports on facets of the NTPCDS exist in other areas. This hasmade it difficult to report against a baseline and interpret the results of other reports. Forexample: the goal of the NTPCDS was to reduce the projected impact of five common chronicdiseases – the number of hospitalisations, deaths and financial costs. This was unable to beevaluated, as there has been no new published hospital data since 2000, apart from that foundon renal day admissions.Many sources of data had to be re-identified as several in the existing draft report were well outof date, or provided baseline data only. Some could not be found, were not available, or were notcomparable to the baseline data, or the NT data were not for publication ie Medicare. Due to thebreadth of this report against objectives and key result areas, this process was complex andextensive. Hence only information that was published was used in the development of the finalreport; and some areas remain incomplete due to the lack of available published data.Evaluation processThe approach used by the NTDH&CS in undertaking this evaluation, using different groups andan internal and external process, created another limitation. Internal staff initiated the evaluationand external consultants completed the project, with limited opportunity for discussion with theChapter 2: Evaluation Methodology – Evaluation of the NT Preventable Chronic Disease Strategy 2007 18

internal project team. It was very difficult at times to identify data sources and validatestatements made in the draft evaluation report. Therefore some of the information contained inthe draft report that could not be validated, was removed.RestructuresBetween 1999-2006 there were three restructures within the NTDH&CS. The broader policyenvironment shifted from Strategy 21 to the current Building Healthier Communities Framework,which included a change from horizontal to vertical programs. This has made it difficult to assesswhere programs and resources have been shifted, or if they have been reallocated or haveceased. Therefore, within the time constraints of the evaluation process, it was not possible togain a sense of the impact of corporate policy directions, except to comment upon how this hasaffected communication between service providers and the integration of services within theNTDH&CS and other service providers across the Northern Territory.Translation between policy and practiceDetermining the translation between policy, the PCDS and practice, and what service providersattributed to the PCDS or another program offered challenges. For example: it was difficult forsome groups, internal and external to NTDH&CS, to identify how the PCDS influenced their work,yet their work was clearly contributing to the outcomes expected from the PCDS.Chapter 2: Evaluation Methodology – Evaluation of the NT Preventable Chronic Disease Strategy 2007 19

internal project team. It was very difficult at times to identify data sources and validatestatements made in the draft evaluation report. Therefore some of the information contained inthe draft report that could not be validated, was removed.RestructuresBetween 1999-2006 there were three restructures within the <strong>NT</strong>DH&CS. The broader policyenvironment shifted from <strong>Strategy</strong> 21 to the current Building <strong>Health</strong>ier Communities Framework,which included a change from horizontal to vertical programs. This has made it difficult to assesswhere programs and resources have been shifted, or if they have been reallocated or haveceased. Therefore, within the time constraints of the evaluation process, it was not possible togain a sense of the impact of corporate policy directions, except to comment upon how this hasaffected communication between service providers and the integration of services within the<strong>NT</strong>DH&CS and other service providers across the Northern Territory.Translation between policy and practiceDetermining the translation between policy, the <strong>PCD</strong>S and practice, and what service providersattributed to the <strong>PCD</strong>S or another program offered challenges. For example: it was difficult forsome groups, internal and external to <strong>NT</strong>DH&CS, to identify how the <strong>PCD</strong>S influenced their work,yet their work was clearly contributing to the outcomes expected from the <strong>PCD</strong>S.Chapter 2: <strong>Evaluation</strong> Methodology – <strong>Evaluation</strong> of the <strong>NT</strong> Preventable Chronic Disease <strong>Strategy</strong> 2007 19

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!