Systematic review, meta-analysis and economic modelling of ...

Systematic review, meta-analysis and economic modelling of ... Systematic review, meta-analysis and economic modelling of ...

10.07.2015 Views

Appendix 93. Two reviewers will make decisions on the final composition of included studies, assessed from a hardcopy of the item. The decisions will be coded and recorded on the Reference Manager database by theProject Manager.4. Authors will be contacted, if appropriate, to clarify details and obtain missing data.5. The quality of each study will be assessed against recognised criteria [23–28].6. Data extraction will be undertaken independently with discrepancies being discussed by the dataextractors. Those that cannot be resolved at this stage will be referred to the rest of the project team.Data extractionThe following data will be extracted from each study: population characteristics (age, gender, CADrisk factors, prevalence of known CAD), setting (emergency department, general ward, cardiologyward), characteristics of the index investigation (biomarker, exercise ECG or CT coronary angiography),characteristics of the reference standard and/or outcome measure, methods used to measure outcomes,duration of follow-up, study quality criteria (independence of the reference standard, blinding of theintervention and reference standard), prevalence of MI, CAD and adverse events, true positives, falsepositives, false negatives and true positives for each outcome. If raw data are not reported we will attemptto calculate these from the reported diagnostic parameters or, in the case of important recent studies, wewill contact the authors for clarification.Data synthesisWhere appropriate, we will combine data to provide pooled estimates of the accuracy of investigationsfor MI, CAD and adverse events. Where appropriate data exist we will use Bayesian evidence synthesis tocharacterise the uncertainty associated with the parameters of interest. Where possible, we will examinethe use of baseline characteristics (i.e. covariates) to explain any heterogeneity between studies. We willthen attempt to identify the study, or homogeneous studies, that most closely reflects the current typicalNHS population and practice.The model used to analyse the data will depend on characteristics of the data obtained. For example, ifdiagnostic thresholds can be assumed constant across studies then simple methods of pooling sensitivityand specificity will be conducted [29]. If there is implicit or explicit evidence that diagnostic thresholdsdiffer between primary studies, then sensitivity and specificity cannot be considered independent andsimultaneous modelling will be required [30]. A detailed assessment of heterogeneity will be conducted inall instances. If possible, meta-regression will be used to explore whether heterogeneity can be explainedby study population characteristics, the characteristics of the intervention, the definition of the outcomeor the study quality, although the feasibility of this will depend on the number of individual studiesidentified and the quality of reporting. Where exploration of covariates is not possible, or (unexplained)heterogeneity remains after the incorporation of covariates into the model(s), random effects will beincorporated to allow for such variability in results between studies.Covariate effects, unexplainable variability and uncertainty in parameter estimates will all be reflected inthe results using cutting-edge meta-analysis approaches. Since the outputs from these analyses will beused in the decision modelling all such sources of variation and uncertainty will be accurately reflected inthe decision modelling [31].Decision analysis modellingWe will develop our existing decision analysis models [11,32] to evaluate two specific decisions in theinvestigation of suspected ACS:1. Which biomarkers should be measured (and when) in patients presenting with suspected ACS?2. Should exercise ECG or CT coronary angiography be used to identify CAD in patients with troponinnegative suspected ACS?182NIHR Journals Library

DOI: 10.3310/hta17010 Health Technology Assessment 2013 Vol. 17 No. 1MI diagnosis: biomarkersWe will test up to ten different biomarker strategies selected on the basis of the quality of supporting datafrom the literature review, the accuracy of the strategy for early MI diagnosis and/or the prognostic valueof the strategy. We will also include a ‘zero option’ of discharging all patients without testing and thecurrent recommended strategy of a 10–12 h troponin for all patients.Each strategy will be applied in the model to a theoretical cohort of patients attending hospital withsuspected ACS with a defined prevalence of MI and a defined prevalence of previously diagnosed andundiagnosed CAD. Estimates of diagnostic and prognostic accuracy from the systematic reviews willdetermine how many cases of MI are correctly identified, how many cases without MI require furthertesting and how many expected adverse events would be accurately predicted. We will assume thatpatients with positive biomarkers will receive hospital treatment while those with negative biomarkerswill be discharged home. Adverse outcomes up to six months in patients with MI at presentation will bedetermined by whether the patient receives appropriate treatment. Adverse outcomes up to six months inpatients without MI will be determined by whether the patient has CAD and whether a positive biomarkertest predicts their risk of adverse outcome.Initially we will assume that patients with negative biomarkers receive exercise ECG testing and subsequentcoronary angiography if positive, according to current guidelines. We will then explore interactionsbetween MI and CAD diagnosis.CAD diagnosis: exercise ECG or CT coronary angiographyInitially we will assume that all patients receive diagnostic testing for MI with a 10–12 h troponin, beforeexploring interactions between MI and CAD diagnosis.We will test strategies of using exercise ECG, CT coronary angiography and no CAD testing for biomarkernegative patients. We will also test strategies based on these approaches but using different decisionthresholds for undertaking coronary angiography and instituting secondary prevention on the basis offirst-line tests. For the baseline analysis the decision threshold will be ≥ 50% luminal diameter stenosis ina major epicardial vessel for CT coronary angiography and greater than 2-mm ST depression on exerciseECG. We will estimate long-term outcomes depending upon whether each patient has CAD or not andwhether they receive secondary prevention and/or percutaneous coronary intervention consequent uponpositive findings at coronary angiography.Long-term outcomes will be modelled as QALYs, determined by whether patients suffer death or adverseoutcome up to six months, and whether they suffer subsequent CAD-related mortality or morbidity. Cohortstudy and registry data identified by the literature review or used in previous models [32,33] will be usedto estimate QALYs after adverse events.A societal costing perspective will be used and the following costs estimated from literature reviewand expert panel assessment: clinical assessment, tests, hospital admission, outpatient review, generalpractitioner review, treatments for MI or CAD, treatments for adverse outcomes, long-term costs of careand productivity losses. Where possible the modelling will adhere to the NICE reference case [34] withsensitivity analyses conducted on including further aspects such as productivity losses.These costs, and the results of evidence synthesis, will be applied to the model and probabilistic modellingused to estimate the net benefit [35] of each strategy at varying thresholds of willingness to pay for healthgain. The optimum strategy will be the one with the maximum expected net benefit at the NICE thresholdof £20,000 per QALY gained. This will be the most appropriate strategy for the NHS. Modelling will be aniterative process with estimates of net benefit from the model being used to inform the development ofnew strategies until all potentially feasible alternatives have been explored.© Queen’s Printer and Controller of HMSO 2013. This work was produced by Goodacre et al. under the terms of a commissioning contract issued by the Secretary of Statefor Health. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journalsprovided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should beaddressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton SciencePark, Southampton SO16 7NS, UK.183

DOI: 10.3310/hta17010 Health Technology Assessment 2013 Vol. 17 No. 1MI diagnosis: biomarkersWe will test up to ten different biomarker strategies selected on the basis <strong>of</strong> the quality <strong>of</strong> supporting datafrom the literature <strong>review</strong>, the accuracy <strong>of</strong> the strategy for early MI diagnosis <strong>and</strong>/or the prognostic value<strong>of</strong> the strategy. We will also include a ‘zero option’ <strong>of</strong> discharging all patients without testing <strong>and</strong> thecurrent recommended strategy <strong>of</strong> a 10–12 h troponin for all patients.Each strategy will be applied in the model to a theoretical cohort <strong>of</strong> patients attending hospital withsuspected ACS with a defined prevalence <strong>of</strong> MI <strong>and</strong> a defined prevalence <strong>of</strong> previously diagnosed <strong>and</strong>undiagnosed CAD. Estimates <strong>of</strong> diagnostic <strong>and</strong> prognostic accuracy from the systematic <strong>review</strong>s willdetermine how many cases <strong>of</strong> MI are correctly identified, how many cases without MI require furthertesting <strong>and</strong> how many expected adverse events would be accurately predicted. We will assume thatpatients with positive biomarkers will receive hospital treatment while those with negative biomarkerswill be discharged home. Adverse outcomes up to six months in patients with MI at presentation will bedetermined by whether the patient receives appropriate treatment. Adverse outcomes up to six months inpatients without MI will be determined by whether the patient has CAD <strong>and</strong> whether a positive biomarkertest predicts their risk <strong>of</strong> adverse outcome.Initially we will assume that patients with negative biomarkers receive exercise ECG testing <strong>and</strong> subsequentcoronary angiography if positive, according to current guidelines. We will then explore interactionsbetween MI <strong>and</strong> CAD diagnosis.CAD diagnosis: exercise ECG or CT coronary angiographyInitially we will assume that all patients receive diagnostic testing for MI with a 10–12 h troponin, beforeexploring interactions between MI <strong>and</strong> CAD diagnosis.We will test strategies <strong>of</strong> using exercise ECG, CT coronary angiography <strong>and</strong> no CAD testing for biomarkernegative patients. We will also test strategies based on these approaches but using different decisionthresholds for undertaking coronary angiography <strong>and</strong> instituting secondary prevention on the basis <strong>of</strong>first-line tests. For the baseline <strong>analysis</strong> the decision threshold will be ≥ 50% luminal diameter stenosis ina major epicardial vessel for CT coronary angiography <strong>and</strong> greater than 2-mm ST depression on exerciseECG. We will estimate long-term outcomes depending upon whether each patient has CAD or not <strong>and</strong>whether they receive secondary prevention <strong>and</strong>/or percutaneous coronary intervention consequent uponpositive findings at coronary angiography.Long-term outcomes will be modelled as QALYs, determined by whether patients suffer death or adverseoutcome up to six months, <strong>and</strong> whether they suffer subsequent CAD-related mortality or morbidity. Cohortstudy <strong>and</strong> registry data identified by the literature <strong>review</strong> or used in previous models [32,33] will be usedto estimate QALYs after adverse events.A societal costing perspective will be used <strong>and</strong> the following costs estimated from literature <strong>review</strong><strong>and</strong> expert panel assessment: clinical assessment, tests, hospital admission, outpatient <strong>review</strong>, generalpractitioner <strong>review</strong>, treatments for MI or CAD, treatments for adverse outcomes, long-term costs <strong>of</strong> care<strong>and</strong> productivity losses. Where possible the <strong>modelling</strong> will adhere to the NICE reference case [34] withsensitivity analyses conducted on including further aspects such as productivity losses.These costs, <strong>and</strong> the results <strong>of</strong> evidence synthesis, will be applied to the model <strong>and</strong> probabilistic <strong>modelling</strong>used to estimate the net benefit [35] <strong>of</strong> each strategy at varying thresholds <strong>of</strong> willingness to pay for healthgain. The optimum strategy will be the one with the maximum expected net benefit at the NICE threshold<strong>of</strong> £20,000 per QALY gained. This will be the most appropriate strategy for the NHS. Modelling will be aniterative process with estimates <strong>of</strong> net benefit from the model being used to inform the development <strong>of</strong>new strategies until all potentially feasible alternatives have been explored.© Queen’s Printer <strong>and</strong> Controller <strong>of</strong> HMSO 2013. This work was produced by Goodacre et al. under the terms <strong>of</strong> a commissioning contract issued by the Secretary <strong>of</strong> Statefor Health. This issue may be freely reproduced for the purposes <strong>of</strong> private research <strong>and</strong> study <strong>and</strong> extracts (or indeed, the full report) may be included in pr<strong>of</strong>essional journalsprovided that suitable acknowledgement is made <strong>and</strong> the reproduction is not associated with any form <strong>of</strong> advertising. Applications for commercial reproduction should beaddressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials <strong>and</strong> Studies Coordinating Centre, Alpha House, University <strong>of</strong> Southampton SciencePark, Southampton SO16 7NS, UK.183

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!