Systematic review, meta-analysis and economic modelling of ...

Systematic review, meta-analysis and economic modelling of ... Systematic review, meta-analysis and economic modelling of ...

10.07.2015 Views

Assessment of diagnostic and prognostic accuracyAll identified citations from the electronic searches and other resources were imported into andmanaged using the Reference Manager bibliographic software (version 12.0; Thomson Reuters,Philadelphia, PA, USA).Study selection and inclusion/exclusion criteriaThe selection of potentially relevant articles was undertaken across both reviews by an experiencedreviewer (CC) and the principal investigator, a clinical expert (SG). An acceptable inter-rater reliability wasachieved from a test screen of a sample of citations retrieved for each set of reviews: k = 0.71 for 700citations for the biochemical markers review and k = 0.61 for 400 from the CTCA/exercise ECG review.The remaining citations were then divided between the reviewers (CC and SG) and each independentlyscreened their respective sample against the inclusion criteria and excluded any citations that clearly didnot meet these criteria. The full manuscript of all potentially eligible citations that were considered relevantby either reviewer was then obtained, where possible. One reviewer (CC) then independently assessedthe full-text articles for inclusion and this decision was double-checked by the principal investigator (SG).Blinding of journal, institution and author was not performed. Any disagreement in the selection processwas resolved through discussion. The relevance of each article to the two diagnostic or prognostic reviewswas assessed according to the following criteria.Study designAll prospective diagnostic cohort studies comparing a relevant index test (biochemical markers or CTCA/exercise ECG) to the required reference standard for the relevant outcome (MI or CAD) were includedin their relevant review. All studies examining the prognostic value of a relevant index text (biochemicalmarkers or CTCA) for at least 30 days’ follow-up for MACEs were included, regardless of the referencestandard used. Case–control studies (i.e. studies in which patients were selected on the basis of the resultsof their reference standard test) were excluded.PopulationTo be included, a study had to assess adults presenting with suspected ACS. Studies were excluded ifpatients were selected on the basis of having a clinical diagnosis of ACS (rather than a clinical suspicion ofACS) or positive diagnostic test for ACS, such as ST deviation on the ECG or an elevated biomarker. Studiesof patients selected on the basis of a negative diagnostic test were included [e.g. studies that excludedpatients with ST elevation myocardial infarction (STEMI)].Index testsFor the biochemical markers review, the index test included any test assessing the following markersindividually or in combination:• z adrenomedullin• z BNP or NT-pro-BNP• z copeptin• z CRP• z galectin-15• z H-FABP• z interleukin 33• z IMA• z matrix metalloproteinase 9 (MMP9)• z MPO• z myoglobin• z PAPP-A• z ST-2• z TnI or TnT.10NIHR Journals Library

DOI: 10.3310/hta17010 Health Technology Assessment 2013 Vol. 17 No. 1Studies were only included in the diagnostic accuracy review if the index test was measured at orbefore patient arrival at hospital. We excluded prognostic studies that only evaluated troponin (or otherbiomarkers not included in the review, such as CK and CK-MB).For the second diagnostic review, the index test was either CTCA, regardless of sensitivity (e.g. 64 or16 slices) or exercise ECG.Target conditionThe target conditions or outcomes of the reviews of biochemical markers were:• z Diagnostic review Acute MI defined according to the universal definition. 7• z Prognostic review MACE, defined as including at least cardiac death and non-fatal MI (individually oras a composite).The target conditions or outcomes of the review of CTCA and exercise ECG were:• z Diagnostic review CAD identified on ICA.• z Prognostic review MACE, defined as including at least cardiac death and non-fatal MI (individually oras a composite).Reference standardsAcute MI was defined according to the universal definition and required TnI or TnT measurement forat least 80% of the population at least 6 hours after symptom onset. If the reference standard was anybiomarker other than troponin the study was excluded from the diagnostic review. Many studies reportedcomposite diagnostic reference standards or a diagnostic standard of ACS, which included clinicallydiagnosed ACS, development of ECG changes or a subsequent MACE. Where possible we attempted toextract data for MI according to our definition. If this was not possible we made a judgement whether ornot the reference standard approximated to our definition of MI. We included studies that used only newdiagnostic ECG changes or outcome-based MACE (e.g. death, non-fatal MI or life-threatening arrhythmia)alongside a troponin-based reference standard. We excluded studies that used clinically diagnosed ACS(i.e. by history and examination findings alone), undefined or any ECG changes, or process-based MACE(e.g. coronary reperfusion) in the reference standard.Coronary artery disease was determined by ICA and defined in accordance with the primary study.Studies were excluded if coronary angiography was performed only in selected patients, such as thosewith positive CTCA or exercise ECG. The definition of MACEs required that at least 80% of the cohort befollowed for at least 30 days and that a MACE included, at least, cardiac death and non-fatal MI.OutcomesSufficient data were required to construct tables of diagnostic test performance, i.e. numbers of truepositives(TPs), false-negatives (FNs), false-positives (FPs) and true-negatives (TNs). If raw numbers were notreported we attempted to calculate these data from sensitivity and specificity, using prevalence and totalnumber analysed to calculate the denominators. Studies were excluded from analysis as ‘unable to extractdata’ if these calculations were not possible or yielded markedly inconsistent data.Data abstraction strategyData abstraction of each study was performed by one reviewer (CC, MK or JL) into a standardiseddata extraction form and independently checked for accuracy by a second reviewer (CC, MK, JL or SG).Discrepancies were resolved by discussion between the two reviewers and if agreement could not bereached, the principal investigator was consulted (SG). Where multiple publications of the same study wereidentified, data were extracted and reported as a single study. Where there was possible overlap betweencohorts reported from the same author group or study centre we excluded data from one of the cohortsto avoid duplication.© Queen’s Printer and Controller of HMSO 2013. This work was produced by Goodacre et al. under the terms of a commissioning contract issued by the Secretary of Statefor Health. This issue may be freely reproduced for the purposes of private research and study and extracts (or indeed, the full report) may be included in professional journalsprovided that suitable acknowledgement is made and the reproduction is not associated with any form of advertising. Applications for commercial reproduction should beaddressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials and Studies Coordinating Centre, Alpha House, University of Southampton SciencePark, Southampton SO16 7NS, UK.11

DOI: 10.3310/hta17010 Health Technology Assessment 2013 Vol. 17 No. 1Studies were only included in the diagnostic accuracy <strong>review</strong> if the index test was measured at orbefore patient arrival at hospital. We excluded prognostic studies that only evaluated troponin (or otherbiomarkers not included in the <strong>review</strong>, such as CK <strong>and</strong> CK-MB).For the second diagnostic <strong>review</strong>, the index test was either CTCA, regardless <strong>of</strong> sensitivity (e.g. 64 or16 slices) or exercise ECG.Target conditionThe target conditions or outcomes <strong>of</strong> the <strong>review</strong>s <strong>of</strong> biochemical markers were:• z Diagnostic <strong>review</strong> Acute MI defined according to the universal definition. 7• z Prognostic <strong>review</strong> MACE, defined as including at least cardiac death <strong>and</strong> non-fatal MI (individually oras a composite).The target conditions or outcomes <strong>of</strong> the <strong>review</strong> <strong>of</strong> CTCA <strong>and</strong> exercise ECG were:• z Diagnostic <strong>review</strong> CAD identified on ICA.• z Prognostic <strong>review</strong> MACE, defined as including at least cardiac death <strong>and</strong> non-fatal MI (individually oras a composite).Reference st<strong>and</strong>ardsAcute MI was defined according to the universal definition <strong>and</strong> required TnI or TnT measurement forat least 80% <strong>of</strong> the population at least 6 hours after symptom onset. If the reference st<strong>and</strong>ard was anybiomarker other than troponin the study was excluded from the diagnostic <strong>review</strong>. Many studies reportedcomposite diagnostic reference st<strong>and</strong>ards or a diagnostic st<strong>and</strong>ard <strong>of</strong> ACS, which included clinicallydiagnosed ACS, development <strong>of</strong> ECG changes or a subsequent MACE. Where possible we attempted toextract data for MI according to our definition. If this was not possible we made a judgement whether ornot the reference st<strong>and</strong>ard approximated to our definition <strong>of</strong> MI. We included studies that used only newdiagnostic ECG changes or outcome-based MACE (e.g. death, non-fatal MI or life-threatening arrhythmia)alongside a troponin-based reference st<strong>and</strong>ard. We excluded studies that used clinically diagnosed ACS(i.e. by history <strong>and</strong> examination findings alone), undefined or any ECG changes, or process-based MACE(e.g. coronary reperfusion) in the reference st<strong>and</strong>ard.Coronary artery disease was determined by ICA <strong>and</strong> defined in accordance with the primary study.Studies were excluded if coronary angiography was performed only in selected patients, such as thosewith positive CTCA or exercise ECG. The definition <strong>of</strong> MACEs required that at least 80% <strong>of</strong> the cohort befollowed for at least 30 days <strong>and</strong> that a MACE included, at least, cardiac death <strong>and</strong> non-fatal MI.OutcomesSufficient data were required to construct tables <strong>of</strong> diagnostic test performance, i.e. numbers <strong>of</strong> truepositives(TPs), false-negatives (FNs), false-positives (FPs) <strong>and</strong> true-negatives (TNs). If raw numbers were notreported we attempted to calculate these data from sensitivity <strong>and</strong> specificity, using prevalence <strong>and</strong> totalnumber analysed to calculate the denominators. Studies were excluded from <strong>analysis</strong> as ‘unable to extractdata’ if these calculations were not possible or yielded markedly inconsistent data.Data abstraction strategyData abstraction <strong>of</strong> each study was performed by one <strong>review</strong>er (CC, MK or JL) into a st<strong>and</strong>ardiseddata extraction form <strong>and</strong> independently checked for accuracy by a second <strong>review</strong>er (CC, MK, JL or SG).Discrepancies were resolved by discussion between the two <strong>review</strong>ers <strong>and</strong> if agreement could not bereached, the principal investigator was consulted (SG). Where multiple publications <strong>of</strong> the same study wereidentified, data were extracted <strong>and</strong> reported as a single study. Where there was possible overlap betweencohorts reported from the same author group or study centre we excluded data from one <strong>of</strong> the cohortsto avoid duplication.© Queen’s Printer <strong>and</strong> Controller <strong>of</strong> HMSO 2013. This work was produced by Goodacre et al. under the terms <strong>of</strong> a commissioning contract issued by the Secretary <strong>of</strong> Statefor Health. This issue may be freely reproduced for the purposes <strong>of</strong> private research <strong>and</strong> study <strong>and</strong> extracts (or indeed, the full report) may be included in pr<strong>of</strong>essional journalsprovided that suitable acknowledgement is made <strong>and</strong> the reproduction is not associated with any form <strong>of</strong> advertising. Applications for commercial reproduction should beaddressed to: NIHR Journals Library, National Institute for Health Research, Evaluation, Trials <strong>and</strong> Studies Coordinating Centre, Alpha House, University <strong>of</strong> Southampton SciencePark, Southampton SO16 7NS, UK.11

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!