The Efficacy and Effectiveness of Online CBT - Jeroen Ruwaard
The Efficacy and Effectiveness of Online CBT - Jeroen Ruwaard The Efficacy and Effectiveness of Online CBT - Jeroen Ruwaard
110 Chapter 6. Online CBT in Routine Clinical Practicemeasures were identical to those used in the clinical trials. Full descriptions of thequestionnaires, which are often used in mental health outcome research, can be foundin the reports of these trials (Lange et al., 2001; Lange, van de Ven, & Schrieken,2003; Knaevelsrud & Maercker, 2007, 2009; Wagner et al., 2006; Wagner & Maercker,2007; Ruwaard et al., 2007, 2009, 2010). The psychometric characteristics of thesequestionnaires are satisfactory (PDSS-SR, OLBI) to good (DASS, BDI, IES). In thepresent sample, Cronbach’s alpha’s ranged from α = .73 (OLBI) to α = .95 (DASSDepression).Secondary outcomes. Secondary outcomes were pre-to-post-treatment changes ingeneral psychopathology, and patient satisfaction. General psychopathology wasassessed through the total score of the DASS (42 items; range: 0-126), which providesa global measure of negative emotional symptoms (Lovibond & Lovibond, 1995). Inthe present sample, the internal consistency of this measure was excellent (Cronbach’salpha: α = .97). Patient satisfaction was assessed through a brief evaluationquestionnaire, which was administered at posttest. Patients rated the contact withtheir therapists (on a 1-10 scale), and stated whether they perceived the treatment aseffective, whether they had missed the face to face contact, and whether they wouldrecommend the treatment to others (Yes/No/Don’t know).6.1.5 Statistical analysesStatistical significance and effect size We estimated treatment effects throughmulti-level mixed-model repeated measures regression (MMRM) (Verbeke & Molenberghs,2000), using the statistical software package R (R Development Core Team,2008). Time of measurement was coded to contrast mean baseline scores to a) meanscores at the short-term posttreatment assessments (i.e., the post-test and the 6-weekfollow-up), and b) mean scores at one-year follow-up. Separate analyses were conductedon data from each treatment and each outcome measure, using two-sided testsand Bonferroni corrections to ensure a family-wise significance level of α = .05. Wefitted three-level regression models, with repeated measurements nested in patientsat level 1, patients nested in therapists at level 2, and therapists at level 3 (Wampold& Serlin, 2000). Conditional intraclass correlations (ICC; Bickel, 2007) revealed that
6.2. Results 1112% of the variance in outcome was attributable to differences between therapists(mean ICC = .02; range: .001 - 0.13). To express effect sizes as Cohen’s d d (J. Cohen,1988), fixed effect regression estimates and associated 95% confidence intervals weredivided by pretest standard deviations.Reliable and clinically significant change Following principles set out by Jacobsonand Truax (1991), pre- to post-treatment change scores of each patient were classifiedas follows: a) deterioration (change was negative and statistically reliable, i.e., itexceeded 1.96 times the standard error of the difference, b) no change (changewas not statistically reliable), c) improvement (change was positive and statisticallyreliable), or d) recovery (change was positive, statistically reliable, and involved achange from a score above clinical cut-off to a score below this cut-off). Analyses wereconducted on observed data of the full sample (i.e., N = 1500, assuming no change inthe patients, who did not complete post-test measurements) as well as the completersample (i.e., those patients, who completed the full treatment and post-treatmentassessment).6.2 Results6.2.1 Sample selectionTo obtain 1500 records of patients who started treatment, 3003 patient records wereretrieved from the database. Figure 6.1 shows that 507 (17%) of the applicants didnot start baseline assessment, 843 (28%) withdrew during assessment, 153 (5%)were referred to other mental health institutions, while 50% (N = 1500) startedtreatment. The available data did not allow for a systematic analysis of the reasonsof voluntary pre-treatment withdrawal. Of the 1500 accepted patients, 413 (28%)started Web-CBT for depression, 139 (9%) started Web-CBT for panic disorder, 478(32%) started Web-CBT for posttraumatic stress, and 470 (31%) started Web-CBT forburnout. Patients were treated by a total of 135 therapists (depression: n = 74; panicdisorder: n = 24; posttraumatic stress: n = 65; burnout: n = 51).
- Page 68 and 69: Ruwaard, J., Broeksteeg, J., Schrie
- Page 70 and 71: 62 Chapter 4. Online CBT of Panic S
- Page 72 and 73: 64 Chapter 4. Online CBT of Panic S
- Page 74 and 75: 66 Chapter 4. Online CBT of Panic S
- Page 76 and 77: 68 Chapter 4. Online CBT of Panic S
- Page 78 and 79: 70 Chapter 4. Online CBT of Panic S
- Page 80 and 81: 72 Chapter 4. Online CBT of Panic S
- Page 82 and 83: 74 Chapter 4. Online CBT of Panic S
- Page 84 and 85: 76 Chapter 4. Online CBT of Panic S
- Page 86 and 87: 78 Chapter 4. Online CBT of Panic S
- Page 88 and 89: 80 Chapter 4. Online CBT of Panic S
- Page 90 and 91: 82 Chapter 4. Online CBT of Panic S
- Page 92 and 93: Ruwaard, J., Lange, A., Broeksteeg,
- Page 94 and 95: 86 Chapter 5. Online CBT of Bulimic
- Page 96 and 97: 88 Chapter 5. Online CBT of Bulimic
- Page 98 and 99: 90 Chapter 5. Online CBT of Bulimic
- Page 100 and 101: 92 Chapter 5. Online CBT of Bulimic
- Page 102 and 103: 94 Chapter 5. Online CBT of Bulimic
- Page 104 and 105: 96 Chapter 5. Online CBT of Bulimic
- Page 106 and 107: 98 Chapter 5. Online CBT of Bulimic
- Page 108 and 109: 100 Chapter 5. Online CBT of Bulimi
- Page 110 and 111: 102 Chapter 5. Online CBT of Bulimi
- Page 112 and 113: Ruwaard, J., Lange, A., Schrieken,
- Page 114 and 115: 106 Chapter 6. Online CBT in Routin
- Page 116 and 117: 108 Chapter 6. Online CBT in Routin
- Page 120 and 121: 112 Chapter 6. Online CBT in Routin
- Page 122 and 123: 114 Chapter 6. Online CBT in Routin
- Page 124 and 125: 116 Chapter 6. Online CBT in Routin
- Page 126 and 127: 118 Chapter 6. Online CBT in Routin
- Page 128 and 129: 120 Chapter 6. Online CBT in Routin
- Page 130 and 131: 122 Chapter 6. Online CBT in Routin
- Page 133 and 134: Chapter 7General DiscussionPrevious
- Page 135 and 136: 7.1. Key Findings 1277.1.2 The effe
- Page 137 and 138: 7.1. Key Findings 129Work−related
- Page 139 and 140: 7.2. Strengths and limitations 1317
- Page 141 and 142: 7.2. Strengths and limitations 133s
- Page 143 and 144: 7.3. Implications for clinical prac
- Page 145 and 146: 7.4. Suggestions for future researc
- Page 147: 7.5. Conclusion 139Post-treatment b
- Page 150 and 151: 142 Summaryof the introduction prov
- Page 152 and 153: 144 Summarythat face-to-face contac
- Page 154 and 155: 146 Summarycomplex, routine practic
- Page 157 and 158: SamenvattingIn 1997 ontwikkelden on
- Page 159 and 160: Samenvatting 151startten direct met
- Page 161 and 162: Samenvatting 153up-metingen suggere
- Page 163 and 164: Samenvatting 155ongeveer gelijk zou
- Page 165 and 166: ReferencesAben, I., Verhey, F., Lou
- Page 167 and 168: References 159Bickel, R. (2007). Mu
6.2. Results 1112% <strong>of</strong> the variance in outcome was attributable to differences between therapists(mean ICC = .02; range: .001 - 0.13). To express effect sizes as Cohen’s d d (J. Cohen,1988), fixed effect regression estimates <strong>and</strong> associated 95% confidence intervals weredivided by pretest st<strong>and</strong>ard deviations.Reliable <strong>and</strong> clinically significant change Following principles set out by Jacobson<strong>and</strong> Truax (1991), pre- to post-treatment change scores <strong>of</strong> each patient were classifiedas follows: a) deterioration (change was negative <strong>and</strong> statistically reliable, i.e., itexceeded 1.96 times the st<strong>and</strong>ard error <strong>of</strong> the difference, b) no change (changewas not statistically reliable), c) improvement (change was positive <strong>and</strong> statisticallyreliable), or d) recovery (change was positive, statistically reliable, <strong>and</strong> involved achange from a score above clinical cut-<strong>of</strong>f to a score below this cut-<strong>of</strong>f). Analyses wereconducted on observed data <strong>of</strong> the full sample (i.e., N = 1500, assuming no change inthe patients, who did not complete post-test measurements) as well as the completersample (i.e., those patients, who completed the full treatment <strong>and</strong> post-treatmentassessment).6.2 Results6.2.1 Sample selectionTo obtain 1500 records <strong>of</strong> patients who started treatment, 3003 patient records wereretrieved from the database. Figure 6.1 shows that 507 (17%) <strong>of</strong> the applicants didnot start baseline assessment, 843 (28%) withdrew during assessment, 153 (5%)were referred to other mental health institutions, while 50% (N = 1500) startedtreatment. <strong>The</strong> available data did not allow for a systematic analysis <strong>of</strong> the reasons<strong>of</strong> voluntary pre-treatment withdrawal. Of the 1500 accepted patients, 413 (28%)started Web-<strong>CBT</strong> for depression, 139 (9%) started Web-<strong>CBT</strong> for panic disorder, 478(32%) started Web-<strong>CBT</strong> for posttraumatic stress, <strong>and</strong> 470 (31%) started Web-<strong>CBT</strong> forburnout. Patients were treated by a total <strong>of</strong> 135 therapists (depression: n = 74; panicdisorder: n = 24; posttraumatic stress: n = 65; burnout: n = 51).