01 NRDC Dyslexia 1-88 update - Texthelp

01 NRDC Dyslexia 1-88 update - Texthelp 01 NRDC Dyslexia 1-88 update - Texthelp

19.10.2014 Views

80 Research Report devising. There might be assignment bias, which can occur when members of the intervention group differ from controls in ways that predict a better response to the intervention, perhaps by having higher motivation or greater ability. Although there are procedures to avoid these kinds of bias, they are not always followed in intervention studies. A fourth group of challenges is associated with shortcomings in the administration of the intervention, such as insufficient treatment duration, differential withdrawal from the programme on the part of successful and unsuccessful participants, or lack of follow-up to determine whether the intervention has had a lasting effect. Inappropriate statistical analyses, especially those which violate the assumptions of the tests used, are not uncommon. These violations can suggest that differences in outcome are statistically significant when they could have occurred by chance. Alternatively, differences in outcome might be statistically significant but trivial to the policy-maker. A further question can be asked of any apparently-effective intervention, namely: ‘Will it be effective for others?’ This is an especially pertinent question to ask of the lateral visual masking study of ‘four severe adult dyslexics’ by Geiger et al. (1992). Even if the initial diagnosis was accurate (and if the intervention addressed the participants’ problem successfully), no finding from such a small-scale study can be generalised with confidence to a larger population. For future researchers, studies like this one can be important, but for policy-makers they offer little guidance. A different question can be asked of the study of thirty college students (Guyer, Banks, & Guyer, 1993): ‘Is the superior intervention the most effective one available?’ One of the two interventions in the comparison was an explicit, structured remedial spelling programme using analytic and synthetic phonics. The comparison programme ‘taught spelling using a non-phonetic approach’. In effect, the programmes were horses for different courses, one for regularly-spelled words and one for irregular words. The outcome was that the ‘regular’ horse ran faster than the ‘irregular’ horse, since most spellings are regular. Readers of a specialist dyslexia journal might be disposed to believe that the ‘regular’ horse (in the form of an Orton- Gillingham programme) would have won the gold cup in any comparison, but in this comparison the race was fixed and the finding offers no answer to the question. There are many pitfalls in evaluation research. How can we know what really works? What kinds of intervention study are likely to offer reliable guidance to tutors? This is not an idle question. The design of intervention studies is exacting in any circumstances; it is especially so when the participants are hard to reach. Perhaps for these reasons, there are many design limitations in existing reading intervention research (Abadzi, 1994; Beder, 1999; Lyon & Moats, 1997; Simmerman & Swanson, 2001; Torgerson et al., 2002). Nevertheless, a good intervention study should satisfy a number of criteria. They include: ■ ■ ■ a focused research question, specifying a theoretically plausible mechanism of change; a design that permits investigators to minimise the effects of extraneous variables, such as teacher effects and differences in motivation; a large enough sample to reduce the possibility that the outcomes of the intervention might have occurred by chance;

Developmental dyslexia in adults: a research review 81 ■ ■ ■ ■ ■ ■ a stable enough sample for attrition not to call the findings into question; a sample described in sufficient detail for researchers to determine whether the intervention is differentially effective on demographic and psychometric criteria; an intervention curriculum specified as to content, teaching method and duration; appropriate, reliable and validated tests, with different forms at pre- and post-testing and test administration that scrupulously follows the test protocols; assessment of whether the new knowledge and skills are then applied to materials not originally part of the intervention; and assessment of whether new knowledge and skills are retained in the long term. One suggested hierarchy of intervention research methods has listed, in descending order of reliability: ■ ■ ■ ■ ■ experimental designs employing two identical groups of participants assigned randomly to treatment and control groups; quasi-experimental designs, employing apparently identical (matched) but non-randomly assigned treatment and control groups; correlational designs, employing non-identical treatment and control groups but with statistical controls for differences that may be important; correlational designs with non-identical treatment and control groups, on an assumption that the differences between them are unimportant; and case studies, with a treatment group only and an assumption that differences among participants are either obvious or not important. It would be difficult to justify a nationally advocated intervention policy except by reference to designs at the head of this hierarchy. No studies were found that evaluated specific interventions with the mathematical difficulties of adults with dyslexia. No studies were found that evaluated specific interventions with adult dyslexic speakers of English as a second or other language. No studies were found that evaluated reading interventions addressing dyslexics’ difficulties with verbal working memory. No studies were found that evaluated reading interventions addressing dyslexics’ attentional difficulties of any kind (i.e. difficulty in sustaining attention, difficulty in switching attention, or difficulty in selective attention). No studies were found that evaluated reading interventions addressing dyslexics’ difficulties in inferring intention or mood. No studies were found that evaluated reading interventions addressing specific language impairment in dyslexics. No studies were found that evaluated interventions addressing dyslexics’ difficulties with the organisation of thought in writing. Only seven research publications were found which evaluated specific interventions with adult

Developmental dyslexia in adults: a research review 81<br />

■<br />

■<br />

■<br />

■<br />

■<br />

■<br />

a stable enough sample for attrition not to call the findings into question;<br />

a sample described in sufficient detail for researchers to determine whether the intervention is<br />

differentially effective on demographic and psychometric criteria;<br />

an intervention curriculum specified as to content, teaching method and duration;<br />

appropriate, reliable and validated tests, with different forms at pre- and post-testing and test<br />

administration that scrupulously follows the test protocols;<br />

assessment of whether the new knowledge and skills are then applied to materials not<br />

originally part of the intervention; and<br />

assessment of whether new knowledge and skills are retained in the long term.<br />

One suggested hierarchy of intervention research methods has listed, in descending order of<br />

reliability:<br />

■<br />

■<br />

■<br />

■<br />

■<br />

experimental designs employing two identical groups of participants assigned randomly to<br />

treatment and control groups;<br />

quasi-experimental designs, employing apparently identical (matched) but non-randomly<br />

assigned treatment and control groups;<br />

correlational designs, employing non-identical treatment and control groups but with<br />

statistical controls for differences that may be important;<br />

correlational designs with non-identical treatment and control groups, on an assumption that<br />

the differences between them are unimportant; and<br />

case studies, with a treatment group only and an assumption that differences among<br />

participants are either obvious or not important.<br />

It would be difficult to justify a nationally advocated intervention policy except by reference to<br />

designs at the head of this hierarchy.<br />

No studies were found that evaluated specific interventions with the mathematical difficulties<br />

of adults with dyslexia.<br />

No studies were found that evaluated specific interventions with adult dyslexic speakers of<br />

English as a second or other language.<br />

No studies were found that evaluated reading interventions addressing dyslexics’ difficulties<br />

with verbal working memory.<br />

No studies were found that evaluated reading interventions addressing dyslexics’ attentional<br />

difficulties of any kind (i.e. difficulty in sustaining attention, difficulty in switching attention, or<br />

difficulty in selective attention).<br />

No studies were found that evaluated reading interventions addressing dyslexics’ difficulties in<br />

inferring intention or mood.<br />

No studies were found that evaluated reading interventions addressing specific language<br />

impairment in dyslexics.<br />

No studies were found that evaluated interventions addressing dyslexics’ difficulties with the<br />

organisation of thought in writing.<br />

Only seven research publications were found which evaluated specific interventions with adult

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!