SRI-Teknisk rapport-sen.v13 - DPU

N.3 Is there sufficient justification for why the
study was done the way it was?
N.4 Was the choice of research design appropriate
for addressing the research question(s) posed?
N.5 Have sufficient attempts been made to establish
the repeatability or reliability of data collection
methods or tools?
N.6 Have sufficient attempts been made to establish
the validity or trustworthiness of data collection
tools and methods?
N.7 Have sufficient attempts been made to establish
the repeatability or reliability of data analysis?
N.8 Have sufficient attempts been made to establish
the validity or trustworthiness of data analysis?
N.9 To what extent are the research design and
methods employed able to rule out any other
sources of error/bias which would lead to alternative
explanations for the findings of the study?
118
sary. Teachers reviewed the questionnaires to
ensure that the important outcomes and processes
were being measured.
Yes (please specify)
Yes. The methods are relevant for the aims of the
study, the study is well linked to existing research,
and it is performed at a time where changes in test
performance are measurable. The danger is that
the study links teachers focus on current perceptions
with a long term growth rate.
yes, completely (please specify)
Yes, completely. The study compares changes in
test scores during a period with classroom and
school variables, which seems an adequate way to
monitor consequences of a program over time. It
would have gained by taking into account the
differences within the individual school.
No, none (please specify)
No. We get no insight in the way the register date
or the questionnaires are collected.
Yes, some attempt (please specify)
Yes. The authorities are supposed to give the right
data, and the relevant teachers were reached
through the schools.
Yes (please specify)
Yes. The study uses standard tools and discusses its
use in great detail. The authors discuss possible
consequences of sampling errors.
Yes, good (please specify)
Yes, good. Authors discuss problems with sample
sizes and with comparing an assessment program
that have been in place for several years with
current teacher perceptions.
A little (please specify)
A little. As the authors point out themselves, the
used model ignores important differences that may
exist among teachers (and classes) within schools.
These differences might be bigger than the differences
between schools.
N.10 How generalisable are the study results? Details
The study results seem generalisable. The findings
are not surprising and to a large degree explainable.