Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ...

6.3 Analysis of the mid-test interview 6 INTERVIEW EVALUATION
6.3 Analysis of the mid-test interview
6.3.1 3-Layer-Model
During the mid-test interview the test candidates stated their opinion about the
complexity, the advantages and the problems of the 3-Layer-Model. It could be
observed that the members throughout the educational experts group graded the
3-Layer-Model as rather complex (cf. table 23 on page 250). They were able to
understand the chosen terminology of the tags based on their pedagogical edu-
cation, however, most of them needed two or more explanations of the 3-Layer-
Model. During the manual markup tests those evaluation candidates used their
experience from education to apply the 3-Layer-Model more with a sense of logic
than with real understanding of the underlying concept. The test candidates that
are members of the educational experts group could not identify any problems of
the 3-Layer-Model at this point of the test, but also stated that they could not see
any specific purpose of the model either. Therefore, 66% of the participants stated
that they could not see any specific advantages of the model at that specific mo-
ment of the test. However, 22% of the test candidates said that they could imagine
that the 3-Layer-Model might help them to structure their educational content (cf.
table 24 on page 250).
In contrast to the educational experts, the technical experts did not have such
big problems understanding the 3-Layer-Model. They rather showed good under-
standing of the model. They also stated in the interview that they could not see
any problems or advantages of the 3-Layer-Model at that stage of the evaluation.
One member of the whole group stated that the model was possibly not complex
enough to cover all possible teaching and material situations. This person has both
high educational and technical expertise (cf. table 23 on page 250) and therefore
was able to consider the model from different points of view.
Furthermore, 44% of the participants stated that they did not have any specific
problems with the EFTECS so far. 22% said that it was too theoretical without
a supporting software tool and another 22% suggested that the model should be
very flexible and extensible (cf. table 25 on page 250).
153