Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ...

5.2 Design of the interview evaluation 5 EVALUATION METHODOLOGY
interview sessions to optimise the efficiency of the final interview design. The
major changes to the basic design were:
• Complete interviews were recorded on tape.
• Structured interviews were undertaken at the beginning, the middle and the
end of the test to get meaningful qualitative data.
• Both markup tasks were slightly changed in order to maximise their effec-
tiveness.
The detailed description of the single steps in the final design of the evaluation
will now be explained.
5.2.3 Final design
Based on the results of the pilot study and the basic design of the evaluation, the
following final design of the evaluation was created:
General objectives
The general objectives of this evaluation were:
• Evaluation by teachers from different teaching levels:
One of the major design goals for the 3-Layer-Model was to create a frame-
work that is usable for different teaching levels. Therefore, it was important
for this study to have teachers from different teaching backgrounds, e.g.
university, grammar school, and their corresponding teaching level. Fur-
thermore, it was deemed beneficial to test the framework with teachers from
different educational institutions and countries.
• Evaluation of the concept of creating useful hypermedia material from ex-
isting material:
To evaluate the possibility of converting existing traditionally authored ma-
terial or coursework into a hypermedia context, it was necessary to provide
132