Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ...

5.3 Design of the practical evaluation 5 EVALUATION METHODOLOGY
5.3 Design of the practical evaluation
The interview evaluation introduced in section 5.2 had to be extended by a prac-
tical evaluation of the HEAT to create a complete evaluation of the HEAT. The
practical evaluation focused on the extensive production of educational material
with the HEAT.
The selection of the educational material that was converted with the HEAT had
to address several issues to produce the best evaluation results.
Firstly, it was decided to convert educational material from two different topic
areas. This selection was expected to provide insights concerning the influence of
the author’s personal knowledge of the educational material on the conversion of
the educational material with the HEAT.
Secondly, it was important that one part of the educational material had already
been existing in some form, for example a course book, and that the other part of
the educational material was authored from scratch. This approach was expected
to provide some information concerning the influence of pre-existing material on
the authoring process.
Finally, the selected educational material was supposed to cover as many differ-
ent TLSs as possible. Any additional TLSs needed can then be discussed and
addressed in the future work.
The practical evaluation focused on the following aspects:
• Educational Material
The selection of the educational material that was converted during the prac-
tical evaluation was selected in a way that promised the most significant
results.
• EHP-layer
The practical evaluation had to determine how the EHP-layer is applicable
during the creation of educational material.
• TLS-layer
The TLS-layer had to be tested and evaluated during the practical evalua-
142