Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ...
Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ... Guenter Hilmer - Phd Thesis - Glamorgan Dspace - University of ...
8.2 Review of the HEAT 8 DISCUSSION with pen and paper or with the HEAT. This means that the basic functionality of the HEAT is given. 8.2.3 Existing material The aim of the practical evaluation was to gain additional insights into the func- tionality of the EFTECS and HEAT. The first part of the practical evaluation of the HEAT was designed to convert some pre-existing educational material. The selected material included parts of two different course books as described in chapter 7. Basically, all the material could be converted, which can be regarded as a proof of the functionality of the HEAT. However, the conversion of the material with the HEAT proved to be not as straightforward as it had been expected to be. Therefore, the evaluation provided some valuable information about the limita- tions of the HEAT and its usage. First of all, the author is not an educational expert in the domain of the selected material. Therefore, it was not possible to just convert the material, but the author had to understand the contents of the selected material. It can be said that the author had to acquire some knowledge about the material domain to successfully convert the material. Additionally, the availability of only four TLSs was a restriction concerning the conversion process. As it was pointed out in section 7.2.2 more and specially designed TLSs would have been beneficial to the conversion task. A direct con- sequence of the lack of specialised TLSs is that the authored material had to be restructured in such a way that it could fit into the available TLSs. Finally, the conversion of the educational material resulted in the question of mass conversion of pre-existing material. Consequently, the need for interfaces for stan- dard file-formats like Microsoft Word or Microsoft Power Point was identified during the authoring of pre-existing material. However, these issues will have to be addressed in the future due to restrictions of time and resources within this PhD. 188
8.2 Review of the HEAT 8 DISCUSSION Altogether, the conversion of the pre-existing material revealed several problems of the HEAT. Therefore, it was decided to create some additional material from scratch to evaluate those problems and to gain some further insights into the ca- pabilities of the HEAT. 8.2.4 New material After the conversion of pre-existing material (cf. section 7.2) it was decided to verify the gained insights by creating some educational material from scratch. The creation of material in a domain where the author was not only a technical ex- pert but an educational expert as well, was successfully completed and described in section 7.3. In comparison to the conversion of pre-existing material it was stated that it was much easier to create educational material with the HEAT if the material was taken from the author’s own knowledge domain. Since the usability of the HEAT was shown during the interview evaluation, the fact that the author’s expertise and knowledge in the domain of the educational material had a direct influence on the usability of the HEAT must lead to the con- clusion that the HEAT and the EFTECS are designed in a way that the educational background of the author outweighs the his technical experience. Additionally, it seems that it is easier for the author to use the HEAT and the EFTECS if he has got some expertise and knowledge concerning the educational domain. At another point of the creation process, it was discovered that additional TLSs would be helpful to improve the usability and handling of the HEAT. The observa- tion that additional and specialised TLSs are needed in the HEAT was also made during the practical evaluation and the interview evaluation. It can therefore be stated that future work (cf. section 9.2) will have to address the creation of such additional TLSs. The design of the EFTECS and the HEAT is expected to allow that without major problems. Altogether, the practical evaluation of the HEAT showed that there were some minor problems which will have to be addressed in the future. 189
- Page 137 and 138: 5.2 Design of the interview evaluat
- Page 139 and 140: 5.2 Design of the interview evaluat
- Page 141 and 142: 5.2 Design of the interview evaluat
- Page 143 and 144: 5.3 Design of the practical evaluat
- Page 145 and 146: 6 Interview evaluation 6 INTERVIEW
- Page 147 and 148: 6.1 Analysis of the pre-test interv
- Page 149 and 150: 6.1 Analysis of the pre-test interv
- Page 151 and 152: 6.2 Analysis of the manual markup t
- Page 153 and 154: 6.3 Analysis of the mid-test interv
- Page 155 and 156: 6.3 Analysis of the mid-test interv
- Page 157 and 158: 6.4 Analysis of the HEAT based mark
- Page 159 and 160: 6.4 Analysis of the HEAT based mark
- Page 161 and 162: 6.5 Analysis of the post-test inter
- Page 163 and 164: 6.5 Analysis of the post-test inter
- Page 165 and 166: 7 Practical evaluation 7 PRACTICAL
- Page 167 and 168: 7.1 Design 7 PRACTICAL EVALUATION O
- Page 169 and 170: 7.2 Existing material 7 PRACTICAL E
- Page 171 and 172: 7.2 Existing material 7 PRACTICAL E
- Page 173 and 174: 7.3 New material 7 PRACTICAL EVALUA
- Page 175 and 176: 7.3 New material 7 PRACTICAL EVALUA
- Page 177 and 178: 7.4 Summary 7 PRACTICAL EVALUATION
- Page 179 and 180: 7.4 Summary 7 PRACTICAL EVALUATION
- Page 181 and 182: 8 Discussion 8 DISCUSSION The insig
- Page 183 and 184: 8.1 Review of the EFTECS 8 DISCUSSI
- Page 185 and 186: 8.1 Review of the EFTECS 8 DISCUSSI
- Page 187: 8.2 Review of the HEAT 8 DISCUSSION
- Page 191 and 192: 8.2 Review of the HEAT 8 DISCUSSION
- Page 193 and 194: 8.3 Critique of the study 8 DISCUSS
- Page 195 and 196: 9 Conclusions 9 CONCLUSIONS In this
- Page 197 and 198: 9.1 Research objectives 9 CONCLUSIO
- Page 199 and 200: 9.2 Future work 9 CONCLUSIONS 9.2 F
- Page 201 and 202: 9.2 Future work 9 CONCLUSIONS Howev
- Page 203 and 204: 9.2 Future work 9 CONCLUSIONS therm
- Page 205 and 206: 9.3 Contribution to knowledge 9 CON
- Page 207 and 208: REFERENCES REFERENCES [10] Robert J
- Page 209 and 210: REFERENCES REFERENCES [30] Kendall
- Page 211 and 212: REFERENCES REFERENCES [49] Barbara
- Page 213 and 214: REFERENCES REFERENCES [68] A.W. Str
- Page 215 and 216: REFERENCES REFERENCES [88] Melanie
- Page 217 and 218: REFERENCES REFERENCES [110] The Dep
- Page 219 and 220: REFERENCES REFERENCES [131] David A
- Page 221 and 222: REFERENCES REFERENCES [151] Michael
- Page 223 and 224: REFERENCES REFERENCES [174] Allianc
- Page 225 and 226: A Appendices 225 A APPENDICES
- Page 227 and 228: A.1 Evaluation tasksheet A APPENDIC
- Page 229 and 230: A.1 Evaluation tasksheet A APPENDIC
- Page 231 and 232: A.1 Evaluation tasksheet A APPENDIC
- Page 233 and 234: A.1 Evaluation tasksheet A APPENDIC
- Page 235 and 236: A.1 Evaluation tasksheet A APPENDIC
- Page 237 and 238: A.1 Evaluation tasksheet A APPENDIC
8.2 Review <strong>of</strong> the HEAT 8 DISCUSSION<br />
Altogether, the conversion <strong>of</strong> the pre-existing material revealed several problems<br />
<strong>of</strong> the HEAT. Therefore, it was decided to create some additional material from<br />
scratch to evaluate those problems and to gain some further insights into the ca-<br />
pabilities <strong>of</strong> the HEAT.<br />
8.2.4 New material<br />
After the conversion <strong>of</strong> pre-existing material (cf. section 7.2) it was decided to<br />
verify the gained insights by creating some educational material from scratch.<br />
The creation <strong>of</strong> material in a domain where the author was not only a technical ex-<br />
pert but an educational expert as well, was successfully completed and described<br />
in section 7.3.<br />
In comparison to the conversion <strong>of</strong> pre-existing material it was stated that it was<br />
much easier to create educational material with the HEAT if the material was taken<br />
from the author’s own knowledge domain.<br />
Since the usability <strong>of</strong> the HEAT was shown during the interview evaluation, the<br />
fact that the author’s expertise and knowledge in the domain <strong>of</strong> the educational<br />
material had a direct influence on the usability <strong>of</strong> the HEAT must lead to the con-<br />
clusion that the HEAT and the EFTECS are designed in a way that the educational<br />
background <strong>of</strong> the author outweighs the his technical experience. Additionally, it<br />
seems that it is easier for the author to use the HEAT and the EFTECS if he has<br />
got some expertise and knowledge concerning the educational domain.<br />
At another point <strong>of</strong> the creation process, it was discovered that additional TLSs<br />
would be helpful to improve the usability and handling <strong>of</strong> the HEAT. The observa-<br />
tion that additional and specialised TLSs are needed in the HEAT was also made<br />
during the practical evaluation and the interview evaluation. It can therefore be<br />
stated that future work (cf. section 9.2) will have to address the creation <strong>of</strong> such<br />
additional TLSs. The design <strong>of</strong> the EFTECS and the HEAT is expected to allow<br />
that without major problems.<br />
Altogether, the practical evaluation <strong>of</strong> the HEAT showed that there were some<br />
minor problems which will have to be addressed in the future.<br />
189