learning - Academic Conferences Limited

learning - Academic Conferences Limited learning - Academic Conferences Limited

academic.conferences.org
from academic.conferences.org More from this publisher
27.06.2013 Views

Martin Cápay et al. of Likert scales. We compared electronic testing to traditional (“paper”) testing using a scale with seven point scale between the options stated as antonyms, e.g. we used the scale objective vs. subjective. The question was: Do you think that traditional testing is objective 1 2 3 4 5 6 7 subjective effective 1 2 3 4 5 6 7 ineffective etc. We used nine scales (Figure 1, Figure 2). If the respondent marked number 4, it meant that he/she regards the particular statement neutrally. On the other hand, marking any other option from given scale, denoted respondent’s inclination to certain term (on the left or on the right side of the scale). The results may be compared to the balance pans - one of the terms tips the scales according to the value it was given by the respondent while the pans are balanced if the respondent does not prefer any of the terms (antonym responses to the statement). 2.2 Research outcomes One of the findings of our survey was that the students did not clearly prefer computer testing and evaluation to teacher’s assessment. We asked them about the perception of two terms, electronic testing (Figure 1) and “traditional” (paper) testing (Figure 2). Figure 1: Comparison of responses in particular phases. Students’ and teachers’ perception of the term “electronic” testing The research showed that the attitude of students is to large extent influenced by the level of their previous experience with e-testing. In spite of the fact that testing is in all mentioned groups perceived as modern, effective and interesting, it is not completely accepted by all the students, nor is it considered to be objective. Students who were tested only traditionally (answering the questions on a paper) claimed they would like to have the opportunity to be tested electronically. Those who experienced both traditional and electronic testing partly preferred the traditional way of testing. Finally, the students tested only using electronic tests expressed mostly positive attitude toward this testing method (Figure 1 and Figure 2). Based on the responses to other questions in the questionnaire in which 5-choice Lickert scales were used, we found out that students’ perception of this type of testing depends on whether classification is the objective of the testing or not. The students preferred combined form of testing where the teacher still plays the essential role. In some cases they also required to check the automatically evaluated tests – in these cases the teacher went through the test again with the student and checked the answers. 84

Martin Cápay et al. Figure 2: Comparison of responses in particular phases, students’ and teachers’ perception of the term “traditional” testing (note: The data of the 3 rd group are not available) On the other hand, we expected a little more traditional view in teachers’ responses but the answers exposed their modern thinking. Teachers perceive e-testing assuredly more positively. However, the survey showed that in spite of positive view of e-testing, this method still remains very doubtful, mainly in the tests used for grading. The biggest complaints from the students, and partially from the teachers as well, were directed to the display of remaining time, which according to their opinion rose their nervousness during the testing. We also found out several differences between the students’ and the teachers’ point of view on advantages and disadvantages of electronic testing (Cápay and Tomanová 2010). Some of the students’ responses on disadvantages of e-testing could be summed up as the lack of multimedia features – the possibility to demonstrate the problem. From the teachers’ point of view the absence of the question parameterisation was among the most often mentioned disadvantages. Therefore we endeavoured to improve these two drawbacks in the tests implemented in LMS Moodle in the following years. 3. Increase of testing possibilities in LMS Moodle One of the possibilities to increase the testing effectiveness is creation of models (Balogh at al.) focusing on the methods of adaptive providing of study materials (Kapusta et al, 2009) and conditioned tests. LMS Moodle is an open system, which means it should not be a problem to suggest a concept of involving multimedia elements and/or the parameterised questions and implement it into the system. 3.1 Parameterisation of the questions LMS Moodle offers quiz questions with the Calculated answers with a collection of input parameters generated for each question. These parameters are inserted automatically into the question text and are unique for each student. Currently it is possible to enter a prescription (function) in the process of inputting the parameters to one output (problem solution). However, it has some limitations. That is why we also need to consider some other possibilities, e.g. the response in the form of clicking to a particular part of a picture map, the question in form of flash application, etc., to solve this problem. Gangur (2011) shows an example of generating a unique test containing cloze questions in the selected LMS. He proposes cloze questions to be generated in the XML structure (Figure 3) and later it can be transformed to a more suitable form. 85

Martin Cápay et al.<br />

of Likert scales. We compared electronic testing to traditional (“paper”) testing using a scale with<br />

seven point scale between the options stated as antonyms, e.g. we used the scale objective vs.<br />

subjective. The question was: Do you think that traditional testing is<br />

objective 1 2 3 4 5 6 7 subjective<br />

effective 1 2 3 4 5 6 7 ineffective etc.<br />

We used nine scales (Figure 1, Figure 2). If the respondent marked number 4, it meant that he/she<br />

regards the particular statement neutrally. On the other hand, marking any other option from given<br />

scale, denoted respondent’s inclination to certain term (on the left or on the right side of the scale).<br />

The results may be compared to the balance pans - one of the terms tips the scales according to the<br />

value it was given by the respondent while the pans are balanced if the respondent does not prefer<br />

any of the terms (antonym responses to the statement).<br />

2.2 Research outcomes<br />

One of the findings of our survey was that the students did not clearly prefer computer testing and<br />

evaluation to teacher’s assessment.<br />

We asked them about the perception of two terms, electronic testing (Figure 1) and “traditional”<br />

(paper) testing (Figure 2).<br />

Figure 1: Comparison of responses in particular phases. Students’ and teachers’ perception of the<br />

term “electronic” testing<br />

The research showed that the attitude of students is to large extent influenced by the level of their<br />

previous experience with e-testing. In spite of the fact that testing is in all mentioned groups perceived<br />

as modern, effective and interesting, it is not completely accepted by all the students, nor is it<br />

considered to be objective. Students who were tested only traditionally (answering the questions on a<br />

paper) claimed they would like to have the opportunity to be tested electronically. Those who<br />

experienced both traditional and electronic testing partly preferred the traditional way of testing.<br />

Finally, the students tested only using electronic tests expressed mostly positive attitude toward this<br />

testing method (Figure 1 and Figure 2).<br />

Based on the responses to other questions in the questionnaire in which 5-choice Lickert scales were<br />

used, we found out that students’ perception of this type of testing depends on whether classification<br />

is the objective of the testing or not. The students preferred combined form of testing where the<br />

teacher still plays the essential role. In some cases they also required to check the automatically<br />

evaluated tests – in these cases the teacher went through the test again with the student and checked<br />

the answers.<br />

84

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!