learning - Academic Conferences Limited
learning - Academic Conferences Limited learning - Academic Conferences Limited
Maria-Jesus Martinez-Argüelles et al. Agents that take part in the feedback processes: One of the elements inherent to feedback are the members that take part of its processes. This research has been developed by using a technological platform that integrates among others two applications that make it possible to provide the student with feedback. The first one is the continuous evaluation registry (RAC, for its acronym in Catalan), a space in the virtual classroom where the teacher inserts the marks of the continuous evaluation and facilitates the personalized feedback (which is sent to a private space only shared by teacher and learner). The second one is the calendar and it can be found in the planning space of the virtual classroom. There, the student can accede to the solutions of the continuous evaluation tests (PAC), prepared by the teacher and published one day after the students have submitted their solutions. Space of virtual communication where the feedback processes take place: Another component is the virtual space where the feedback takes place, be it public or private. In this study we analyse the effects of feedback in a private space (from now on personalized feedback). Authors such as [Rice et al., 1994] have proved that personalized feedback (private spaces) has advantages over feedback in public spaces because it fits better to the needs and characteristics of each student. Moment of feedback: To provide immediate or differed feedback has been the object of discussion in several researches on this issue. It is remarkable the proposal made by [Dempsey et al., 1988], that define some categories used in this work. The first one is immediate feedback (it provides the student with information on the correct answer) and in this context it corresponds to the PACs' solutions, published just one day after the students submit their answers. The second one is differed feedback (where the errors made are commented on, some contents are recommended as well as strategies to improve the process of learning), that gives added value to the solution of the PAC. Extension and form of the feedback: Another special feature of feedback in a virtual environment is its extension. It is tightly linked to the semantic dimension of feedback and to the kind of knowledge on which the feedback is given (depending on whether it is more abstract or conceptual or more applied and procedural). In order for the feedback to be effective it must give enough information to university students so as for them to attain the aims of learning previewed. The feedback can have different shapes: text and/or technological multimedia (audio and video recordings, screenshots with audio as well as the possibility to upload compressed videos). The student receives it in the RAC as an attached file or in the message itself. Following Narciss and her collaborators [Narciss 2004, 2008], [Narciss et al., 2004a, 2004b, 2006], in this article we also state that there are other dimensions apart from the semantic and the structural dimension with influence on the feedback processes, as in the case of the pedagogical design. Following we explain the pedagogical framework in which this study has been carried out. 2.1 Pedagogical design One of the defining aspects of this work is the context in which it is carried out. It is an eLearning environment where the process of teaching and learning is conveyed through a technological platform. This work studies the case of the Universitat Oberta de Catalunya (UOC). This university was created in 1995 and from the very beginning has developed its activities in a virtual campus. In the UOC's model of education, the agents of the educative activity do not share the same space and time coordinates. This flexibility that involves that both the student and the teacher enjoy the learning environment from any space and moment (asynchronous communication) needs the educative activity to be based upon communication exchanges between both of them. The UOC's pedagogical model puts the student in the centre of the teaching and learning process (student centred learning, SCL) carried out in a virtual classroom. This virtual classroom has four different areas: planning, communication, resources and evaluation. The evaluation area gathers all aspects related to the evaluation process of a given subject. This study is focused in one of the spaces of the evaluation area: the Continuous Evaluation Registry (RAC for its acronym in Catalan) that is where the personalized feedbacks take place. This personalized feedback consists of introducing marks by the teacher, and/or personalized inputs (sub-dimension 1, error identification and correction, and sub-dimension 3, task improvement). Despite the fact that sub-dimension 2 is not directly dealt with from the RAC (nor it is a direct part of the feedback), some guiding solutions to evaluated activities are given once the submission term is over. Furthermore, when necessary, part of the feedback uses the solutions as a support. 458
Maria-Jesus Martinez-Argüelles et al. During the teaching and learning process, the student counts with the tutor's and the teacher's direct support. The latter is the one that teaches in the virtual classroom, accompanies the student in the development of the teaching and learning process acting both as a facilitator of the educative activity and as expert on the subject he/she is teaching. The UOC's evaluation system is based upon the combination of an educational and time-continuous evaluation, with a final evaluation. The continuous evaluation is based on a series of proposed evaluation tests -continuous evaluation test (PAC)- that are carried out on a time-continuous basis. To this point, the theoretical basis of this study and the context in which it has been developed have been described. It follows the empirical analysis and its results. 3. Implementation It is in the context of research on processes of feedback with the aim to promote construction of knowledge and regulation of learning, still rather incipient in eLearning environments, where this study takes shape. Thus, attaining the objectives proposed in the context of this article will allow us to get results at two different levels: on the one hand, efficiency for the teachers and, on the other hand, efficacy for the students (performance). In this context, considering costs and benefits of implementing personalized feedback, it is necessary to question its usefulness, in order to extend it to other subjects or studies. With the aim to analyse the impact that has the incorporation of personalized feedback to the solution of activities and correction of exercises during the continuous evaluation process, and to make available several technological methodologies as well as their feasibility, diverse pilot tests have been designed according to the following criteria: groups of reduced dimensions (maximum 35 students) per subject have been chosen in order to ensure the teacher's adequate dimensioned task. Subjects have been selected according to the sort of knowledge (structural dimension of feedback) and diverse methodology, apart from considering teachers with different aptitudes, assessing the action's transversality and its possible extension to all of the subjects in the degree. The involved subjects, all of them from the Degree in Business Administration, were: Introduction to business (01.500), Statistics essentials (01.501), Behaviour of economic aggregates (01.508), Economic structure (01.510) and Introduction to accountability (01.520). As pointed out, there was a will to find subjects covering different fields of the degree. From applied economy (Economic structure and Behaviour of economic aggregates) to more methodological subjects (Statistics essentials), including accountancy subjects (Introduction to accountability) and business organization subjects (Introduction to business) (see detail in table 1). Table 1: Summary charter of forecasts made in each subject when carrying out the pilot test Subject Introduction to accountability Statistics essentials Economic structure Behaviour of economic aggregates Introduction to business In all the activities? Yes, with different levels of intensity Yes, with different levels of intensity Yes, with different levels of intensity Yes, with different levels of intensity Yes, with different levels of intensity To whom? PAC1 to everyone. To the rest, depending on the results (D, C- and C+ enough to everyone) and to the rest depending on the errors and evolution Depending on marks categories: C+, C- and D. PAC1 to everyone. To the rest, depending on the results and needs. To everyone with a weak mark and especially to those who fail PAC1 to everyone, to the rest depending of results and needs Level of personalization Individual Depending on the type of error made Individual How? Proposal of feedback PAC1/PAC2: audio and/or textual. The rest video or screenshots The most difficult (PAC2/PAC3):Ca ptures and video. To the rest text/audio. Video and/or audio Depending on Captures/video/te the type of error xt/audio made 459 Individual Video/text/audio To correct errors and guide/improve the learning process To correct errors and guide/improve the learning process Firstly, to motivate. Secondly, to correct errors and guide/improve the learning process To correct errors and re-orient/improve the learning process To correct errors and re-orient/improve the learning process and to motivate
- Page 434 and 435: Sophisticated Usability Evaluation
- Page 436 and 437: Stephanie Linek and Klaus Tochterma
- Page 438 and 439: Stephanie Linek and Klaus Tochterma
- Page 440 and 441: Stephanie Linek and Klaus Tochterma
- Page 442 and 443: Social Networks, eLearning and Inte
- Page 444 and 445: Birgy Lorenz et al. 135 students p
- Page 446 and 447: Birgy Lorenz et al. The experts' st
- Page 448 and 449: Birgy Lorenz et al. Akdeniz, Y. (19
- Page 450 and 451: Arno Louw programmes, and within th
- Page 452 and 453: Arno Louw It should be clearly stat
- Page 454 and 455: Arno Louw somewhat an unwritten con
- Page 456 and 457: Arno Louw Lecturers assume that le
- Page 458 and 459: A treasure hunt has to be done to f
- Page 460 and 461: How to Represent a Frog That can be
- Page 462 and 463: Robert Lucas Occasionally we will a
- Page 464 and 465: Robert Lucas Note the need to creat
- Page 466 and 467: Robert Lucas Figure 5: A model of a
- Page 468 and 469: Learning by Wandering: Towards a Fr
- Page 470 and 471: Marie Martin and Michaela Noakes wa
- Page 472 and 473: Marie Martin and Michaela Noakes Th
- Page 474 and 475: Marie Martin and Michaela Noakes is
- Page 476 and 477: Linda Martin et al. across the sect
- Page 478 and 479: Linda Martin et al. confidence. Alt
- Page 480 and 481: 8. Conclusion Linda Martin et al. T
- Page 482 and 483: Personalized e-Feedback and ICT Mar
- Page 486 and 487: Source: Own elaboration from survey
- Page 488 and 489: Maria-Jesus Martinez-Argüelles et
- Page 490 and 491: Maria-Jesus Martinez-Argüelles et
- Page 492 and 493: 1.1 Semantic dimension Maria-Jesús
- Page 494 and 495: 2. Methodology Maria-Jesús Martín
- Page 496 and 497: Maria-Jesús Martínez-Argüelles e
- Page 498 and 499: Maria-Jesús Martínez-Argüelles e
- Page 500 and 501: David Mathew members of staff frigh
- Page 502 and 503: David Mathew disclose this informat
- Page 504 and 505: David Mathew baboon smells the wate
- Page 506 and 507: Peter Mikulecky framing learning, p
- Page 508 and 509: Peter Mikulecky inhabitants or work
- Page 510 and 511: Acknowledgements Peter Mikulecky Th
- Page 512 and 513: Karen Hughes Miller and Linda Leake
- Page 514 and 515: Karen Hughes Miller and Linda Leake
- Page 516 and 517: Karen Hughes Miller and Linda Leake
- Page 518 and 519: An Analysis of Collaborative Learni
- Page 520 and 521: 2.3 Flexible and accessible learnin
- Page 522 and 523: 3.1 Definition of case study Peter
- Page 524 and 525: Peter Mkhize et al. Basically, soci
- Page 526 and 527: Peter Mkhize et al. you’ve got yo
- Page 528 and 529: Ideas for Using Critical Incidents
- Page 530 and 531: Jonathan Moizer and Jonathan Lean I
- Page 532 and 533: Jonathan Moizer and Jonathan Lean o
Maria-Jesus Martinez-Argüelles et al.<br />
Agents that take part in the feedback processes: One of the elements inherent to feedback are<br />
the members that take part of its processes. This research has been developed by using a<br />
technological platform that integrates among others two applications that make it possible to<br />
provide the student with feedback. The first one is the continuous evaluation registry (RAC, for its<br />
acronym in Catalan), a space in the virtual classroom where the teacher inserts the marks of the<br />
continuous evaluation and facilitates the personalized feedback (which is sent to a private space<br />
only shared by teacher and learner). The second one is the calendar and it can be found in the<br />
planning space of the virtual classroom. There, the student can accede to the solutions of the<br />
continuous evaluation tests (PAC), prepared by the teacher and published one day after the<br />
students have submitted their solutions.<br />
Space of virtual communication where the feedback processes take place: Another component is<br />
the virtual space where the feedback takes place, be it public or private. In this study we analyse<br />
the effects of feedback in a private space (from now on personalized feedback). Authors such as<br />
[Rice et al., 1994] have proved that personalized feedback (private spaces) has advantages over<br />
feedback in public spaces because it fits better to the needs and characteristics of each student.<br />
Moment of feedback: To provide immediate or differed feedback has been the object of<br />
discussion in several researches on this issue. It is remarkable the proposal made by [Dempsey<br />
et al., 1988], that define some categories used in this work. The first one is immediate feedback (it<br />
provides the student with information on the correct answer) and in this context it corresponds to<br />
the PACs' solutions, published just one day after the students submit their answers. The second<br />
one is differed feedback (where the errors made are commented on, some contents are<br />
recommended as well as strategies to improve the process of <strong>learning</strong>), that gives added value to<br />
the solution of the PAC.<br />
Extension and form of the feedback: Another special feature of feedback in a virtual environment<br />
is its extension. It is tightly linked to the semantic dimension of feedback and to the kind of<br />
knowledge on which the feedback is given (depending on whether it is more abstract or<br />
conceptual or more applied and procedural). In order for the feedback to be effective it must give<br />
enough information to university students so as for them to attain the aims of <strong>learning</strong> previewed.<br />
The feedback can have different shapes: text and/or technological multimedia (audio and video<br />
recordings, screenshots with audio as well as the possibility to upload compressed videos). The<br />
student receives it in the RAC as an attached file or in the message itself.<br />
Following Narciss and her collaborators [Narciss 2004, 2008], [Narciss et al., 2004a, 2004b, 2006], in<br />
this article we also state that there are other dimensions apart from the semantic and the structural<br />
dimension with influence on the feedback processes, as in the case of the pedagogical design.<br />
Following we explain the pedagogical framework in which this study has been carried out.<br />
2.1 Pedagogical design<br />
One of the defining aspects of this work is the context in which it is carried out. It is an eLearning<br />
environment where the process of teaching and <strong>learning</strong> is conveyed through a technological<br />
platform. This work studies the case of the Universitat Oberta de Catalunya (UOC). This university<br />
was created in 1995 and from the very beginning has developed its activities in a virtual campus. In<br />
the UOC's model of education, the agents of the educative activity do not share the same space and<br />
time coordinates. This flexibility that involves that both the student and the teacher enjoy the <strong>learning</strong><br />
environment from any space and moment (asynchronous communication) needs the educative<br />
activity to be based upon communication exchanges between both of them.<br />
The UOC's pedagogical model puts the student in the centre of the teaching and <strong>learning</strong> process<br />
(student centred <strong>learning</strong>, SCL) carried out in a virtual classroom. This virtual classroom has four<br />
different areas: planning, communication, resources and evaluation. The evaluation area gathers all<br />
aspects related to the evaluation process of a given subject. This study is focused in one of the<br />
spaces of the evaluation area: the Continuous Evaluation Registry (RAC for its acronym in Catalan)<br />
that is where the personalized feedbacks take place. This personalized feedback consists of<br />
introducing marks by the teacher, and/or personalized inputs (sub-dimension 1, error identification<br />
and correction, and sub-dimension 3, task improvement). Despite the fact that sub-dimension 2 is not<br />
directly dealt with from the RAC (nor it is a direct part of the feedback), some guiding solutions to<br />
evaluated activities are given once the submission term is over. Furthermore, when necessary, part of<br />
the feedback uses the solutions as a support.<br />
458