learning - Academic Conferences Limited

learning - Academic Conferences Limited learning - Academic Conferences Limited

academic.conferences.org
from academic.conferences.org More from this publisher
27.06.2013 Views

Maria-Jesus Martinez-Argüelles et al. Agents that take part in the feedback processes: One of the elements inherent to feedback are the members that take part of its processes. This research has been developed by using a technological platform that integrates among others two applications that make it possible to provide the student with feedback. The first one is the continuous evaluation registry (RAC, for its acronym in Catalan), a space in the virtual classroom where the teacher inserts the marks of the continuous evaluation and facilitates the personalized feedback (which is sent to a private space only shared by teacher and learner). The second one is the calendar and it can be found in the planning space of the virtual classroom. There, the student can accede to the solutions of the continuous evaluation tests (PAC), prepared by the teacher and published one day after the students have submitted their solutions. Space of virtual communication where the feedback processes take place: Another component is the virtual space where the feedback takes place, be it public or private. In this study we analyse the effects of feedback in a private space (from now on personalized feedback). Authors such as [Rice et al., 1994] have proved that personalized feedback (private spaces) has advantages over feedback in public spaces because it fits better to the needs and characteristics of each student. Moment of feedback: To provide immediate or differed feedback has been the object of discussion in several researches on this issue. It is remarkable the proposal made by [Dempsey et al., 1988], that define some categories used in this work. The first one is immediate feedback (it provides the student with information on the correct answer) and in this context it corresponds to the PACs' solutions, published just one day after the students submit their answers. The second one is differed feedback (where the errors made are commented on, some contents are recommended as well as strategies to improve the process of learning), that gives added value to the solution of the PAC. Extension and form of the feedback: Another special feature of feedback in a virtual environment is its extension. It is tightly linked to the semantic dimension of feedback and to the kind of knowledge on which the feedback is given (depending on whether it is more abstract or conceptual or more applied and procedural). In order for the feedback to be effective it must give enough information to university students so as for them to attain the aims of learning previewed. The feedback can have different shapes: text and/or technological multimedia (audio and video recordings, screenshots with audio as well as the possibility to upload compressed videos). The student receives it in the RAC as an attached file or in the message itself. Following Narciss and her collaborators [Narciss 2004, 2008], [Narciss et al., 2004a, 2004b, 2006], in this article we also state that there are other dimensions apart from the semantic and the structural dimension with influence on the feedback processes, as in the case of the pedagogical design. Following we explain the pedagogical framework in which this study has been carried out. 2.1 Pedagogical design One of the defining aspects of this work is the context in which it is carried out. It is an eLearning environment where the process of teaching and learning is conveyed through a technological platform. This work studies the case of the Universitat Oberta de Catalunya (UOC). This university was created in 1995 and from the very beginning has developed its activities in a virtual campus. In the UOC's model of education, the agents of the educative activity do not share the same space and time coordinates. This flexibility that involves that both the student and the teacher enjoy the learning environment from any space and moment (asynchronous communication) needs the educative activity to be based upon communication exchanges between both of them. The UOC's pedagogical model puts the student in the centre of the teaching and learning process (student centred learning, SCL) carried out in a virtual classroom. This virtual classroom has four different areas: planning, communication, resources and evaluation. The evaluation area gathers all aspects related to the evaluation process of a given subject. This study is focused in one of the spaces of the evaluation area: the Continuous Evaluation Registry (RAC for its acronym in Catalan) that is where the personalized feedbacks take place. This personalized feedback consists of introducing marks by the teacher, and/or personalized inputs (sub-dimension 1, error identification and correction, and sub-dimension 3, task improvement). Despite the fact that sub-dimension 2 is not directly dealt with from the RAC (nor it is a direct part of the feedback), some guiding solutions to evaluated activities are given once the submission term is over. Furthermore, when necessary, part of the feedback uses the solutions as a support. 458

Maria-Jesus Martinez-Argüelles et al. During the teaching and learning process, the student counts with the tutor's and the teacher's direct support. The latter is the one that teaches in the virtual classroom, accompanies the student in the development of the teaching and learning process acting both as a facilitator of the educative activity and as expert on the subject he/she is teaching. The UOC's evaluation system is based upon the combination of an educational and time-continuous evaluation, with a final evaluation. The continuous evaluation is based on a series of proposed evaluation tests -continuous evaluation test (PAC)- that are carried out on a time-continuous basis. To this point, the theoretical basis of this study and the context in which it has been developed have been described. It follows the empirical analysis and its results. 3. Implementation It is in the context of research on processes of feedback with the aim to promote construction of knowledge and regulation of learning, still rather incipient in eLearning environments, where this study takes shape. Thus, attaining the objectives proposed in the context of this article will allow us to get results at two different levels: on the one hand, efficiency for the teachers and, on the other hand, efficacy for the students (performance). In this context, considering costs and benefits of implementing personalized feedback, it is necessary to question its usefulness, in order to extend it to other subjects or studies. With the aim to analyse the impact that has the incorporation of personalized feedback to the solution of activities and correction of exercises during the continuous evaluation process, and to make available several technological methodologies as well as their feasibility, diverse pilot tests have been designed according to the following criteria: groups of reduced dimensions (maximum 35 students) per subject have been chosen in order to ensure the teacher's adequate dimensioned task. Subjects have been selected according to the sort of knowledge (structural dimension of feedback) and diverse methodology, apart from considering teachers with different aptitudes, assessing the action's transversality and its possible extension to all of the subjects in the degree. The involved subjects, all of them from the Degree in Business Administration, were: Introduction to business (01.500), Statistics essentials (01.501), Behaviour of economic aggregates (01.508), Economic structure (01.510) and Introduction to accountability (01.520). As pointed out, there was a will to find subjects covering different fields of the degree. From applied economy (Economic structure and Behaviour of economic aggregates) to more methodological subjects (Statistics essentials), including accountancy subjects (Introduction to accountability) and business organization subjects (Introduction to business) (see detail in table 1). Table 1: Summary charter of forecasts made in each subject when carrying out the pilot test Subject Introduction to accountability Statistics essentials Economic structure Behaviour of economic aggregates Introduction to business In all the activities? Yes, with different levels of intensity Yes, with different levels of intensity Yes, with different levels of intensity Yes, with different levels of intensity Yes, with different levels of intensity To whom? PAC1 to everyone. To the rest, depending on the results (D, C- and C+ enough to everyone) and to the rest depending on the errors and evolution Depending on marks categories: C+, C- and D. PAC1 to everyone. To the rest, depending on the results and needs. To everyone with a weak mark and especially to those who fail PAC1 to everyone, to the rest depending of results and needs Level of personalization Individual Depending on the type of error made Individual How? Proposal of feedback PAC1/PAC2: audio and/or textual. The rest video or screenshots The most difficult (PAC2/PAC3):Ca ptures and video. To the rest text/audio. Video and/or audio Depending on Captures/video/te the type of error xt/audio made 459 Individual Video/text/audio To correct errors and guide/improve the learning process To correct errors and guide/improve the learning process Firstly, to motivate. Secondly, to correct errors and guide/improve the learning process To correct errors and re-orient/improve the learning process To correct errors and re-orient/improve the learning process and to motivate

Maria-Jesus Martinez-Argüelles et al.<br />

Agents that take part in the feedback processes: One of the elements inherent to feedback are<br />

the members that take part of its processes. This research has been developed by using a<br />

technological platform that integrates among others two applications that make it possible to<br />

provide the student with feedback. The first one is the continuous evaluation registry (RAC, for its<br />

acronym in Catalan), a space in the virtual classroom where the teacher inserts the marks of the<br />

continuous evaluation and facilitates the personalized feedback (which is sent to a private space<br />

only shared by teacher and learner). The second one is the calendar and it can be found in the<br />

planning space of the virtual classroom. There, the student can accede to the solutions of the<br />

continuous evaluation tests (PAC), prepared by the teacher and published one day after the<br />

students have submitted their solutions.<br />

Space of virtual communication where the feedback processes take place: Another component is<br />

the virtual space where the feedback takes place, be it public or private. In this study we analyse<br />

the effects of feedback in a private space (from now on personalized feedback). Authors such as<br />

[Rice et al., 1994] have proved that personalized feedback (private spaces) has advantages over<br />

feedback in public spaces because it fits better to the needs and characteristics of each student.<br />

Moment of feedback: To provide immediate or differed feedback has been the object of<br />

discussion in several researches on this issue. It is remarkable the proposal made by [Dempsey<br />

et al., 1988], that define some categories used in this work. The first one is immediate feedback (it<br />

provides the student with information on the correct answer) and in this context it corresponds to<br />

the PACs' solutions, published just one day after the students submit their answers. The second<br />

one is differed feedback (where the errors made are commented on, some contents are<br />

recommended as well as strategies to improve the process of <strong>learning</strong>), that gives added value to<br />

the solution of the PAC.<br />

Extension and form of the feedback: Another special feature of feedback in a virtual environment<br />

is its extension. It is tightly linked to the semantic dimension of feedback and to the kind of<br />

knowledge on which the feedback is given (depending on whether it is more abstract or<br />

conceptual or more applied and procedural). In order for the feedback to be effective it must give<br />

enough information to university students so as for them to attain the aims of <strong>learning</strong> previewed.<br />

The feedback can have different shapes: text and/or technological multimedia (audio and video<br />

recordings, screenshots with audio as well as the possibility to upload compressed videos). The<br />

student receives it in the RAC as an attached file or in the message itself.<br />

Following Narciss and her collaborators [Narciss 2004, 2008], [Narciss et al., 2004a, 2004b, 2006], in<br />

this article we also state that there are other dimensions apart from the semantic and the structural<br />

dimension with influence on the feedback processes, as in the case of the pedagogical design.<br />

Following we explain the pedagogical framework in which this study has been carried out.<br />

2.1 Pedagogical design<br />

One of the defining aspects of this work is the context in which it is carried out. It is an eLearning<br />

environment where the process of teaching and <strong>learning</strong> is conveyed through a technological<br />

platform. This work studies the case of the Universitat Oberta de Catalunya (UOC). This university<br />

was created in 1995 and from the very beginning has developed its activities in a virtual campus. In<br />

the UOC's model of education, the agents of the educative activity do not share the same space and<br />

time coordinates. This flexibility that involves that both the student and the teacher enjoy the <strong>learning</strong><br />

environment from any space and moment (asynchronous communication) needs the educative<br />

activity to be based upon communication exchanges between both of them.<br />

The UOC's pedagogical model puts the student in the centre of the teaching and <strong>learning</strong> process<br />

(student centred <strong>learning</strong>, SCL) carried out in a virtual classroom. This virtual classroom has four<br />

different areas: planning, communication, resources and evaluation. The evaluation area gathers all<br />

aspects related to the evaluation process of a given subject. This study is focused in one of the<br />

spaces of the evaluation area: the Continuous Evaluation Registry (RAC for its acronym in Catalan)<br />

that is where the personalized feedbacks take place. This personalized feedback consists of<br />

introducing marks by the teacher, and/or personalized inputs (sub-dimension 1, error identification<br />

and correction, and sub-dimension 3, task improvement). Despite the fact that sub-dimension 2 is not<br />

directly dealt with from the RAC (nor it is a direct part of the feedback), some guiding solutions to<br />

evaluated activities are given once the submission term is over. Furthermore, when necessary, part of<br />

the feedback uses the solutions as a support.<br />

458

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!