learning - Academic Conferences Limited
learning - Academic Conferences Limited learning - Academic Conferences Limited
3.3 Early stage implementation Alice Bird During the academic year 2010/11, a number of factors combined to transform the proposed early stage implementation into an extended pilot rather than wide-spread implementation. Academic staff initiative overload referred to earlier was one factor and there was also a need to align more generally with other institutional policies, including the proposal for anonymous marking. Participation was wider than in the previous pilot study, with increased general awareness of a developing e-submission policy. This led to wider debate amongst the academic community, with the main union representing academic staff questioning aspects of policy and practice, already raised as perceived issues by staff. Union concerns about health and safety resulted in a revision of the university’s safety code of practice on visual display equipment to accommodate laptop and tablet devices. This did not lead to the identification of any specific e-submission and e-marking safety issue, although staff remained concerned about their ability to comply with the code and also meet the three week turnaround for feedback. Another union concern was to ensure the right for staff to print electronically submitted coursework, although this did conflict with directives in some Schools that electronic submission should not result in increased departmental costs. A further union concern related to the ability of the institutional print room to cope with large volume printing a peak deadline times but this was countered as a historical view of the capabilities of the service. The early phase implementation is currently being evaluated but the institution has decided to continue with the ‘third way’ approach for electronic submission. This has been translated into policy for 2011/12 but in a way that still allows academic staff to choose how to mark and provide feedback. The decision to maintain the approach, without further amendment, acknowledges the general sense of initiative overload by academic staff. E-submission does represent a major cultural shift in staff assessment practices and our experience suggests that it cannot be achieved without agreeing some form of consensus in approach. The project has also highlighted to strategic management the complexity of the overall coursework submission process and the need to limit change to what is practicable at any point in time. 4. Reflection and recommendations In reflecting on the case study experience, the institution has made progress towards implementing electronic submission of coursework and to achieving its objectives. The proposal to implement a ‘third way’ was critical in moving the process forward. However, we are conscious that implementing e-submission is only one aspect of reviewing and improving assessment practices within the institution. Evidence from existing and emerging research supports the need to redesign assessment practices across the whole institution, REAP (2011), and within programmes of study, TESTA (2011). The intention is to continue working with institutional management, academic staff and students to develop practices that benefit all stakeholders. In recommending how other institutions might approach development of e-submission policy and practice, a key starting point is analysis of the predominant culture and sub-cultures. Acknowledging the increased influence in student power is essential and early inclusion of student leadership does promote better understanding between key stakeholders. The needs of key stakeholders need to align but giving stakeholders the opportunity to vent their concerns is also critical in promoting better understanding. This needs to be conducted in the spirit of listening and moving forward with agreement to minimise concerns. In our case, frequent consultation throughout the various stages of the project did not translate into members of academic staff being aware of the introduction of new policy. Hence, further debate can be expected once any new policy is first implemented. Providing evidence that perceived issues have already been discussed and solutions considered is essential at this stage. Progress can only be achieved through managing the expectations and understandings of all key stakeholders. Our experience also highlights the need to take an institutional perspective of all initiatives impacting on academic practice, administrative activities and the student experience, at any point in time. Finally, any implementation of e-submission policy and practice needs to be considered in the context of changing assessment practices, in general, and the opportunities that technology provides for alternative approaches to assessment and feedback on assessment. 80
References Alice Bird Alvesson, M (2002) Understanding Organizational Culture. London: Sage. Berquist, W.H. (1992) The Four Cultures of the Academy. San Francisco: Jossey Bass. HEFCE (2010) Student Perspectives on Technology – demand, perceptions and training needs. Available online at http://www.hefce.ac.uk/pubs/rdreports/2010/rd18_10/ Hepplestone, S., Parkin, H., Irwin, B., Holden, G and Thorpe, L (2010) Technology, Feedback, Action! The impact of learning technology upon students' engagement with their feedback. Available online at http://www.heacademy.ac.uk/assets/EvidenceNet/TFA_report_final.pdf Land, R. (2001) Agency, context and change in academic development. International Journal for Academic Development, 6 (1), 4-20. NSF (2009) National Student Forum Annual Report 09. Available online at http://www.bis.gov.uk/assets/biscore/higher-education/docs/n/09-p83-national-student-forum-annual-report- 09 NUS (2008) Higher Education Campaign: Mark my words, not my name. Further information available online at http://www.nus.org.uk/en/Campaigns/Higher-Education/Mark-my-words-not-my-name/ NUS (2009) Higher Education Campaign: Assessment feedback. Further information available online at http://www.nus.org.uk/en/Campaigns/Higher-Education/Assessment-feedback-/ REAP (2011) Re-Engineering Assessment Practices in Higher Education. Further information available online at http://www.reap.ac.uk/Home.aspx TESTA (2011) Transforming the Experience of Students Through Assessment. Further information available online at http://www.testa.ac.uk/. Tierney, W. G. (1988) Organisational culture in higher education. Journal of Higher Education, 59, (1) 2-21. Trowler, P. (2008) Cultures and Change in Higher Education, 1 -15. New York: Palgrave MacMillan. 81
- Page 56 and 57: Figure 5: Video metadata from YouTu
- Page 58 and 59: Antonios Andreatos The organisatio
- Page 60 and 61: Constructing a Survey Instrument fo
- Page 62 and 63: Jonathan Barkand The teacher demon
- Page 64 and 65: Jonathan Barkand Indicator 2.3: Has
- Page 66 and 67: References Jonathan Barkand Allen,
- Page 68 and 69: 2. Pedagogical agents Orlando Belo
- Page 70 and 71: Orlando Belo Type (Tp), the refere
- Page 72 and 73: 3.3 The agent’s architecture Orla
- Page 74 and 75: Some Reflections on the Evaluation
- Page 76 and 77: Nabil Ben Abdallah and Françoise P
- Page 78 and 79: Nabil Ben Abdallah and Françoise P
- Page 80 and 81: Nabil Ben Abdallah and Françoise P
- Page 82 and 83: Designing A New Curriculum: Finding
- Page 84 and 85: Andrea Benn For this new course, it
- Page 86 and 87: Andrea Benn Technology is already i
- Page 88 and 89: Andrea Benn To bring about the co-o
- Page 90 and 91: Latefa Bin Fryan and Lampros Stergi
- Page 92 and 93: Latefa Bin Fryan and Lampros Stergi
- Page 94 and 95: Faculty development Online course
- Page 96 and 97: Latefa Bin Fryan and Lampros Stergi
- Page 98 and 99: Latefa Bin Fryan and Lampros Stergi
- Page 100 and 101: Alice Bird being reviewed under the
- Page 102 and 103: Alice Bird Developing the process m
- Page 104 and 105: Alice Bird Reflecting on the feasib
- Page 108 and 109: Enhancement of e-Testing Possibilit
- Page 110 and 111: Martin Cápay et al. of Likert scal
- Page 112 and 113: Martin Cápay et al. Figure 3 Proce
- Page 114 and 115: Martin Cápay et al. Figure 4: An e
- Page 116 and 117: Martin Cápay et al. On the other h
- Page 118 and 119: Tim Cappelli demand from students t
- Page 120 and 121: Tim Cappelli at a time and increasi
- Page 122 and 123: Tim Cappelli forms were processed a
- Page 124 and 125: Objectives More efficient and faste
- Page 126 and 127: Digital Educational Resources Repos
- Page 128 and 129: Cornélia Castro et al. Economic:
- Page 130 and 131: Cornélia Castro et al. Dimension E
- Page 132 and 133: Cornélia Castro et al. feedback on
- Page 134 and 135: Cornélia Castro et al. EdReNe (200
- Page 136 and 137: Ivana Cechova et al. The influence
- Page 138 and 139: 4. Methodology Ivana Cechova et al.
- Page 140 and 141: Ivana Cechova et al. Although this
- Page 142 and 143: 8. Conclusion Ivana Cechova et al.
- Page 144 and 145: Yin Ha Vivian Chan et al. What is s
- Page 146 and 147: Yin Ha Vivian Chan et al. as a viab
- Page 148 and 149: Yin Ha Vivian Chan et al. the ILC h
- Page 150 and 151: The Development and Application of
- Page 152 and 153: Serdar Çiftci and Mehmet Akif Ocak
- Page 154 and 155: 4.3 Data collection Serdar Çiftci
3.3 Early stage implementation<br />
Alice Bird<br />
During the academic year 2010/11, a number of factors combined to transform the proposed early<br />
stage implementation into an extended pilot rather than wide-spread implementation. <strong>Academic</strong> staff<br />
initiative overload referred to earlier was one factor and there was also a need to align more generally<br />
with other institutional policies, including the proposal for anonymous marking. Participation was wider<br />
than in the previous pilot study, with increased general awareness of a developing e-submission<br />
policy. This led to wider debate amongst the academic community, with the main union representing<br />
academic staff questioning aspects of policy and practice, already raised as perceived issues by staff.<br />
Union concerns about health and safety resulted in a revision of the university’s safety code of<br />
practice on visual display equipment to accommodate laptop and tablet devices. This did not lead to<br />
the identification of any specific e-submission and e-marking safety issue, although staff remained<br />
concerned about their ability to comply with the code and also meet the three week turnaround for<br />
feedback. Another union concern was to ensure the right for staff to print electronically submitted<br />
coursework, although this did conflict with directives in some Schools that electronic submission<br />
should not result in increased departmental costs. A further union concern related to the ability of the<br />
institutional print room to cope with large volume printing a peak deadline times but this was<br />
countered as a historical view of the capabilities of the service.<br />
The early phase implementation is currently being evaluated but the institution has decided to<br />
continue with the ‘third way’ approach for electronic submission. This has been translated into policy<br />
for 2011/12 but in a way that still allows academic staff to choose how to mark and provide feedback.<br />
The decision to maintain the approach, without further amendment, acknowledges the general sense<br />
of initiative overload by academic staff. E-submission does represent a major cultural shift in staff<br />
assessment practices and our experience suggests that it cannot be achieved without agreeing some<br />
form of consensus in approach. The project has also highlighted to strategic management the<br />
complexity of the overall coursework submission process and the need to limit change to what is<br />
practicable at any point in time.<br />
4. Reflection and recommendations<br />
In reflecting on the case study experience, the institution has made progress towards implementing<br />
electronic submission of coursework and to achieving its objectives. The proposal to implement a<br />
‘third way’ was critical in moving the process forward. However, we are conscious that implementing<br />
e-submission is only one aspect of reviewing and improving assessment practices within the<br />
institution. Evidence from existing and emerging research supports the need to redesign assessment<br />
practices across the whole institution, REAP (2011), and within programmes of study, TESTA (2011).<br />
The intention is to continue working with institutional management, academic staff and students to<br />
develop practices that benefit all stakeholders.<br />
In recommending how other institutions might approach development of e-submission policy and<br />
practice, a key starting point is analysis of the predominant culture and sub-cultures. Acknowledging<br />
the increased influence in student power is essential and early inclusion of student leadership does<br />
promote better understanding between key stakeholders. The needs of key stakeholders need to<br />
align but giving stakeholders the opportunity to vent their concerns is also critical in promoting better<br />
understanding. This needs to be conducted in the spirit of listening and moving forward with<br />
agreement to minimise concerns. In our case, frequent consultation throughout the various stages of<br />
the project did not translate into members of academic staff being aware of the introduction of new<br />
policy. Hence, further debate can be expected once any new policy is first implemented. Providing<br />
evidence that perceived issues have already been discussed and solutions considered is essential at<br />
this stage.<br />
Progress can only be achieved through managing the expectations and understandings of all key<br />
stakeholders. Our experience also highlights the need to take an institutional perspective of all<br />
initiatives impacting on academic practice, administrative activities and the student experience, at any<br />
point in time. Finally, any implementation of e-submission policy and practice needs to be considered<br />
in the context of changing assessment practices, in general, and the opportunities that technology<br />
provides for alternative approaches to assessment and feedback on assessment.<br />
80