framework for the implementation of a virtual design studio model in ...
framework for the implementation of a virtual design studio model in ... framework for the implementation of a virtual design studio model in ...
7.5 Summative Evaluation It is understandable that a framework which is formulated to evaluate integrate technology into education and evaluate the effectiveness should be evaluated. It is important to estimate the effectiveness of such a project. This chapter outlines the approach used to evaluate the overall project. The chapter presents the findings and conclusions of the evaluation. The chapter states the effectiveness of the implementation process, the overall project and its intended outcomes. This section examined the effects or outcomes of some object – they summarise it by describing what happens subsequent to delivery of the programme or technology, assessing whether the object can be said to have caused the outcome; determining the overall impact of the causal factor beyond only the immediate target outcomes, and estimating the relative costs associated with the object. The summative evaluation in this study can be subdivided into two branches: the outcome evaluation and the impact evaluation. The outcome evaluation is defined as investigative of whether the programme or technology caused demonstrable effects on specifically defined target outcomes. The strategy for evaluating this project had the following two goals: to report on how well VDS 3 was implemented and received and to analyse the extent to which the stated outcomes of VDS 3 were achieved. As a result, in this study the outcome evaluation discussed the results or effects of VDS 3 on improving the participating student‟s performance in using technology and using the tools of collaboration and creativity tools; while the impact evaluation is defined as broader and assesses the overall or net effects – intended or unintended – of the programme or technology. As a result, the impact evaluation in this study discusses how VDS 3 affected the education process in the environment in which it was implemented. The tools used in this were the lecturers‟ interviews, observations, and the focus group analysis. In the summative component of the evaluation, it was observed that the students extended their use of the skills learnt in VDS 3 to other subject they undertake at The University of Sharjah. Facebook accounts showed the 165
extended use of Facebook accounts to include other subjects and communicate with each other about issues related to other subjects. The students were also observed to pick up and adopt the style of learning encouraged in the VDS 3 workshop. The students started to take responsibilities of their own learning. The students also started to think creatively in attending some of the tasks for other subjects. At the end of the VDS 3 workshop it was evidenced in the campus corridors the students‟ use of the skills they learned in VDS 3. The students involved their surroundings in solving their academic problems. The students also began to work with each other in a less stressed manner especially as far as gender is concerned. Interviews with the lecturers revealed a change of attitude by the students toward their learning. Dr. Radoine comments that “I could see the motivation developed inside the students not only in turning to the VDS 3 on a Saturday morning but also in using what they learnt in VDS 3 in other subject areas.” The effect that this workshop left on the educational institutes in the UAE was covered also by the press in the UAE. 315 Also the University has already demanded some more collaboration in terms of conducting new VDS and having it as a continuous activity. The University of Sharjah web page has also addressed VDS 3 as one of the important events that occurred in the University in 2009. 316 7.6 Outcome Evaluation The outcome evaluation was measured through the use of the data obtained from the observation and the student focus group and the lecturers‟ interviews. A set of intended outcomes were identified as shown below: 315 Al Sada Magazine (2009). Virtual design studio to redesign Sharjah: by an Emirati PhD. student Amal Al-Ali. Emirates. Year 11. 544. p52. (in Arabic) 316 http://www.sharjah.ac.ae/English/Academics/Colleges/Engineering/Departments/ArchitecturalEngine ering/events/ArtActivities/Pages/Redesignsharjah.aspx 166
- Page 115 and 116: concerned. The students also indica
- Page 117 and 118: ideas and collaborate. Video record
- Page 119 and 120: Peer Assessment: Students will be s
- Page 121 and 122: also covered the data collection in
- Page 123 and 124: to another cycle of observation, ac
- Page 125 and 126: 6.3 Phase One The needs analysis in
- Page 127 and 128: Figure 6.2: VDS 1 basic elements Th
- Page 129 and 130: Figure 6.3: Database Form for Ident
- Page 131 and 132: in universities in China and the Fa
- Page 133 and 134: conducted to get in-depth understan
- Page 135 and 136: which supported the curriculum of t
- Page 137 and 138: student engage with their learning
- Page 139 and 140: skills to tackle similar problems t
- Page 141 and 142: � Team-Working Another important
- Page 143 and 144: Facebook was utilised in this proje
- Page 145 and 146: supportive educational tool Second
- Page 147 and 148: female are not supposed to be mixin
- Page 149 and 150: Formative evaluations improve and d
- Page 151 and 152: the diary of events, and the timeta
- Page 153 and 154: Dimension Application Creativity- p
- Page 155 and 156: Dimension Aim Implementation Techni
- Page 157 and 158: that helped the students in working
- Page 159 and 160: Creativity Critique Collaboration C
- Page 161 and 162: available. Figure 7.3 illustrates s
- Page 163 and 164: Collaboration Anonymous 7.4.4 Focus
- Page 165: synchronous tools scored highly com
- Page 169 and 170: Figure 7.9: Student Performance Fig
- Page 171 and 172: 7.8 Conclusion This chapter discuss
- Page 173 and 174: The figure above shows the main the
- Page 175 and 176: Networking also helped the students
- Page 177 and 178: the discipline of being part of the
- Page 179 and 180: just an hour beforehand with the fo
- Page 181 and 182: positively adapted the new culture
- Page 183 and 184: 8.3.14 Creativity As shown in Figur
- Page 185 and 186: Chapter 9: Recommendations 9.1 Intr
- Page 187 and 188: The summary of the findings of the
- Page 189 and 190: 9.3.3 Networking Facilities The ope
- Page 191 and 192: Figure 9.2 VCCS Framework The resea
- Page 193 and 194: Figure 9.4: Hofstede classification
- Page 195 and 196: support by providing financial supp
- Page 197 and 198: positive attitude toward technology
- Page 199 and 200: To better accommodate the above rec
- Page 201 and 202: them. The e-learning diary will als
- Page 203 and 204: Conclusion Future Architects This w
- Page 205 and 206: Appendices
- Page 207 and 208: Appendix A a. The University of Sha
- Page 209 and 210: Q4. We were hoping that this is goi
- Page 211 and 212: Also, being strict with time, outre
- Page 213 and 214: allocated for this workshop will no
- Page 215: Other suggestions? Student1: The wo
extended use <strong>of</strong> Facebook accounts to <strong>in</strong>clude o<strong>the</strong>r subjects and<br />
communicate with each o<strong>the</strong>r about issues related to o<strong>the</strong>r subjects.<br />
The students were also observed to pick up and adopt <strong>the</strong> style <strong>of</strong><br />
learn<strong>in</strong>g encouraged <strong>in</strong> <strong>the</strong> VDS 3 workshop. The students started to<br />
take responsibilities <strong>of</strong> <strong>the</strong>ir own learn<strong>in</strong>g. The students also started to<br />
th<strong>in</strong>k creatively <strong>in</strong> attend<strong>in</strong>g some <strong>of</strong> <strong>the</strong> tasks <strong>for</strong> o<strong>the</strong>r subjects. At <strong>the</strong><br />
end <strong>of</strong> <strong>the</strong> VDS 3 workshop it was evidenced <strong>in</strong> <strong>the</strong> campus corridors<br />
<strong>the</strong> students‟ use <strong>of</strong> <strong>the</strong> skills <strong>the</strong>y learned <strong>in</strong> VDS 3. The students<br />
<strong>in</strong>volved <strong>the</strong>ir surround<strong>in</strong>gs <strong>in</strong> solv<strong>in</strong>g <strong>the</strong>ir academic problems. The<br />
students also began to work with each o<strong>the</strong>r <strong>in</strong> a less stressed manner<br />
especially as far as gender is concerned.<br />
Interviews with <strong>the</strong> lecturers revealed a change <strong>of</strong> attitude by <strong>the</strong><br />
students toward <strong>the</strong>ir learn<strong>in</strong>g. Dr. Rado<strong>in</strong>e comments that “I could see<br />
<strong>the</strong> motivation developed <strong>in</strong>side <strong>the</strong> students not only <strong>in</strong> turn<strong>in</strong>g to <strong>the</strong><br />
VDS 3 on a Saturday morn<strong>in</strong>g but also <strong>in</strong> us<strong>in</strong>g what <strong>the</strong>y learnt <strong>in</strong> VDS<br />
3 <strong>in</strong> o<strong>the</strong>r subject areas.”<br />
The effect that this workshop left on <strong>the</strong> educational <strong>in</strong>stitutes <strong>in</strong> <strong>the</strong><br />
UAE was covered also by <strong>the</strong> press <strong>in</strong> <strong>the</strong> UAE. 315 Also <strong>the</strong> University<br />
has already demanded some more collaboration <strong>in</strong> terms <strong>of</strong> conduct<strong>in</strong>g<br />
new VDS and hav<strong>in</strong>g it as a cont<strong>in</strong>uous activity. The University <strong>of</strong><br />
Sharjah web page has also addressed VDS 3 as one <strong>of</strong> <strong>the</strong> important<br />
events that occurred <strong>in</strong> <strong>the</strong> University <strong>in</strong> 2009. 316<br />
7.6 Outcome Evaluation<br />
The outcome evaluation was measured through <strong>the</strong> use <strong>of</strong> <strong>the</strong> data<br />
obta<strong>in</strong>ed from <strong>the</strong> observation and <strong>the</strong> student focus group and <strong>the</strong><br />
lecturers‟ <strong>in</strong>terviews. A set <strong>of</strong> <strong>in</strong>tended outcomes were identified as<br />
shown below:<br />
315<br />
Al Sada Magaz<strong>in</strong>e (2009). Virtual <strong>design</strong> <strong>studio</strong> to re<strong>design</strong> Sharjah: by an Emirati PhD. student Amal<br />
Al-Ali. Emirates. Year 11. 544. p52. (<strong>in</strong> Arabic)<br />
316<br />
http://www.sharjah.ac.ae/English/Academics/Colleges/Eng<strong>in</strong>eer<strong>in</strong>g/Departments/ArchitecturalEng<strong>in</strong>e<br />
er<strong>in</strong>g/events/ArtActivities/Pages/Re<strong>design</strong>sharjah.aspx<br />
166