IELTS Research Reports

An empirical investigation of the process of writing Academic Readingtest items for the International English Language Testing SystemCONTENTS1 Aims.....................................................................................................................................2722 Background and related research.....................................................................................2722.1 A socio-cognitive test validation framework...........................................................2722.2 Item writing............................................................................................................2733 Research methodology and design..................................................................................2773.1 Deduction and induction........................................................................................2773.2 Design....................................................................................................................2774 Analysis and findings from interviews and focus group discussions..........................2794.1 Non-experienced IELTS item writer group.............................................................2794.1.1 IELTS text search, selection and characterisation ................................................2794.1.2 Participant text search treatment and item development: flowcharts anddiscussions............................................................................................................2804.1.3 Participant focus group discussions......................................................................2844.2 Procedures with and findings from the experienced IELTS item writer group.......2874.2.1 Participant text search treatment and item development: flowcharts anddiscussions............................................................................................................2874.2.2 Participant focus group discussions .....................................................................2975 Analysis and findings on the texts....................................................................................2985.1 The non-experienced group...................................................................................3005.2 The experienced group..........................................................................................3036 Analysis and findings on the editing process..................................................................3086.1 The non-experienced group ..................................................................................3086.1.1 Choosing the text for the exam..............................................................................3106.1.2 Change of view caused by the editing process?................................................... 3116.2 The experienced group..........................................................................................3126.2.1 Analysis and findings on the items........................................................................3177 Comparisons between groups...........................................................................................3207.1 Item writing processes...........................................................................................3217.2 The texts................................................................................................................3228 Conclusions and Recommendations................................................................................324References ..........................................................................................................................327Appendix A: Commissioning letter........................................................................................332Appendix B: Background questionnaires..............................................................................333Appendix C: Item writer submissions....................................................................................342IELTS Research Reports Volume 11271