In-Basket Design: Developing and Implementing an On-Line ... - IPAC
In-Basket Design: Developing and Implementing an On-Line ... - IPAC In-Basket Design: Developing and Implementing an On-Line ... - IPAC
Step 7: Assemble, Review, and Finalize Assemble Alternate Forms A True Balancing Act • Both forms must follow the competencybased test plan • Each document must be addressed by at least one multiple-choice question • One question cannot imply the answer to other questions • Response options should be equally distributed • Each option (A,B,C,D,E) will comprise about 20% of the total • Response options should be appropriately sequenced • no more than 3 ―A’s,‖ ―B’s,‖ ―C’s,‖ etc. in a row IPAC Annual Conference 2011 36
Step 7: Assemble, Review, and Finalize • Write instructions for administration • On-line • Paper-and-pencil • Quality control: Proofread!! • Look for common mistakes – watch for inconsistencies – Names of characters – Names of places – Dates/times – E-mail format ―the details‖ IPAC Annual Conference 2011 37
- Page 1 and 2: In-Basket Design Developing and Imp
- Page 3 and 4: What is the In-Basket Assessment
- Page 5 and 6: The Steps • Step 1: Determine Cri
- Page 7 and 8: Step 1: Determine Critical Tasks, D
- Page 9 and 10: Step 1: Determine Critical Tasks, D
- Page 11 and 12: Step 2: Collect Source Materials
- Page 13 and 14: Step 2: Collect Source Materials Wo
- Page 15 and 16: Step 3: Develop Overview and E-mail
- Page 17 and 18: Step 4: Develop Performance Benchma
- Page 19 and 20: Step 4: Develop Performance Benchma
- Page 21 and 22: Step 4: Develop Performance Benchma
- Page 23 and 24: Step 5: Write Multiple-Choice Quest
- Page 25 and 26: Step 5: Write Multiple-Choice Quest
- Page 27 and 28: Step 5: Write Multiple-Choice Quest
- Page 29 and 30: Step 5: Write Multiple-Choice Quest
- Page 31 and 32: Step 5: Write Multiple-Choice Quest
- Page 33 and 34: Step 6: Confirm Fidelity and Job Re
- Page 35: Step 6: Confirm Fidelity and Job Re
- Page 39 and 40: Step 8: Prepare for Administration
- Page 41 and 42: Step 9: Administer the In-Basket Ca
- Page 43 and 44: Step 10: Conduct Key Clearance Ques
- Page 45 and 46: References American Educational Res
- Page 47 and 48: Questions IPAC Annual Conference 20
- Page 49 and 50: Gast/Votraw -- In-Basket Design IPA
- Page 51 and 52: Gast -- In-Basket Design PTC-SC Ann
- Page 53: The ITEM as a whole should: It
Step 7: Assemble, Review, <strong><strong>an</strong>d</strong> Finalize<br />
Assemble Alternate Forms<br />
A True Bal<strong>an</strong>cing Act<br />
• Both forms must follow the competencybased<br />
test pl<strong>an</strong><br />
• Each document must be addressed by at<br />
least one multiple-choice question<br />
• <strong>On</strong>e question c<strong>an</strong>not imply the <strong>an</strong>swer to<br />
other questions<br />
• Response options should be equally<br />
distributed<br />
• Each option (A,B,C,D,E) will comprise about<br />
20% of the total<br />
• Response options should be appropriately<br />
sequenced<br />
• no more th<strong>an</strong> 3 ―A’s,‖ ―B’s,‖ ―C’s,‖ etc. in a row<br />
<strong>IPAC</strong> Annual Conference 2011<br />
36
Change language