In-Basket Design: Developing and Implementing an On-Line ... - IPAC
In-Basket Design: Developing and Implementing an On-Line ... - IPAC In-Basket Design: Developing and Implementing an On-Line ... - IPAC
Step 5: Write Multiple-Choice Questions Prepare the Test Plan • Weight each competency based on job analysis results • Set test length and determine the number of items needed for each competency • Write more questions than you need # of Questions Competency Draft Final Decision-Making 20 18 Planning & Resource Management 15 13 Perf. & Results Management 15 13 Managing Information 20 16 Self-Management 20 15 Total 90 75 1 Assumes that 2 forms will be developed and that there will be about 40-50% overlap between the forms. IPAC Annual Conference 2011 24
Step 5: Write Multiple-Choice Questions Select the Best E-mail Messages • Each e-mail message should . . . • Look and feel like the job • Address at least one critical competency • The pool of e-mail messages should . . . • Sample the domain of critical duties and work activities • Vary in ―sender‖ and priority • Be able to be read within time limits • Average reading speed = 300 words/minute • 25 - 30 e-mail messages = about 30 minutes • Reserve ―back-up‖ e-mail messages • E-mail messages will be eliminated during item writing and test reviews IPAC Annual Conference 2011 25
- Page 1 and 2: In-Basket Design Developing and Imp
- Page 3 and 4: What is the In-Basket Assessment
- Page 5 and 6: The Steps • Step 1: Determine Cri
- Page 7 and 8: Step 1: Determine Critical Tasks, D
- Page 9 and 10: Step 1: Determine Critical Tasks, D
- Page 11 and 12: Step 2: Collect Source Materials
- Page 13 and 14: Step 2: Collect Source Materials Wo
- Page 15 and 16: Step 3: Develop Overview and E-mail
- Page 17 and 18: Step 4: Develop Performance Benchma
- Page 19 and 20: Step 4: Develop Performance Benchma
- Page 21 and 22: Step 4: Develop Performance Benchma
- Page 23: Step 5: Write Multiple-Choice Quest
- Page 27 and 28: Step 5: Write Multiple-Choice Quest
- Page 29 and 30: Step 5: Write Multiple-Choice Quest
- Page 31 and 32: Step 5: Write Multiple-Choice Quest
- Page 33 and 34: Step 6: Confirm Fidelity and Job Re
- Page 35 and 36: Step 6: Confirm Fidelity and Job Re
- Page 37 and 38: Step 7: Assemble, Review, and Final
- Page 39 and 40: Step 8: Prepare for Administration
- Page 41 and 42: Step 9: Administer the In-Basket Ca
- Page 43 and 44: Step 10: Conduct Key Clearance Ques
- Page 45 and 46: References American Educational Res
- Page 47 and 48: Questions IPAC Annual Conference 20
- Page 49 and 50: Gast/Votraw -- In-Basket Design IPA
- Page 51 and 52: Gast -- In-Basket Design PTC-SC Ann
- Page 53: The ITEM as a whole should: It
Step 5: Write Multiple-Choice Questions<br />
Prepare the Test Pl<strong>an</strong><br />
• Weight each competency based on job <strong>an</strong>alysis results<br />
• Set test length <strong><strong>an</strong>d</strong> determine the number of items needed for<br />
each competency<br />
• Write more questions th<strong>an</strong> you need<br />
# of Questions<br />
Competency Draft Final<br />
Decision-Making 20 18<br />
Pl<strong>an</strong>ning & Resource M<strong>an</strong>agement 15 13<br />
Perf. & Results M<strong>an</strong>agement 15 13<br />
M<strong>an</strong>aging <strong>In</strong>formation 20 16<br />
Self-M<strong>an</strong>agement 20 15<br />
Total 90 75<br />
1 Assumes that 2 forms will be developed <strong><strong>an</strong>d</strong> that there will be about<br />
40-50% overlap between the forms.<br />
<strong>IPAC</strong> Annual Conference 2011<br />
24
Change language