In-Basket Design: Developing and Implementing an On-Line ... - IPAC
In-Basket Design: Developing and Implementing an On-Line ... - IPAC
In-Basket Design: Developing and Implementing an On-Line ... - IPAC
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Step 10: Conduct Key Clear<strong>an</strong>ce<br />
• Prior to assigning scores, we examine item functioning to:<br />
• Verify the accuracy of the computer-programmed scoring key<br />
• Evaluate the integrity of each item<br />
• What we examine<br />
• Item difficulty (p-values)<br />
• Point biserial correlations (pbi)<br />
• Hi/Lo Split (response distribution of upper <strong><strong>an</strong>d</strong> lower 45%)<br />
• <strong>In</strong>ternal consistency reliability<br />
• Content of question stems <strong><strong>an</strong>d</strong> response options<br />
• Decisions we make based on item statistics <strong><strong>an</strong>d</strong> content review<br />
• Poorly performing items are eliminated<br />
• Alternative plausible responses receive full or partial credit<br />
<strong>IPAC</strong> Annual Conference 2011<br />
42