Guide for Developing Assessment Tools - National Skills Standards ...

NQC | Guide for developing assessment toolsMajor componentType of informationEvidence of validity The assessment tasks are based on or reflect work-basedcontexts and situations (i.e. face validity)The tool, as a whole, represents the full-range of skills andknowledge specified within the Unit(s) of Competency (i.e.content validity)The tool has been designed to assess a variety of evidence overtime and contexts (i.e. predictive validity)The boundaries and limitations of the tool in accordance with thepurpose and context for the assessment (i.e. consequentialvalidity)The tool has been designed to minimise the influence ofextraneous factors (i.e. factors that are not related to the unit ofcompetency) on candidate performance (i.e. construct validity)The tool has been designed to adhere to the literacy andnumeracy requirements of the Unit(s) of Competency (i.e.construct validity)Evidence of reliability There is clear documentation of the required training, experienceand/or qualifications of assessors to administer the tool (i.e.inter-rater reliability)The tool provides model responses and/or examples ofperformance at varying levels (e.g. competent/not yetcompetent) to guide assessors in their decision making (i.e. interand intra-rater reliability)There is clear instructions on how to synthesis multiple sourcesof evidence to make overall judgement of performance (i.e. interraterreliability)If marks or grades are to be reported, there are clear proceduresfor scoring performance (e.g. marking guidelines, scoring rulesand/or grading criteria) (i.e. inter-rater reliability)Recording Requirements The type of information to be recordedHow it is to be recorded and stored, including durationReporting requirements What will be reported and to whom?What are the stakes and consequences of the assessmentoutcomes?Supplementary information Any other information that will assist the assessor inadministering and judging the performance of the candidateGUIDE FOR DEVELOPING ASSESSMENT TOOLS PAGE 22