Quality of Assessment Practices - National Skills Standards Council
Quality of Assessment Practices - National Skills Standards Council
Quality of Assessment Practices - National Skills Standards Council
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Contents<br />
1. Executive Summary ................................................................ 3 <br />
2. Background .......................................................................... 12<br />
3. Structure <strong>of</strong> this report .......................................................... 14<br />
4. Project methodology ............................................................. 15<br />
5 Findings <strong>of</strong> the evaluation <strong>of</strong> the national stock <strong>of</strong><br />
assessment materials ........................................................... 19<br />
5.1 <strong>Assessment</strong> materials that address the general <br />
needs <strong>of</strong> assessors ......................................................... 19<br />
5.2 <strong>Assessment</strong> materials that address key <br />
assessment-related issues .............................................. 22<br />
5.3 Industry specific assessment materials ........................... 27<br />
5.4 Summary <strong>of</strong> findings <strong>of</strong> the evaluation <strong>of</strong> the <br />
national stock <strong>of</strong> assessment materials ........................... 32<br />
6. Strategy to address the key issues impacting on the <br />
national stock <strong>of</strong> assessment support materials .................... 34<br />
6.1 Improve awareness <strong>of</strong> and access to the national <br />
stock <strong>of</strong> assessment materials ........................................ 34<br />
6.2 Improve the quality, range and availability <strong>of</strong> <br />
industry specific assessment materials ........................... 36<br />
6.3 Provide support materials that address the current<br />
and emerging issues impacting on the quality <strong>of</strong><br />
assessment practice ....................................................... 38<br />
Appendix 1 - Participants in consultations .................................. 41<br />
Appendix 2 - Rating <strong>of</strong> assessment materials that address <br />
the general needs <strong>of</strong> assessors .................................................. 42<br />
Appendix 3 - Rating <strong>of</strong> assessment materials that address <br />
specific assessment related issues ............................................. 47<br />
Appendix 4 - Rating <strong>of</strong> industry specific assessment <br />
materials ..................................................................................... 50<br />
Disclaimer<br />
This work has been produced on behalf <strong>of</strong> the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> with funding<br />
provided through the Australian Government Department <strong>of</strong> Education Employment<br />
and Workplace Relations and state and territory governments. The views expressed<br />
herein are not necessarily those <strong>of</strong> the Australian Government or state and territory<br />
governments. Recommendations are under consideration by the NQC but it should<br />
not be assumed that they will necessarily be implemented in the future<br />
© Commonwealth <strong>of</strong> Australia 2009<br />
This document is available under a “Preserve Integrity” licence.<br />
see http://www.aesharenet.com.au/P4 for details. All other rights reserved.<br />
For licensing enquiries contact sales@tvetaustralia.com.au.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2<br />
2
1. Executive Summary<br />
In May 2009, the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> [NQC], through the<br />
<strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> Action Group [QAAG], commissioned<br />
Learning Australia Pty Ltd to undertake the second stage <strong>of</strong><br />
the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> <strong>Practices</strong> project. This involved:<br />
• Conducting an evaluation <strong>of</strong> the assessment related<br />
support materials that were identified through the<br />
national audit <strong>of</strong> assessment support materials which<br />
was completed during the first stage <strong>of</strong> the project; and<br />
• Formulating a strategy for addressing any issues raised<br />
through the evaluation <strong>of</strong> the national stock <strong>of</strong><br />
assessment support materials.<br />
The national audit <strong>of</strong> assessment support materials identified<br />
over seventeen hundred items, which were categorised into<br />
three broad groups, namely:<br />
1. <strong>Assessment</strong> materials which support the general needs<br />
<strong>of</strong> the VET workforce in relation to assessment. This<br />
includes resources that focus on matters such as: the<br />
design <strong>of</strong> assessment / evidence gathering tools, making<br />
assessment judgements, the assessment process,<br />
providing feedback and unpacking competency<br />
standards.<br />
2. <strong>Assessment</strong> materials that address specific assessment<br />
related issues, including: assessing generic /<br />
employability skills, assessing higher order<br />
competencies, peer, self and negotiated assessment,<br />
on-line assessment, graded assessment, workplace<br />
assessment, simulation, <strong>of</strong>f the job assessment,<br />
assessment in apprenticeships/ traineeships,<br />
assessment and international / NESB students and<br />
reasonable adjustment.<br />
3. <strong>Assessment</strong> instruments for the assessment <strong>of</strong> specific<br />
units <strong>of</strong> competency and / or qualifications, such as <br />
observation checklists, portfolios, question banks,<br />
practical tasks, simulations, test items and third party<br />
reports.<br />
The evaluation <strong>of</strong> these materials revealed that:<br />
• The national stock <strong>of</strong> assessment related resources is<br />
highly dispersed across a range <strong>of</strong> national and State /<br />
Territory agencies. This makes it difficult for users to<br />
identify, preview and access relevant assessmentrelated<br />
support materials.<br />
• There is a significant range <strong>of</strong> high quality, up to date<br />
materials dealing with the general needs <strong>of</strong> assessors.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 3
• There is a very limited range <strong>of</strong> up to date, assessment<br />
materials that address the key current and emerging<br />
issues impacting on quality assessment. For example,<br />
the national audit did not identify any materials that<br />
provide assessors with current, high quality advice on:<br />
Peer, self and negotiated assessment;<br />
Formative assessment;<br />
The use <strong>of</strong> simulation;<br />
<strong>Assessment</strong> moderation; and<br />
The assessment <strong>of</strong> international students and<br />
students from non English speaking backgrounds.<br />
• There is an uneven spread <strong>of</strong> industry-specific<br />
assessment materials across the key industry areas.<br />
Some areas, such as primary industries are particularly<br />
well served, whereas others, such as property services,<br />
have very few industry-specific assessment materials.<br />
The evaluation <strong>of</strong> these materials revealed that there are<br />
significant quality issues impacting on this category <strong>of</strong><br />
materials. For example, sixty per cent <strong>of</strong> the assessment<br />
materials are not based on the current version <strong>of</strong> the<br />
relevant Training Package. In addition, there is a lack <strong>of</strong><br />
innovation in assessment materials design in this<br />
category.<br />
• Many <strong>of</strong> the items in the national stock <strong>of</strong> assessment<br />
materials are State or Territory publications. This limits<br />
their accessibility and consideration should be given to<br />
making them more readily available to a wider national<br />
audience.<br />
• Most <strong>of</strong> the items in the national stock <strong>of</strong> assessment<br />
materials are not supported by a systematic<br />
maintenance process. This means that the national stock<br />
<strong>of</strong> assessment materials is at risk <strong>of</strong> becoming obsolete.<br />
• Many <strong>of</strong> the industry specific assessment materials have<br />
been appraised against the quality principles for Training<br />
Package Support Materials and carry the national tick<br />
even though they:<br />
Are not supported by a maintenance strategy,<br />
May not comply with the current version <strong>of</strong> the<br />
Training Package; and<br />
May not represent innovative assessment<br />
materials design.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 4
In response to this situation it is recommended that the<br />
<strong>National</strong> <strong>Quality</strong> <strong>Council</strong> implement the following three-point<br />
strategy that is designed to:<br />
1. Improve awareness <strong>of</strong> and access to the national stock <strong>of</strong><br />
assessment materials;<br />
2. Improve the quality, range and availability <strong>of</strong> industry<br />
specific assessment materials; and<br />
3. Provide support materials that address the current and<br />
emerging issues impacting on the quality <strong>of</strong> assessment<br />
practice.<br />
Improve awareness <strong>of</strong> and access to the<br />
national stock <strong>of</strong> assessment materials<br />
The national audit <strong>of</strong> assessment-related resources showed<br />
that the national stock <strong>of</strong> assessment materials comprises:<br />
• A significant collection <strong>of</strong> high quality, up to date<br />
materials dealing with the general needs <strong>of</strong> assessors, in<br />
areas such as the assessment processes, recognition <strong>of</strong><br />
prior learning and assessment tool design.<br />
• A limited but nevertheless high quality selection <strong>of</strong><br />
materials dealing with key assessment related issues <br />
such as: assessing in apprenticeship and traineeship <br />
programs, assessing higher order competencies,<br />
assessment quality assurance, assessment validation,<br />
assessment judgement, assessor networks, and<br />
assessing generic / employability skills.<br />
• A large number <strong>of</strong> materials, especially industry specific<br />
materials, that are out <strong>of</strong> date and do not meet the<br />
requirements <strong>of</strong> the current version <strong>of</strong> the relevant<br />
Training Package and / or Australian <strong>Quality</strong> Training<br />
Framework.<br />
The audit also showed that:<br />
There is no single location where all these materials can<br />
be identified, previewed and accessed;<br />
It is difficult to establish the currency <strong>of</strong> the materials;<br />
and<br />
There is limited advice on the quality <strong>of</strong> the materials or<br />
how they may be used.<br />
This makes it very difficult for assessors and other users to<br />
identify, access and use these materials.<br />
There is a pressing need for a national clearinghouse for<br />
assessment-related support materials that has:<br />
1. A discovery function that enables assessors to identify<br />
existing high quality assessment materials;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 5
2. A marketing function that promotes existing high<br />
quality assessment materials to potential users;<br />
3. A pr<strong>of</strong>essional development function that informs<br />
assessors about the ways in which the national stock <strong>of</strong><br />
assessment materials may be used and / or customised;<br />
and<br />
4. A maintenance function that monitors assessment<br />
materials held in the clearinghouse and informs<br />
copyright owners about the relevance <strong>of</strong> their materials<br />
and the need for them to be updated or revised.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 6
Recommendation 1<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> request TVET Australia to<br />
establish a comprehensive, national clearinghouse for free<br />
and commercial assessment-related support materials that:<br />
• Enable users to identify and preview the national stock <strong>of</strong><br />
assessment-related support materials, and if required,<br />
obtain copies which are licensed for use via free <strong>of</strong><br />
charge download or immediate electronic purchase and<br />
delivery;<br />
• Actively promotes the national stock <strong>of</strong> assessment-<br />
related support materials to users including industry,<br />
assessors and RTOs;<br />
• Conducts, in conjunction with the Industry <strong>Skills</strong> <br />
<strong>Council</strong>s, industry organisations and State / Territory<br />
VET agencies, pr<strong>of</strong>essional education programs for <br />
assessors on the national stock <strong>of</strong> assessment-related <br />
support materials;<br />
• Actively engages with owners <strong>of</strong> materials promoted<br />
through the clearinghouse to ensure that the<br />
assessment-related support materials are maintained or<br />
withdrawn from the clearinghouse;<br />
• Provides assessors and other users with clear <br />
information on the quality <strong>of</strong> the assessment related<br />
support materials held in the clearinghouse; and<br />
• Provides advice or a referral service for assessors and <br />
other users seeking information on the national stock <strong>of</strong><br />
assessment-related support materials.<br />
Improve the quality, range and availability <strong>of</strong><br />
industry specific assessment materials<br />
The national audit <strong>of</strong> assessment-related resources identified<br />
over seventeen hundred industry specific assessment<br />
resources, including assessment instruments, assessor<br />
guides and candidates materials.<br />
However the evaluation <strong>of</strong> these materials revealed that:<br />
• Many <strong>of</strong> the materials do not comply with the current<br />
version <strong>of</strong> the Training Package;<br />
• The materials are <strong>of</strong>ten developed by State and Territory<br />
agencies and are not well known by assessors working<br />
in other jurisdictions;<br />
• There is a lack <strong>of</strong> good quality assessment materials in <br />
many industry sectors; <br />
• The current national process for quality assuring<br />
assessment-related support materials is inadequate;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 7
• There are no systematic arrangements for the<br />
maintenance <strong>of</strong> these materials; and <br />
• There is a lack <strong>of</strong> innovation in assessment materials <br />
design.<br />
In response to this situation it is recommended that the<br />
<strong>National</strong> <strong>Quality</strong> <strong>Council</strong> take steps to:<br />
1. Develop a quality assurance process for assessmentrelated<br />
support materials for which national endorsement<br />
and inclusion in the proposed national clearinghouse is<br />
sought;<br />
2. Transfer responsibility for the quality assurance <strong>of</strong><br />
assessment-related support materials to the relevant<br />
Industry <strong>Skills</strong> <strong>Council</strong>s; and<br />
3. Fund the Industry <strong>Skills</strong> <strong>Council</strong> to undertake the design,<br />
development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />
assessment-related support materials for each endorsed<br />
Training Package in their area <strong>of</strong> coverage and to<br />
actively promote these materials on a national basis, in<br />
collaboration with relevant national and State / Territory<br />
agencies.<br />
It is envisaged that the Industry <strong>Skills</strong> <strong>Council</strong>s and the<br />
proposed national clearinghouse [see Recommendation 1]<br />
would collaborate to provide an integrated discovery service<br />
for assessment related support materials. Under this<br />
arrangement the Industry <strong>Skills</strong> <strong>Council</strong> would have<br />
responsibility for industry specific materials, whereas the<br />
clearinghouse would focus on promoting cross industry<br />
assessment support materials.<br />
Recommendation 2<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> develop a quality assurance<br />
process for assessment-related support materials for which<br />
national endorsement and inclusion in the proposed national<br />
clearinghouse is sought which:<br />
• Ensures that nationally recognised assessment-related <br />
support materials comply with the principles <strong>of</strong> validity,<br />
flexibility, usability, equity and accessibility;<br />
• Requires developers <strong>of</strong> assessment-related support<br />
materials to engage industry in the design, development<br />
and evaluation <strong>of</strong> the assessment materials;<br />
• Requires developers to implement an active <br />
maintenance process to ensure the currency and <br />
relevance <strong>of</strong> the assessment materials; and<br />
• Fosters innovation in assessment materials design.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 8
Recommendation 3<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> transfer responsibility for the<br />
quality assurance <strong>of</strong> assessment-related support materials,<br />
within nationally agreed guidelines as established through<br />
Recommendation 2, to the relevant Industry <strong>Skills</strong> <strong>Council</strong>s.<br />
Recommendation 4<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support the design and<br />
implementation <strong>of</strong> a capability building program to ensure that<br />
Industry <strong>Skills</strong> <strong>Council</strong>s have the capability to manage the<br />
quality assurance <strong>of</strong> assessment-related support materials.<br />
Recommendation 5<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support each Industry <strong>Skills</strong><br />
<strong>Council</strong> being funded to:<br />
• Undertake, in conjunction with industry, the design,<br />
development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />
assessment-related support materials for each endorsed<br />
Training Package in their area <strong>of</strong> coverage;<br />
• Actively promote these exemplar assessment-related<br />
support materials on a national basis in conjunction with<br />
industry and national, State and Territory VET agencies;<br />
and<br />
• Establish a national pr<strong>of</strong>essional development strategy,<br />
in conjunction with industry and national, State and <br />
Territory VET agencies, to build assessor capability in <br />
the use <strong>of</strong> the exemplar assessment – related support<br />
materials.<br />
Provide support materials that address the<br />
current and emerging issues impacting on<br />
the quality <strong>of</strong> assessment practice<br />
The national audit <strong>of</strong> assessment related support materials<br />
identified a set <strong>of</strong> twenty-one current and emerging issues<br />
impacting on the quality <strong>of</strong> assessment practice. These<br />
included: assessing in apprenticeship and traineeship<br />
programs, assessing higher order competencies, assessment<br />
quality assurance, assessment validation, assessment<br />
judgement, assessor networks, and assessing generic /<br />
employability skills.<br />
The evaluation <strong>of</strong> the national stock <strong>of</strong> assessment-related<br />
support materials showed that:<br />
• There is a very limited range <strong>of</strong> up to date, assessment<br />
materials that address these issues; and<br />
• There are a number <strong>of</strong> key assessment-related issues <br />
for which there are no suitable, nationally available <br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 9
support materials. For example, the national audit did not<br />
identify any materials that provide assessors with<br />
current, high quality advice on: peer, self and negotiated<br />
assessment; formative assessment; the use <strong>of</strong><br />
simulation; and the assessment <strong>of</strong> international students<br />
and students from non-English speaking backgrounds.<br />
The absence <strong>of</strong> quality assessment support materials is an<br />
impediment to improving assessment practice. Consideration<br />
should be given to establishing a national assessment<br />
initiative that is focused on developing support materials and<br />
fostering assessor capability in these key areas.<br />
Recommendation 6<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> sponsor a national<br />
assessment initiative to develop support materials and foster<br />
assessor capability in relation to the key issues impacting on<br />
the quality <strong>of</strong> assessment practice. Specifically the national<br />
assessment initiative should:<br />
1. Commission an integrated series <strong>of</strong> projects designed to<br />
develop support materials and assessor capability in<br />
relation to:<br />
The use <strong>of</strong> formative assessment or assessment for<br />
learning approaches to enhance competency<br />
development;<br />
Improving the quality <strong>of</strong> assessor judgement in the<br />
assessment process;<br />
Assessing in workplace settings, including identifying<br />
and addressing the skill development needs <strong>of</strong><br />
employees, supervisors, human resource practitioners<br />
and other workplace personnel who are engaged in<br />
providing training and assessment functions;<br />
The use <strong>of</strong> peer, self and negotiated assessment to<br />
improve competency development;<br />
Contextualising nationally recognised assessment<br />
resources for use in enterprise based training and<br />
assessment systems;<br />
The use <strong>of</strong> simulation in competency based<br />
assessment;<br />
<strong>Assessment</strong> <strong>of</strong> higher order competencies;<br />
Assessing in international contexts – assessment <strong>of</strong><br />
international students in Australian and international<br />
settings;<br />
The integrated assessment <strong>of</strong> skill sets;<br />
Cost effective approaches to assessment moderation;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 10
<strong>Assessment</strong> in regulated occupations / industries; and<br />
Competency based assessment in online learning<br />
environments.<br />
2. Establish a national implementation program, in<br />
conjunction with the Industry <strong>Skills</strong> <strong>Council</strong> and national,<br />
State and Territory VET agencies, to ensure that all<br />
assessors in private, public and enterprise providers are<br />
provided with training and / or information on:<br />
The issues addressed in the materials; and<br />
How to effectively use the materials with different VET<br />
clients and in varying VET contexts.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 11
2. Background<br />
In May 2009, the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> [NQC], through the<br />
<strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> Action Group [QAAG], commissioned<br />
Learning Australia Pty Ltd to undertake the second stage <strong>of</strong><br />
the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> <strong>Practices</strong> project. This was<br />
designed to:<br />
• Review the materials that were identified through the<br />
national audit <strong>of</strong> assessment materials that was<br />
undertaken during first stage <strong>of</strong> the project;<br />
• Develop a strategy to address gaps in the provision <strong>of</strong><br />
assessment materials required to support quality<br />
assessment; and<br />
• Establish a plan for the dissemination and<br />
implementation <strong>of</strong> any new, updated or existing materials<br />
for supporting quality assessment.<br />
This project built on the outcomes <strong>of</strong> the first stage <strong>of</strong> the<br />
project which was commissioned by the former VET<br />
Workforce Standing Committee <strong>of</strong> the <strong>National</strong> <strong>Quality</strong><br />
<strong>Council</strong> in November 2008. The key outcome <strong>of</strong> stage 1 <strong>of</strong><br />
the project was a report that:<br />
• Identified the characteristics <strong>of</strong> quality assessment;<br />
• Discussed the key issues impacting on quality<br />
assessment in the VET sector in the current context;<br />
• Identified the assessment materials that are currently<br />
available to support quality assessment practices; and<br />
• Identified the critical components <strong>of</strong> quality assessment.<br />
The first stage report sets out seven key actions which<br />
should be taken to improve the quality <strong>of</strong> assessment<br />
practices in the vocational education and training sector. The<br />
key actions are as follows:<br />
1. Build assessment expertise within the VET sector;<br />
2. Provide clear benchmarks for assessment;<br />
3. Build the status and capability <strong>of</strong> assessors;<br />
4. Improve assessment quality assurance by supporting<br />
the effective implementation <strong>of</strong> the current AQTF<br />
standards;<br />
5. Provide high quality, industry endorsed model<br />
assessment support materials;<br />
6. Improve the capability <strong>of</strong> assessors to make quality<br />
assessment judgements; and<br />
7. Ensure that assessment is an integral part <strong>of</strong> the<br />
learning and training process.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 12
The key actions and associated recommendations, which<br />
were considered by the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> Action Group<br />
early in 2009, are fully detailed in the Stage 1 report.<br />
The <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> (NQC) endorsed the final<br />
report, <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> <strong>Practices</strong> Stage 1 (parts A and<br />
B), for public release in April 2009, with the caveat that the<br />
recommendations were currently under consideration by the<br />
NQC and would not necessarily be implemented in the<br />
future. A number <strong>of</strong> recommendations were directed to NQC<br />
Action Groups for further consideration.<br />
The NQC also agreed that the report on the <strong>National</strong><br />
Mapping <strong>of</strong> <strong>Assessment</strong> Materials, which formed part <strong>of</strong> the<br />
Stage 1 report, would be further reviewed in Stage 2 <strong>of</strong> the<br />
project and that this would also provide recommendations to<br />
the NQC on how gaps in materials might be addressed.<br />
Learning Australia Pty Ltd was granted the tender to<br />
complete Stage 2 <strong>of</strong> the project.<br />
The second stage <strong>of</strong> the project is the focus <strong>of</strong> this report. It<br />
involved Learning Australia in:<br />
1. Undertaking an evaluation <strong>of</strong> the materials identified<br />
through the national audit <strong>of</strong> assessment materials; and<br />
2. Formulating a strategy for addressing the issues raised<br />
through the evaluation <strong>of</strong> the national stock <strong>of</strong><br />
assessment materials. <br />
The work undertaken during this stage <strong>of</strong> the project was<br />
also informed by:<br />
• The findings <strong>of</strong> the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> project<br />
Investigation into industry expectations <strong>of</strong> vocational<br />
education and training assessment;<br />
• The outcomes <strong>of</strong> the NQC project on Alternative<br />
frameworks for recognizing workplace training which was<br />
undertaken in late 2008;<br />
• The findings emerging from the suite <strong>of</strong> assessment-<br />
related projects currently being undertaken by the NQC<br />
dealing with moderation and validation processes,<br />
industry partnerships and graded assessment; and<br />
• The preliminary findings <strong>of</strong> the <strong>National</strong>; <strong>Quality</strong> <strong>Council</strong> /<br />
<strong>Council</strong> <strong>of</strong> Australian Governments Joint Steering<br />
Committee project on VET products for the 21st century<br />
project.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 13
3. Structure <strong>of</strong> this report<br />
This report describes the outcomes <strong>of</strong> the evaluation <strong>of</strong> the<br />
national stock <strong>of</strong> assessment support materials and a strategy<br />
to address the key issues impacting on the national stock <strong>of</strong><br />
assessment support materials.<br />
This report comprises six key sections:<br />
• Section one is an executive summary.<br />
• Section two provides the background to the project.<br />
• Section three outlines the structure <strong>of</strong> the report.<br />
• Section four describes the project methodology.<br />
• Section five discusses the findings <strong>of</strong> the evaluation <strong>of</strong><br />
the national stock <strong>of</strong> assessment support materials.<br />
• Section six details a strategy to address the key issues<br />
impacting on the national stock <strong>of</strong> assessment support<br />
materials.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 14
4. Project methodology<br />
The methodology developed by Learning Australia Pty Ltd for<br />
this project involved four key stages. These were:<br />
1. Project establishment – the consultant met with the NQC<br />
Secretariat Project Director to clarify the scope,<br />
methodology and expected outcomes <strong>of</strong> the project.<br />
2. Review <strong>of</strong> the national stock <strong>of</strong> assessment materials –<br />
the consultant undertook an analysis <strong>of</strong> the three sets <strong>of</strong><br />
assessment materials that were identified through the<br />
national audit <strong>of</strong> assessment materials [see stage one<br />
report]. Materials included in the audit were selected on<br />
the basis <strong>of</strong> the following criteria:<br />
The materials are available to both private and public<br />
RTOs;<br />
The materials are available free or at nominal cost;<br />
The materials have been subject to a relevant quality<br />
assurance process. This was taken to include:<br />
validation by industry, review by a user group or<br />
appraisal against a set <strong>of</strong> quality criteria, such as the<br />
quality principles for Training Package Support<br />
Materials or quality principles established for<br />
educational materials development by any relevant<br />
Australian or international body;<br />
The materials have been designed to support<br />
assessment <strong>of</strong> units <strong>of</strong> competency, modules and /<br />
or qualifications in Training Packages and / or State /<br />
Territory accredited courses;<br />
The materials have been developed for use in the<br />
Australian vocational education and training system;<br />
The materials have been developed since 2000; and<br />
The materials are primarily assessment resources.<br />
As such the audit did not include learning materials<br />
that may incorporate an assessment component.<br />
The analysis <strong>of</strong> the materials was undertaken in two stages.<br />
The first stage involved a meta-evaluation <strong>of</strong> the three sets<br />
<strong>of</strong> assessment materials. This focused on identifying the:<br />
• Number <strong>of</strong> materials;<br />
• Type <strong>of</strong> materials;<br />
• Format <strong>of</strong> materials;<br />
• Age <strong>of</strong> materials;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 15
• Key aspects <strong>of</strong> assessment practice covered by the<br />
materials; and<br />
• Key areas <strong>of</strong> assessment practice in which there are<br />
gaps.<br />
In the case <strong>of</strong> the third set <strong>of</strong> assessment materials, namely<br />
materials which are designed for specific industry /<br />
occupational areas, the meta-evaluation also identified the<br />
industry coverage <strong>of</strong> the materials. The second stage<br />
involved an evaluation <strong>of</strong> the individual items in each <strong>of</strong> the<br />
three sets <strong>of</strong> assessment materials. This involved evaluating<br />
the individual items against the evaluative criteria and scoring<br />
system set out in Figure 1.<br />
It should be noted that as the third set <strong>of</strong> assessment<br />
materials, namely materials for specific industry areas, was<br />
so extensive it was agreed with the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong><br />
Action Group that a sample <strong>of</strong> assessment materials in this<br />
group would be evaluated. The sample:<br />
• Comprised 99 <strong>of</strong> the 1,643 <strong>of</strong> the assessment materials<br />
in this group that were identified through the national<br />
audit;<br />
• Covered each <strong>of</strong> the 27 industry areas identified in the<br />
national audit <strong>of</strong> assessment materials;<br />
• Covered each <strong>of</strong> the agencies, identified through the<br />
audit, that either develop or distribute assessment<br />
materials in each <strong>of</strong> the twenty-seven industry areas;<br />
and<br />
• Was randomly selected across the industry areas and<br />
the agencies engaged in the development or distribution<br />
<strong>of</strong> the assessment materials.<br />
The following table indicates the evaluation criteria and the<br />
scoring system used in the meta- evaluation<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 16
Figure 1: Evaluation criteria and scoring system<br />
VALIDITY<br />
Score<br />
Descriptor<br />
1 The assessment materials clearly comply with the approach to assessment<br />
embodied in the current version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework and,<br />
where relevant, comply with the assessment provisions in the current version <strong>of</strong> the<br />
relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />
2 The assessment materials generally comply with the approach to assessment<br />
embodied in the current version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework and,<br />
where relevant, generally comply with the assessment provisions in the current<br />
version <strong>of</strong> the relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />
3 The assessment materials do not appear to comply with the approach to<br />
assessment embodied in the current version <strong>of</strong> the Australian <strong>Quality</strong> Training<br />
Framework and / or do not appear to comply with the assessment provisions in<br />
the current version <strong>of</strong> the relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />
ACCESSIBILITY<br />
Score<br />
Descriptor<br />
1 The assessment materials are readily accessible to assessors and trainers in all<br />
jurisdictions working in both private and public RTOs in a wide variety <strong>of</strong> VET<br />
contexts ie: institutional settings, workplaces, enterprises and schools. Generally<br />
these materials are marketed nationally; able to be viewed, downloaded and / or<br />
ordered via the Internet; and are free <strong>of</strong> charge or low cost.<br />
2 The assessment materials are generally accessible to assessors and trainers<br />
working in a variety <strong>of</strong> VET contexts ie: institutional settings, workplaces,<br />
enterprises and schools. Accessibility may be limited by lack <strong>of</strong> national marketing;<br />
restricted web access for downloading, ordering or viewing; and / or cost.<br />
3 The assessment materials do not appear to be accessible to all assessors and<br />
trainers. There are significant restrictions, such as cost; licensing; copyright;<br />
subscription and absence <strong>of</strong> web access for downloading, ordering or viewing that<br />
limit the accessibility <strong>of</strong> the assessment materials.<br />
USABILITY<br />
Score<br />
Descriptor<br />
1 The assessment materials are well designed. The materials design is user<br />
friendly [ie: the user knows what to do and how to do it]. The time and effort<br />
needed to customize and use the materials is reasonable.<br />
2 The assessment materials are generally well designed. The materials design<br />
could be more user friendly [ie: the user needs clearer advice on what to do and<br />
how to do it]. Users must invest significant time and effort to customize and / or use<br />
the materials.<br />
3 The assessment materials do not appear to be well designed. The materials<br />
design is not user friendly. The time and/ or effort needed to customize and / or<br />
use the materials is excessive.<br />
FLEXIBILITY<br />
Score<br />
Descriptor<br />
1 The assessment materials: [1] may be adapted for use with a variety <strong>of</strong> VET clients,<br />
[2] take into account equity considerations, [3] make provision for reasonable<br />
adjustment, and [4] may be readily applied in a range <strong>of</strong> VET contexts.<br />
2 The assessment materials require significant user input to: [1] be used with a<br />
variety <strong>of</strong> VET clients, [2] take into account equity considerations, [3] make<br />
provision for reasonable adjustment, and [4] be applied in different VET contexts.<br />
3 The assessment materials do not appear to [1] be suited for use with a variety <strong>of</strong><br />
VET clients, including learners with special needs, [2] take into account equity<br />
considerations, [3] make provision for reasonable adjustment, and [4] be designed<br />
for application in different VET contexts.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2<br />
17
The second stage involved both the preparation <strong>of</strong> a draft<br />
report and consultation. The consultant collated the<br />
information gathered through the analysis <strong>of</strong> the national<br />
stock <strong>of</strong> assessment materials and produced a draft report<br />
that identified:<br />
• The outcomes <strong>of</strong> the analysis <strong>of</strong> the national stock <strong>of</strong><br />
assessment materials; and<br />
• A strategy for addressing issues that arose from the<br />
evaluation <strong>of</strong> the assessment support materials.<br />
During this stage, the consultant met with representatives <strong>of</strong><br />
the following organisations to gather views and opinions on<br />
the outcomes emerging from the analysis <strong>of</strong> the national<br />
stock <strong>of</strong> assessment materials:<br />
Australian Chamber <strong>of</strong> Commerce and Industry<br />
Australian <strong>Council</strong> <strong>of</strong> Trade Unions<br />
Australian Industry Group<br />
Construction and Property Services Industry <strong>Skills</strong><br />
<strong>Council</strong><br />
Department <strong>of</strong> Education and Training –<br />
Queensland<br />
Department <strong>of</strong> Education and Training – Western<br />
Australia<br />
Department <strong>of</strong> Further Education, Employment,<br />
Science and Technology – South Australia.<br />
TVET Australia<br />
A list <strong>of</strong> individuals consulted is provided as Appendix 1.<br />
The draft report was prepared and presented to the NQC<br />
Secretariat and members <strong>of</strong> the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong><br />
Action Group for comment in early June 2009.<br />
The third stage involved preparation <strong>of</strong> the final report and <br />
acquittal <strong>of</strong> the project. The consultant reviewed the<br />
feedback from the members <strong>of</strong> the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong><br />
Action Group and prepared the final version <strong>of</strong> the project<br />
report and recommendations. This was presented to the<br />
Action Group in mid June 2009.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 18
5 Findings <strong>of</strong> the evaluation <strong>of</strong> the national<br />
stock <strong>of</strong> assessment materials<br />
The national audit <strong>of</strong> assessment related materials, which<br />
was conducted during the first stage <strong>of</strong> this project, identified<br />
1,705 assessment materials that met the selection criteria.<br />
As discussed earlier in this report, these resources may be<br />
divided in three broad categories. These are:<br />
1. <strong>Assessment</strong> materials which support the general needs<br />
<strong>of</strong> the VET workforce in relation to assessment. This<br />
includes resources that focus on matters such as: the<br />
design <strong>of</strong> assessment / evidence gathering tools, making<br />
assessment judgements, the assessment process,<br />
providing feedback and unpacking competency<br />
standards.<br />
2. <strong>Assessment</strong> materials that address specific assessment<br />
related issues, including: assessing generic /<br />
employability skills, assessing higher order<br />
competencies, peer, self and negotiated assessment,<br />
on-line assessment, graded assessment, workplace<br />
assessment, simulation, <strong>of</strong>f the job assessment,<br />
assessment in apprenticeships/ traineeships,<br />
assessment and international / NESB students and<br />
reasonable adjustment.<br />
3. <strong>Assessment</strong> instruments for the assessment <strong>of</strong> specific<br />
units <strong>of</strong> competency and / or qualifications, such as <br />
observation checklists, portfolios, question banks,<br />
practical tasks, simulations, test items and third party<br />
reports.<br />
The ensuing section <strong>of</strong> this report provides an analysis <strong>of</strong><br />
the availability and quality <strong>of</strong> the resources in each <strong>of</strong><br />
these categories <strong>of</strong> assessment materials.<br />
5.1 <strong>Assessment</strong> materials that address the general<br />
needs <strong>of</strong> assessors<br />
The national audit <strong>of</strong> assessment materials identified forty<br />
resources which address the general needs <strong>of</strong> assessors<br />
[see Appendix 2].<br />
These resources, as shown in Figure 2, deal with five key<br />
themes, namely: the assessment process, assessment<br />
system management, assessment tool design, assessor<br />
skills and recognition <strong>of</strong> prior learning. However most <strong>of</strong><br />
these resources focus on two themes, namely the<br />
assessment process [twelve] and recognition <strong>of</strong> prior<br />
learning [twenty].<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 19
Figure 2: <strong>Assessment</strong> resources that address the general needs <strong>of</strong><br />
assessors – number <strong>of</strong> resources<br />
General needs <strong>of</strong> assessors<br />
Number <strong>of</strong><br />
resources<br />
<strong>Assessment</strong> process 12<br />
<strong>Assessment</strong> system management 3<br />
<strong>Assessment</strong> tool design 4<br />
Assessor skills 1<br />
Recognition <strong>of</strong> prior learning 20<br />
Total 40<br />
As shown in Figure 3, most <strong>of</strong> the resources related to these<br />
two themes are very recent. Fourteen <strong>of</strong> the twenty<br />
resources on recognition <strong>of</strong> prior learning, were developed<br />
through the <strong>Council</strong> <strong>of</strong> Australian Governments Recognition<br />
<strong>of</strong> Prior Learning Program, and eight <strong>of</strong> the twelve resources<br />
dealing with the assessment process have been published<br />
since 2008. Overall, more than three-quarters <strong>of</strong> the<br />
assessment materials in this category have been published<br />
since 2006. As such, there is a relatively extensive stock <strong>of</strong><br />
up to date assessment materials in this category.<br />
Nevertheless the national audit did reveal that there is a lack<br />
<strong>of</strong> assessment support materials dealing with three key<br />
themes, namely:<br />
1. <strong>Assessment</strong> feedback;<br />
2. <strong>Assessment</strong> recording and reporting processes; and<br />
3. <strong>Assessment</strong> moderation.<br />
Whilst there is a lack <strong>of</strong> specialised material dealing with the<br />
first two <strong>of</strong> these themes, the evaluation <strong>of</strong> the materials in<br />
this category revealed that these matters are <strong>of</strong>ten<br />
addressed in broader resources dealing with the assessment<br />
process and recognition <strong>of</strong> prior learning process. This did<br />
not appear to be the case with assessment moderation and<br />
there appears to be a distinct lack <strong>of</strong> up to date support<br />
materials in this area.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 20
Figure 3: <strong>Assessment</strong> resources that address the general needs <strong>of</strong> assessors<br />
– year <strong>of</strong> publication<br />
Year <strong>of</strong> publication<br />
Number <strong>of</strong><br />
resources<br />
2008 - 2009 29<br />
2006 - 2007 2<br />
Prior to 2006 9<br />
Total 40<br />
The forty resources in this category were evaluated against<br />
the four criteria <strong>of</strong> validity, accessibility, usability and flexibility<br />
[see Figure 1]. The individual ratings for each resource are<br />
detailed in Appendix 2.<br />
The ratings show that on a three point scale, with one<br />
indicating clear compliance with the criterion and three<br />
indicating non compliance with the criterion, that four <strong>of</strong> the<br />
forty resources attained an aggregate score <strong>of</strong> 1.0, twentytwo<br />
scored 1.25 and thirteen scored 1.50. It is also<br />
interesting to note that in terms <strong>of</strong> validity, twenty-one <strong>of</strong> the<br />
forty resources scored 1.0 and the remaining nineteen<br />
scored 2.0.<br />
Overall this suggests that the resources in this category are<br />
generally <strong>of</strong> a high quality. Over half <strong>of</strong> the resources fully<br />
comply and the remainder generally comply with the<br />
approach to assessment embodied in the Australian <strong>Quality</strong><br />
Training Framework and / or Training Packages. In addition<br />
the resources:<br />
• Are accessible to trainers and assessors;<br />
• Are user friendly;<br />
• Address equity considerations; and<br />
• Are able to be used with a variety <strong>of</strong> VET clients in a<br />
range <strong>of</strong> contexts, including in workplace, institutional<br />
and on line settings.<br />
While the materials in this category are generally accessible<br />
to trainers and assessors, it is interesting to note that thirtyone<br />
<strong>of</strong> the forty resources rated 2.00 on the accessibility<br />
scale. This reflects the following facts:<br />
• Half <strong>of</strong> the materials have been developed by State and<br />
Territory agencies. While these materials are generally<br />
available on line, they simply may not been known by<br />
assessors and trainers in other jurisdictions; and<br />
• Some <strong>of</strong> the materials, such as the Shea series, are<br />
commercial publications. Even though these materials<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 21
are reasonably priced, the cost <strong>of</strong> these materials may<br />
limit their accessibility for some users.<br />
While accessibility is an important factor, the main issue<br />
impacting on this category <strong>of</strong> materials is maintenance. As<br />
noted earlier, most <strong>of</strong> these materials have been published<br />
since 2006, with twenty nine <strong>of</strong> the forty resources being<br />
published since 2008. However most <strong>of</strong> these materials have<br />
been developed using project funds and are not supported<br />
by a maintenance strategy. This means that there is no<br />
systematic process for ensuring that the materials keep pace<br />
with changes to the Australian <strong>Quality</strong> Training Framework,<br />
Training Packages, industry practice and relevant legislation.<br />
As a result there is a significant risk that these materials will<br />
become obsolete.<br />
In summary, the evaluation <strong>of</strong> the assessment materials in <br />
this category showed that: <br />
• There is a good range <strong>of</strong> high quality, up to date<br />
materials dealing with the general needs <strong>of</strong> assessors;<br />
• There is a lack <strong>of</strong> support materials on assessment <br />
moderation;<br />
• Many <strong>of</strong> the materials are State or Territory publications,<br />
this limits their accessibility and consideration should be<br />
given to making them more readily available to a wider<br />
national audience; and<br />
• In many cases there is no systematic process for<br />
maintaining these materials.<br />
5.2 <strong>Assessment</strong> materials that address key<br />
assessment-related issues<br />
Through the national audit <strong>of</strong> assessment materials,<br />
information was gathered on the availability and quality <strong>of</strong><br />
resources that address twenty-one key assessment-related <br />
issues. These are:<br />
• Apprenticeships and traineeship and assessment;<br />
• AQTF;<br />
• Assessing generic / employability skills;<br />
• Assessing higher order competencies;<br />
• <strong>Assessment</strong> and international / NESB students;<br />
• <strong>Assessment</strong> judgement;<br />
• <strong>Assessment</strong> partnerships;<br />
• <strong>Assessment</strong> quality assurance;<br />
• <strong>Assessment</strong> validation;<br />
• Assessor networks;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 22
• Assessor training;<br />
• E learning and assessment;<br />
• Formative assessment;<br />
• Graded assessment;<br />
• Norm referenced assessment;<br />
• Off the job assessment;<br />
• On-line assessment;<br />
• Peer, self and negotiated assessment;<br />
• Reasonable adjustment;<br />
• Simulation; and<br />
• Workplace assessment, including contextualisation <strong>of</strong><br />
nationally recognised materials for use in enterprise<br />
based programs.<br />
The national audit identified twenty-two resources which<br />
address these issues [see Appendix 3].<br />
These resources, as shown in Figure 4, cover thirteen <strong>of</strong> the<br />
twenty-one key issues. These include assessing within<br />
apprenticeship and traineeship programs, assessing higher<br />
order competencies and assessment quality assurance. For<br />
six <strong>of</strong> these thirteen issues, namely assessment validation,<br />
assessment judgement, assessing within apprenticeship and<br />
traineeship programs, assessor networks, assessment<br />
quality assurance and assessing generic / employability<br />
skills, at least two resources were identified through the<br />
audit.<br />
For seven <strong>of</strong> these assessment-related issues, including<br />
such critical issues as reasonable adjustment and assessing<br />
higher order competencies, there was only one resource<br />
identified through the audit. In the latter case, the resource<br />
was originally published in 2001 and as such predates the<br />
recent reforms to the AQTF and moves to enhance<br />
articulation between the VET and higher education sectors.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 23
Figure 4: Key assessment themes – number <strong>of</strong> resources identified in the<br />
national audit <strong>of</strong> assessment materials<br />
Key assessment theme<br />
Number <strong>of</strong><br />
resources<br />
<strong>Assessment</strong> judgement 3<br />
Apprenticeships and traineeship and assessment 3<br />
<strong>Assessment</strong> validation 3<br />
Assessor networks 2<br />
<strong>Assessment</strong> quality assurance 2<br />
Assessing generic / employability skills 2<br />
Workplace assessment 1<br />
Reasonable adjustment 1<br />
E learning / assessment 1<br />
Assessor training 1<br />
<strong>Assessment</strong> partnerships 1<br />
Assessing higher order competencies 1<br />
AQTF 1<br />
Total 22<br />
In addition, as shown in Figure 5, there were eight key<br />
assessment-related issues for which no resources were<br />
identified. This included key issues impacting on the quality<br />
<strong>of</strong> assessment practice, such as formative assessment, the<br />
use <strong>of</strong> peer, self and negotiated assessment and assessing<br />
international students and students from non-English<br />
speaking backgrounds.<br />
Figure 5 – Key assessment themes not represented in national audit <strong>of</strong><br />
assessment materials<br />
Key assessment theme<br />
Peer, self and negotiated assessment<br />
Formative assessment<br />
On-line assessment<br />
Graded assessment<br />
Simulation<br />
Norm referenced assessment<br />
Off the job assessment<br />
<strong>Assessment</strong> and international / NESB students<br />
Furthermore, as shown in Figure 6, half <strong>of</strong> the resources in<br />
this category were published prior to 2006.<br />
Figure 6 – Key assessment – related resources – year <strong>of</strong> publication<br />
Year <strong>of</strong> publication<br />
Number <strong>of</strong><br />
resources<br />
2008 - 2009 8<br />
2006 - 2007 3<br />
Prior to 2006 11<br />
Total 22<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 24
The twenty-two resources in this category were evaluated<br />
against the four criteria <strong>of</strong> validity, accessibility, usability and<br />
flexibility [see Figure 1]. The individual ratings for each<br />
resource are detailed in Appendix 3.<br />
The ratings show that on a three point scale, with one<br />
indicating clear compliance with the criterion and three<br />
indicating non compliance with the criterion, that two <strong>of</strong> the<br />
resources attained an aggregate score <strong>of</strong> 1.0, seventeen<br />
scored 1.25 and three scored 1.50. Overall this suggests that<br />
the resources are generally <strong>of</strong> high quality in that they:<br />
• Generally comply with the approach to assessment<br />
embodied in the Australian <strong>Quality</strong> Training Framework<br />
and / or Training Packages;<br />
• Are accessible to trainers and assessors;<br />
• Are user friendly;<br />
• Address equity considerations; and<br />
• Are able to be used with a variety <strong>of</strong> VET clients in a<br />
range <strong>of</strong> contexts, including in workplace, institutional<br />
and on line settings.<br />
Nevertheless the evaluation <strong>of</strong> the individual items indicated<br />
that:<br />
• Fourteen <strong>of</strong> the twenty-two resources, while generally<br />
complying with the Australian <strong>Quality</strong> Training<br />
Framework and / or Training Packages do not fully<br />
comply with the current versions <strong>of</strong> these documents<br />
[see Appendix 2]. In most cases, this is due to the fact<br />
that the resources have become dated and there has<br />
been no maintenance strategy to ensure that the<br />
resources are updated to accommodate changes in<br />
assessment practice, the AQTF and / or Training<br />
Packages. A clear example <strong>of</strong> this is the assessment<br />
guides that were developed through the Training<br />
Materials <strong>Assessment</strong> Project by the former Australian<br />
<strong>National</strong> Training Authority and the Department <strong>of</strong><br />
Education, Science and Training in 2001. These guides,<br />
which address matters such as assessment quality<br />
assurance, assessing higher order competencies and<br />
assessing in partnerships, while providing a valuable<br />
resource have not been updated and do not reflect the<br />
changes that have occurred in assessment practice and<br />
the AQTF over the past eight years.<br />
• A number <strong>of</strong> resources have been developed by State<br />
and Territory training authorities in response to local<br />
needs. For example, the Western Australian Department<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 25
<strong>of</strong> Education and Training has developed a series <strong>of</strong><br />
guides for assessors that focus on issues such as<br />
assessment validation and assessing apprenticeships<br />
and traineeships. Similar materials have also been<br />
developed by the Department <strong>of</strong> Education and Training<br />
in Queensland on assessment judgement and the NSW<br />
Department <strong>of</strong> Education and Training on assessment<br />
judgement and assessing generic and employability<br />
skills. While primarily developed for local audiences<br />
these materials have national relevance and should be<br />
made more accessible to trainers and assessors in other<br />
jurisdictions. Even though these materials may be<br />
accessed via the Internet, assessors in other<br />
jurisdictions are <strong>of</strong>ten simply unaware that the materials<br />
exist.<br />
• While most <strong>of</strong> the resources identified in this category<br />
are available either free <strong>of</strong> charge via download from the<br />
Internet or at relatively low cost, there are some items,<br />
such as the tool box on E-learning assessment that is<br />
distributed by TVET Australia, which are relatively<br />
inaccessible due to cost.<br />
In summary, the evaluation <strong>of</strong> the assessment materials in<br />
this category showed that:<br />
1. There is a very limited range <strong>of</strong> up to date, assessment<br />
materials that address the key issues impacting on<br />
quality assessment;<br />
2. Most <strong>of</strong> the existing assessment materials are not<br />
supported by a maintenance strategy and this means<br />
that there is risk that these materials will become<br />
obsolete;<br />
3. A number <strong>of</strong> high quality resources have been<br />
developed by State and Territory training authorities<br />
which should be made available to assessors in other<br />
jurisdictions;<br />
4. The cost <strong>of</strong> some <strong>of</strong> the materials may limit their<br />
accessibility; and<br />
5. There are a number <strong>of</strong> key assessment-related issues<br />
for which there are no suitable, nationally available<br />
support materials. For example, the national audit did not<br />
identify any materials that provide assessors with<br />
current, high quality advice on: peer, self and negotiated<br />
assessment; formative assessment; the use <strong>of</strong><br />
simulation; and the assessment <strong>of</strong> international students<br />
and students from non English speaking backgrounds.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 26
5.3 Industry specific assessment materials<br />
The national audit identified 1,643 industry specific<br />
assessment-related resources across twenty-one industry<br />
areas [see Appendix 4]. These materials included<br />
assessment tools, assessor guides and candidate resources.<br />
The distinguishing feature <strong>of</strong> these materials is that they have<br />
been prepared to address assessment requirements within a<br />
specific industry or occupational area. In many cases, the<br />
materials have been designed to assist with the assessment<br />
<strong>of</strong> a specific unit <strong>of</strong> competency in a Training Package.<br />
Most <strong>of</strong> the materials in this category have been developed<br />
by State and Territory training authorities, particularly New<br />
South Wales, Victoria and Queensland and national Industry<br />
<strong>Skills</strong> <strong>Council</strong>s.<br />
As shown in Figure 7, the assessment materials in this<br />
category are unevenly spread across the twenty-one industry<br />
areas. For example, the audit identified six hundred and<br />
thirteen resources that are designed to support the<br />
assessment process in primary industries. This represents<br />
37% <strong>of</strong> the national stock <strong>of</strong> industry specific assessment<br />
resources. In contrast, less than twenty assessment-related<br />
resources were identified in each <strong>of</strong> the following sectors:<br />
communications, general education and training,<br />
government, health, laboratory operations, pharmaceuticals,<br />
property services, sport and recreation, seafood and water.<br />
The industry areas which appear to be most well serviced in<br />
terms <strong>of</strong> industry specific assessment resources are: primary<br />
industries, business, construction and engineering.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 27
Figure 7: Industry specific assessment resources – number <strong>of</strong> items<br />
Industry area<br />
Number <strong>of</strong> resources<br />
Audit<br />
Sample<br />
Total<br />
Arts and Entertainment 29 5<br />
Automotive 66 4<br />
Business 129 7<br />
Communications 19 2<br />
Community Services 25 5<br />
Construction 100 3<br />
Engineering 95 7<br />
Food processing 31 5<br />
Forest and forest products 92 3<br />
Furnishing 20 4<br />
General education and training 3 2<br />
General manufacturing 42 2<br />
Government 11 4<br />
Health 1 1<br />
Horse 56 1<br />
Hospitality 35 3<br />
Laboratory Operations 14 4<br />
Mining 94 2<br />
Pharmaceuticals 14 1<br />
Primary Industries 613 7<br />
Property Services 3 1<br />
Retail, Wholesale and Personal Services 45 10<br />
Sport and Recreation 8 2<br />
Tourism 45 4<br />
Transport and Distribution 34 7<br />
Seafood 18 2<br />
Water 1 1<br />
1643 99<br />
The analysis <strong>of</strong> the assessment materials in this category is<br />
based on a sample <strong>of</strong> ninety-nine resources [see Figure 7].<br />
The criteria for selecting this sample are outlined in section 4<br />
<strong>of</strong> this report.<br />
As shown in Figure 8, forty-four <strong>of</strong> the ninety-nine [44.4%]<br />
resources in this category were published prior to 2006. This<br />
means that many <strong>of</strong> the resources, such as assessment<br />
instruments for specific units <strong>of</strong> competency, are not based<br />
on the current version <strong>of</strong> either the relevant Training Package<br />
and / or the Australian Qualifications Training Framework.<br />
It also means that many <strong>of</strong> these resources may not be<br />
consistent with current legislation, regulations, codes <strong>of</strong><br />
practice and work practices that apply in the relevant industry<br />
sectors.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 28
Figure 8: Industry specific assessment resources – year <strong>of</strong> publication <strong>of</strong><br />
sample assessment resources<br />
Year <strong>of</strong> publication<br />
Number <strong>of</strong><br />
resources<br />
2008 - 2009 8<br />
2006 - 2007 21<br />
Prior to 2006 44<br />
Not available 29<br />
Total 99<br />
As illustrated in Figure 9 many <strong>of</strong> the assessment materials<br />
in this category ranked low in terms <strong>of</strong> validity. The<br />
evaluation revealed that only eighteen <strong>of</strong> the ninety- nine<br />
resources in the sample [18.1%] were fully compliant with the<br />
current version <strong>of</strong> the relevant Training Package and / or the<br />
Australian Qualifications Training Framework. Sixty items<br />
[60.6%] in the sample were assessed as not appearing to<br />
comply with the approach to assessment embodied in the<br />
current version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework<br />
and / or the assessment provisions in the current version <strong>of</strong><br />
the relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />
Figure 9: Industry specific assessment resources – validity <strong>of</strong> sample<br />
assessment resources<br />
Validity rating scale<br />
Number <strong>of</strong><br />
resources<br />
1. The assessment materials clearly comply with the<br />
18 [18.1%]<br />
approach to assessment embodied in the current version<br />
<strong>of</strong> the Australian <strong>Quality</strong> Training Framework and, where<br />
relevant, comply with the assessment provisions in the<br />
current version <strong>of</strong> the relevant Training Package and / or<br />
unit[s] <strong>of</strong> competency.<br />
2. The assessment materials generally comply with the 21 [21.2%]<br />
approach to assessment embodied in the current version<br />
<strong>of</strong> the Australian <strong>Quality</strong> Training Framework and, where<br />
relevant, generally comply with the assessment<br />
provisions in the current version <strong>of</strong> the relevant Training<br />
Package and / or unit[s] <strong>of</strong> competency.<br />
3. The assessment materials do not appear to comply with 60 [60.6%]<br />
the approach to assessment embodied in the current<br />
version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework and<br />
/ or do not appear to comply with the assessment<br />
provisions in the current version <strong>of</strong> the relevant Training<br />
Package and / or unit[s] <strong>of</strong> competency.<br />
Total 99 [99.9%]<br />
Overall the assessment materials in this category rated lower<br />
than the materials in the other two categories. The individual<br />
ratings for each resource are detailed in Appendix 4.<br />
As illustrated in Figure 10, none <strong>of</strong> the ninety-nine resources<br />
attained an aggregate score <strong>of</strong> 1.0, twenty-six scored less<br />
than 2.0 and seventy -three scored 2.0 or over, with ten<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 29
scoring 2.5. Overall this suggests that the resources in this<br />
category rate poorly in terms <strong>of</strong> quality. This is primarily<br />
because many <strong>of</strong> the materials are dated and do not comply<br />
with the current version <strong>of</strong> the relevant Training Package and<br />
/ or the Australian <strong>Quality</strong> Training Framework. In addition,<br />
the accessibility <strong>of</strong> many <strong>of</strong> the materials is limited because<br />
they have been developed by State and Territory training<br />
authorities and may not be known to assessors in other<br />
jurisdictions. Also a number <strong>of</strong> the materials are only<br />
available on a commercial basis, such as the VETASSESS<br />
materials, which limits their accessibility to some users.<br />
On the positive side most <strong>of</strong> the materials in this category<br />
were assessed as being:<br />
• Generally well designed; and<br />
• Able to be used with a variety <strong>of</strong> VET clients in a range <br />
<strong>of</strong> contexts, including in workplace, institutional and on<br />
line settings.<br />
Figure 10: Industry specific assessment resources – overall rating <strong>of</strong> sample<br />
assessment resources<br />
Rating <strong>of</strong> assessment resources<br />
Number <strong>of</strong><br />
resources<br />
1.00 0<br />
1.25 14<br />
1.50 4<br />
1.75 8<br />
2.00 22<br />
2.25 41<br />
2.50 10<br />
2.75 0<br />
3.00 0<br />
Total 99<br />
While the overall picture suggests that the assessment<br />
materials in this category do not rate well in terms <strong>of</strong> validity,<br />
there were examples <strong>of</strong> high quality, up to date materials in<br />
this category. The key examples were the assessment<br />
materials developed by ForestWorks the Industry <strong>Skills</strong><br />
<strong>Council</strong> for the forest and forest products sector, MINTRAC,<br />
the industry advisory group for the meat industry and the<br />
<strong>Skills</strong> First RPL resources developed by the Department <strong>of</strong><br />
Education and Training in Queensland. Each <strong>of</strong> these sets <strong>of</strong><br />
materials scored highly in the overall ranking and particularly<br />
in relation to validity.<br />
The <strong>Skills</strong> First materials are relatively new and in most<br />
cases are based on the latest version <strong>of</strong> the Training<br />
Package. The challenge for these materials will be the<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 30
Department <strong>of</strong> Education and Training’s capacity to maintain<br />
the materials.<br />
The distinguishing feature <strong>of</strong> the materials developed by both<br />
ForestWorks and MINTRAC is the active role that these<br />
organisations have taken in developing and maintaining the<br />
assessment materials. In both cases, the organisations have<br />
produced a range <strong>of</strong> low cost, high quality assessment<br />
materials that:<br />
• Are benchmarked against the relevant standards;<br />
• Use assessment methods that are appropriate for the<br />
industry and the client group;<br />
• Are endorsed by the key industry parties; and<br />
• Are maintained by the host organization.<br />
A further issue that emerged in the evaluation <strong>of</strong> this<br />
category <strong>of</strong> assessment materials is the lack <strong>of</strong> innovation in<br />
assessment materials design. All too <strong>of</strong>ten the assessment<br />
materials, especially those developed for particular units <strong>of</strong><br />
competency, are based on fairly conventional evidence<br />
gathering techniques, such as observation checklists, lists <strong>of</strong><br />
oral questions and third party reports. Further, the materials<br />
<strong>of</strong>ten lack advice on how to make the assessment judgement<br />
or decision once the assessment evidence has been<br />
collected.<br />
Finally, many <strong>of</strong> the assessment resources in this and the<br />
other two categories, have been appraised against the<br />
quality principles for Training Package Support Materials and<br />
carry the national tick. Given that 60% <strong>of</strong> the sample <strong>of</strong> the<br />
materials in this category was assessed as not appearing to<br />
comply with the current version <strong>of</strong> the Training Package and /<br />
or the AQTF, it is questionable whether the existing appraisal<br />
process for assessment-related support materials is<br />
adequate.<br />
In summary, the evaluation <strong>of</strong> the assessment materials in<br />
this category showed that:<br />
1. There is an uneven spread <strong>of</strong> assessment materials<br />
across key the twenty-one industry areas. Some areas,<br />
such as primary industries are particularly well served,<br />
whereas in others, such as property services, there are<br />
very few resources;<br />
2. Many <strong>of</strong> the materials are not based on the current<br />
version <strong>of</strong> the relevant Training Package;<br />
3. There is a lack <strong>of</strong> innovation in training materials design;<br />
4. Many <strong>of</strong> the materials are State or Territory publications.<br />
This limits their accessibility and consideration should be<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 31
given to making them more readily available to a wider<br />
national audience; and<br />
5. In most cases the materials are not supported by a<br />
systematic maintenance process.<br />
5.4 Summary <strong>of</strong> findings <strong>of</strong> the evaluation <strong>of</strong> the<br />
national stock <strong>of</strong> assessment materials<br />
As noted earlier in this report, the national audit <strong>of</strong><br />
assessment materials identified 1,705 items. The evaluation<br />
<strong>of</strong> these materials revealed that:<br />
1. The national stock <strong>of</strong> assessment related resources is<br />
highly dispersed across a range <strong>of</strong> national and State /<br />
Territory agencies. This makes it difficult for users to<br />
locate assessment-related support materials.<br />
2. There is a good range <strong>of</strong> high quality, up to date<br />
materials dealing with the general needs <strong>of</strong> assessors.<br />
3. There is a very limited range <strong>of</strong> up to date, assessment<br />
materials that address the key current and emerging<br />
issues impacting on quality assessment. For example,<br />
the national audit did not identify any materials that<br />
provide assessors with current, high quality advice on:<br />
• Peer, self and negotiated assessment;<br />
• Formative assessment;<br />
• The use <strong>of</strong> simulation;<br />
• <strong>Assessment</strong> moderation; or<br />
• The assessment <strong>of</strong> international students and students<br />
from non-English speaking backgrounds.<br />
4. There is an uneven spread <strong>of</strong> industry-specific<br />
assessment materials across the key industry areas.<br />
Some areas, such as primary industries are particularly<br />
well served, whereas others, such as property services,<br />
have very few industry-specific assessment materials.<br />
The evaluation <strong>of</strong> the sample <strong>of</strong> assessment materials<br />
also revealed that there are significant quality issues<br />
impacting on this category <strong>of</strong> materials. For example,<br />
sixty per cent <strong>of</strong> the assessment materials are not based<br />
on the current version <strong>of</strong> the relevant Training Package.<br />
In addition, there is a lack <strong>of</strong> innovation in assessment<br />
materials design in this category.<br />
5. Many <strong>of</strong> the assessment materials examined in this<br />
project are State or Territory publications. This limits<br />
their accessibility. Consideration should be given to<br />
making them more readily available to a wider national<br />
audience.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 32
6. Most <strong>of</strong> the assessment materials examined in this<br />
project are not supported by a systematic maintenance<br />
process. This means that the national stock <strong>of</strong><br />
assessment materials is at risk <strong>of</strong> becoming obsolete.<br />
7. Many <strong>of</strong> the industry specific assessment materials have<br />
been appraised against the quality principles for Training<br />
Package Support Materials and carry the national tick<br />
even though they:<br />
• Are not supported by a maintenance strategy;<br />
• May not comply with the current version <strong>of</strong> the Training<br />
Package; or<br />
• May not represent innovative assessment materials<br />
design. This suggests that the current approach for<br />
appraising and giving national recognition to assessment<br />
related support materials needs to be reviewed.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 33
6. Strategy to address the key issues<br />
impacting on the national stock <strong>of</strong><br />
assessment support materials<br />
The ensuing section <strong>of</strong> this paper sets out a strategy for<br />
addressing key issues impacting on the national stock <strong>of</strong><br />
assessment support materials. This strategy is designed to:<br />
1. Improve awareness <strong>of</strong> and access to the national stock<br />
<strong>of</strong> assessment materials;<br />
2. Improve the quality, range and availability <strong>of</strong> industry<br />
specific assessment materials; and<br />
3. Provide support materials that address the current and<br />
emerging issues impacting on the quality <strong>of</strong> assessment<br />
practice.<br />
6.1 Improve awareness <strong>of</strong> and access to the<br />
national stock <strong>of</strong> assessment materials<br />
The national audit <strong>of</strong> assessment-related resources showed<br />
that there is a large national stock <strong>of</strong> assessment materials<br />
and that within this there is:<br />
• A significant collection <strong>of</strong> high quality, up to date<br />
materials dealing with the general needs <strong>of</strong> assessors, in<br />
areas such as the assessment processes, recognition <strong>of</strong><br />
prior learning and assessment tool design;<br />
• A limited but nevertheless high quality selection <strong>of</strong><br />
materials dealing with key assessment related issues<br />
such as: assessing in apprenticeship and traineeship<br />
programs, assessing higher order competencies,<br />
assessment quality assurance, assessment validation,<br />
assessment judgement, assessor networks, and<br />
assessing generic / employability skills; and<br />
• A large number <strong>of</strong> materials, especially industry specific<br />
materials, that are out <strong>of</strong> date and do not meet the<br />
requirements <strong>of</strong> the current version <strong>of</strong> the relevant<br />
Training Package and / or Australian <strong>Quality</strong> Training<br />
Framework.<br />
The problem for assessors is that:<br />
• There is no single location where all these materials can<br />
be identified, previewed and accessed;<br />
• It is difficult to establish the currency <strong>of</strong> the materials;<br />
and<br />
• There is limited advice on the quality <strong>of</strong> the materials or<br />
how they may be used.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 34
This makes it very difficult for assessors and other users to<br />
identify, access and use these materials.<br />
There is a pressing need for a national clearinghouse for<br />
assessment-related support materials that provides<br />
assessors and other users with access to a comprehensive<br />
range <strong>of</strong> free and commercial assessment materials. The<br />
clearinghouse should provide:<br />
1. A discovery function that enables assessors to identify<br />
existing high quality assessment materials;<br />
2. A marketing function that promotes existing high<br />
quality assessment materials to potential users;<br />
3. A pr<strong>of</strong>essional development function that informs<br />
assessors about the ways in which the national stock <strong>of</strong><br />
assessment materials may be used and / or customised;<br />
and<br />
4. A maintenance function that monitors assessment<br />
materials held in the clearinghouse and informs<br />
copyright owners about the relevance <strong>of</strong> their materials<br />
and the need for them to be updated or revised.<br />
Specifically the clearinghouse should:<br />
• Enable users to identify and preview the national stock <strong>of</strong><br />
assessment-related support materials, and if required,<br />
obtain copies which are licensed for use via free <strong>of</strong><br />
charge download or immediate electronic purchase and<br />
delivery;<br />
• Actively promote the national stock <strong>of</strong> assessmentrelated<br />
support materials to users including industry,<br />
assessors and RTOs;<br />
• Conduct, in conjunction with the Industry <strong>Skills</strong> <strong>Council</strong>s,<br />
industry organisations and State / Territory VET<br />
agencies, pr<strong>of</strong>essional education programs for<br />
assessors on the national stock <strong>of</strong> assessment-related<br />
support materials;<br />
• Actively engage with the owners <strong>of</strong> materials promoted<br />
through the clearinghouse to ensure that the<br />
assessment-related support materials are maintained or<br />
withdrawn from the clearinghouse;<br />
• Provide assessors and other users with clear information<br />
on the quality <strong>of</strong> the assessment related resource<br />
materials; and<br />
• Provide advice or a referral service for assessors and<br />
other users seeking information on the national stock <strong>of</strong><br />
assessment-related support materials.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 35
This function is highly compatible with the core role <strong>of</strong> TVET<br />
Australia which was initially conceived <strong>of</strong> as a national, one<br />
stop shop for VET products and services. However this type<br />
<strong>of</strong> service could also be facilitated through the <strong>National</strong><br />
Training Information Service or the Education Network<br />
Australia [Edna].<br />
Recommendation 1<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> request TVET Australia to <br />
establish a comprehensive, national clearinghouse for free<br />
and commercial assessment-related support materials that:<br />
• Enables users to identify and preview the national stock<br />
<strong>of</strong> assessment-related support materials, and if required,<br />
obtain copies which are licensed for use via free <strong>of</strong><br />
charge download or immediate electronic purchase and<br />
delivery;<br />
• Actively promotes the national stock <strong>of</strong> assessment-<br />
related support materials to users including industry,<br />
assessors and RTOs;<br />
• Conducts, in conjunction with the Industry <strong>Skills</strong> <strong>Council</strong>s,<br />
industry organisations and State / Territory VET<br />
agencies, pr<strong>of</strong>essional education programs for assessors<br />
on the national stock <strong>of</strong> assessment-related support<br />
materials;<br />
• Actively engages with owners <strong>of</strong> materials promoted <br />
through the clearinghouse to ensure that the<br />
assessment-related support materials are maintained or <br />
withdrawn from the clearinghouse;<br />
• Provides assessors and other users with clear <br />
information on the quality <strong>of</strong> the assessment related<br />
support materials held in the clearinghouse;<br />
• Provides advice or a referral service for assessors and <br />
other users seeking information on the national stock <strong>of</strong><br />
assessment-related support materials.<br />
6.2 Improve the quality, range and availability <strong>of</strong><br />
industry specific assessment materials<br />
The national audit <strong>of</strong> assessment-related resources identified<br />
over seventeen hundred industry specific assessment<br />
resources, including assessment instruments, assessor<br />
guides and candidates materials.<br />
However the evaluation <strong>of</strong> these materials revealed that:<br />
• Many <strong>of</strong> the materials do not comply with the current<br />
version <strong>of</strong> the Training Package;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 36
• The materials are <strong>of</strong>ten developed by State and<br />
Territory agencies and are not well known by assessors<br />
working in other jurisdictions;<br />
• There is a lack <strong>of</strong> good quality assessment materials in<br />
many industry sectors;<br />
• The current national process for quality assuring<br />
assessment-related support materials is inadequate;<br />
• There are no systematic arrangements for the<br />
maintenance <strong>of</strong> these materials; and<br />
• There is a lack <strong>of</strong> innovation in assessment materials<br />
design.<br />
In response to this situation it is recommended that the<br />
<strong>National</strong> <strong>Quality</strong> <strong>Council</strong> take steps to:<br />
1. Develop a quality assurance process for assessmentrelated<br />
support materials for which national endorsement<br />
and inclusion in the proposed national clearinghouse is<br />
sought;<br />
2. Transfer responsibility for the quality assurance <strong>of</strong><br />
assessment-related support materials to the relevant<br />
Industry <strong>Skills</strong> <strong>Council</strong>s;<br />
3. Fund the Industry <strong>Skills</strong> <strong>Council</strong> to undertake the design,<br />
development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />
assessment-related support materials for each endorsed<br />
Training Package in their area <strong>of</strong> coverage and to<br />
actively promote these materials on a national basis, in<br />
collaboration with relevant national and State/ Territory<br />
agencies.<br />
It is envisaged that the Industry <strong>Skills</strong> <strong>Council</strong>s and the<br />
proposed national clearinghouse [see Recommendation 1]<br />
would collaborate to provide an integrated discovery service<br />
for assessment related support materials. Under this<br />
arrangement the Industry <strong>Skills</strong> <strong>Council</strong> would have<br />
responsibility for industry specific materials, whereas the<br />
clearinghouse would focus on promoting cross industry<br />
assessment support materials.<br />
Recommendation 2<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> develop a quality<br />
assurance process for assessment-related support materials<br />
for which national endorsement and inclusion in the proposed<br />
national clearinghouse is sought which:<br />
1. Ensures that nationally recognised assessment-related<br />
support materials comply with the principles <strong>of</strong> validity,<br />
flexibility, usability, equity and accessibility;<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 37
2. Requires developers <strong>of</strong> assessment-related support<br />
materials to engage industry in the design, development<br />
and evaluation <strong>of</strong> the assessment materials;<br />
3. Requires developers to implement an active<br />
maintenance process to ensure the currency and<br />
relevance <strong>of</strong> the assessment materials; and<br />
4. Fosters innovation in assessment materials design.<br />
Recommendation 3<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> transfer responsibility for<br />
the quality assurance <strong>of</strong> assessment-related support<br />
materials, within nationally agreed guidelines as established<br />
through Recommendation 2, to the relevant Industry <strong>Skills</strong><br />
<strong>Council</strong>s.<br />
Recommendation 4<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support the design and<br />
implementation <strong>of</strong> a capability building program to ensure<br />
that Industry <strong>Skills</strong> <strong>Council</strong>s have the capability to manage<br />
the quality assurance <strong>of</strong> assessment-related support<br />
materials.<br />
Recommendation 5<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support each Industry <strong>Skills</strong><br />
<strong>Council</strong> being funded to:<br />
1. Undertake, in conjunction with industry, the design,<br />
development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />
assessment-related support materials for each endorsed<br />
Training Package in their area <strong>of</strong> coverage;<br />
2. Actively promote these exemplar assessment-related<br />
support materials on a national basis in conjunction with<br />
industry and national, State and Territory VET agencies;<br />
and<br />
3. Establish a national pr<strong>of</strong>essional development strategy,<br />
in conjunction with industry and national, State and<br />
Territory VET agencies, to build assessor capability in<br />
the use <strong>of</strong> the exemplar assessment – related support<br />
materials.<br />
6.3 Provide support materials that address the<br />
current and emerging issues impacting on the<br />
quality <strong>of</strong> assessment practice<br />
The national audit <strong>of</strong> assessment related support materials<br />
identified a range <strong>of</strong> key issues impacting on the quality <strong>of</strong><br />
assessment practice. The evaluation <strong>of</strong> the national stock <strong>of</strong><br />
assessment-related support materials showed that:<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 38
• There is a very limited range <strong>of</strong> up to date, assessment<br />
materials that address these issues; and<br />
• There are a number <strong>of</strong> key assessment-related issues<br />
for which there are no suitable, nationally available<br />
support materials. For example, the national audit did not<br />
identify any materials that provide assessors with<br />
current, high quality advice on: peer, self and negotiated<br />
assessment; formative assessment; the use <strong>of</strong><br />
simulation; and the assessment <strong>of</strong> international students<br />
and students from non English speaking backgrounds.<br />
This suggests that there is a need to develop support<br />
materials and assessor capability in relation to:<br />
• The use <strong>of</strong> formative assessment or assessment for<br />
learning approaches to enhance competency<br />
development;<br />
• Improving the quality <strong>of</strong> assessor judgement in the<br />
assessment process;<br />
• Assessing in workplace settings, including identifying<br />
and addressing the skill development needs <strong>of</strong><br />
employees, supervisors, human resource practitioners<br />
and other workplace personnel who are engaged in<br />
providing training and assessment functions, which may<br />
only form part <strong>of</strong> their work role;<br />
• The use <strong>of</strong> peer, self and negotiated assessment to<br />
improve competency development;<br />
• Contextualising nationally recognised assessment<br />
resources for use in enterprise based training and<br />
assessment systems;<br />
• The use <strong>of</strong> simulation in competency based<br />
assessment;<br />
• <strong>Assessment</strong> <strong>of</strong> higher order competencies;<br />
• Assessing in international contexts – assessment <strong>of</strong><br />
international students in Australian and international<br />
settings;<br />
• The integrated assessment <strong>of</strong> skill sets;<br />
• Cost effective approaches to assessment moderation;<br />
• <strong>Assessment</strong> in regulated occupations / industries; and<br />
• Competency based assessment in online learning<br />
environments.<br />
Recommendation 6<br />
That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> sponsor a national<br />
assessment initiative to develop support materials and foster<br />
assessor capability in relation to the key issues impacting on<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 39
the quality <strong>of</strong> assessment practice. Specifically the national<br />
assessment initiative should:<br />
1. Commission an integrated series <strong>of</strong> projects designed to<br />
develop support materials and assessor capability in<br />
relation to:<br />
The use <strong>of</strong> formative assessment or assessment<br />
for learning approaches to enhance competency<br />
development;<br />
Improving the quality <strong>of</strong> assessor judgement in the<br />
assessment process;<br />
Assessing in workplace settings, including<br />
identifying and addressing the skill development<br />
needs <strong>of</strong> employees, supervisors, human resource<br />
practitioners and other workplace personnel who<br />
are engaged in providing training and assessment<br />
functions;<br />
The use <strong>of</strong> peer, self and negotiated assessment<br />
to improve competency development;<br />
Contextualising nationally recognised assessment<br />
resources for use in enterprise based training and<br />
assessment systems;<br />
The use <strong>of</strong> simulation in competency based<br />
assessment;<br />
<strong>Assessment</strong> <strong>of</strong> higher order competencies;<br />
Assessing in international contexts – assessment<br />
<strong>of</strong> international students in Australian and<br />
international settings;<br />
The integrated assessment <strong>of</strong> skill sets;<br />
Cost effective approaches to assessment<br />
moderation;<br />
<strong>Assessment</strong> in regulated occupations / industries;<br />
and<br />
Competency based assessment in online learning<br />
environments.<br />
2. Establish a national implementation program, in<br />
conjunction with the Industry <strong>Skills</strong> <strong>Council</strong>s and national,<br />
State and Territory VET agencies, to ensure that all<br />
assessors in private, public and enterprise providers are<br />
provided with training and / or information on:<br />
• The issues addressed in the materials and<br />
• How to effectively use the materials with different VET<br />
clients and in varying VET contexts.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 40
Appendix 1 – Participants in consultations<br />
Name<br />
Mary Hicks<br />
Michelle Bissett<br />
Megan Lilly<br />
David Magee<br />
Organisation<br />
Australian Chamber <strong>of</strong> Commerce and<br />
Industry<br />
Australian <strong>Council</strong> <strong>of</strong> Trade Unions<br />
Australian Industry Group<br />
Construction and Property Services<br />
Industry <strong>Skills</strong> <strong>Council</strong><br />
Peter Skippington Department <strong>of</strong> Education and Training –<br />
Queensland<br />
Brenda Micale Department <strong>of</strong> Education and Training –<br />
Western Australia<br />
Elizabeth Owers<br />
Margaret Thornton<br />
Department <strong>of</strong> Further Education,<br />
Employment, Science and Technology –<br />
South Australia.<br />
Department <strong>of</strong> Further Education,<br />
Employment, Science and Technology –<br />
South Australia.<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2<br />
41
Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
<strong>Assessment</strong> process<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide1 -<br />
Training Package assessment materials kit<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Learner guide TAA Training Package Support Materials : Contribute to<br />
Print 2008 IBSA<br />
assessment TAASS301B<br />
www.ibsa.org.au<br />
Learner guide TAA Training Package Support Materials : Plan and organize Print 2005 IBSA<br />
assessment TAAASS401A<br />
www.ibsa.org.au<br />
Learner guide TAA Training Package Support Materials : Assess<br />
Print 2005 IBSA<br />
competence TAASS402A<br />
www.ibsa.org.au<br />
Learner guide Shea series : TAAASS301B Contribute to assessment Print 2008 TVET Australia<br />
www.atpl.net.au<br />
Learner guide Shea series : TAAASS401C Plan and organise assessment Print 2008 TVET Australia<br />
www.atpl.net.au<br />
Learner guide Shea series : TAAASS402C Assess competence Print 2008 TVET Australia<br />
www.atpl.net.au<br />
Reference Guidelines for assessing competence in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Reference Troubleshooting guide – <strong>Assessment</strong> in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Toolbox Training and <strong>Assessment</strong> Toolbox 607 v 2 Toolbox 2007 TVET Australia<br />
www.atpl.net.au<br />
Video <strong>Assessment</strong> case study video – Stone masonry Video on 2008 Department <strong>of</strong> Education, Training and the Arts<br />
line<br />
http://www.vetpd.qld.gov.au/teaching-learning-and-<br />
Video <strong>Assessment</strong> case study video - Aquaculture Video on<br />
line<br />
<strong>Assessment</strong> system management<br />
Learner guide<br />
Learner guide<br />
Learner guide<br />
TAA Training Package Support Materials : Lead and<br />
coordinate assessment systems and services<br />
TAA Training Package Support Materials : Develop training<br />
and or assessment organizational policies and procedures<br />
TAA Training Package Support Materials : Lead and conduct<br />
training , assessment evaluations<br />
assessment/resources/case-study/index.html<br />
2008 Department <strong>of</strong> Education, Training and the Arts<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/case-study/index.html<br />
Print 2009 IBSA<br />
www.ibsa.org.au<br />
Print 2009 IBSA<br />
www.ibsa.org.au<br />
Print 2009 IBSA<br />
www.ibsa.org.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2 1 1 1 1.25<br />
1 1 1 1 1.00<br />
2 1 1 1 1.25<br />
2 1 1 1 1.25<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
2 2 2 2 2.00<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
1 1 1 1 1.00<br />
1 1 1 1 1.00<br />
1 1 1 1 1.00<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 42
Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />
<strong>Assessment</strong> materials<br />
RATING<br />
Type <strong>of</strong> resource Title Format Year Source<br />
<strong>Assessment</strong> tool design<br />
Exemplars and<br />
templates<br />
<strong>Assessment</strong> templates and exemplars:<br />
<strong>Assessment</strong> Plan Template<br />
<strong>Assessment</strong> Task Template<br />
Questions Single Unit<br />
Questions Cluster <strong>of</strong> Units<br />
Observations Single Unit<br />
Observations Cluster <strong>of</strong> Units<br />
Assignment Cover Sheet<br />
<strong>Assessment</strong> Record Individual Student Template<br />
Student Feedback Form<br />
<strong>Assessment</strong> Plan Exemplar<br />
<strong>Assessment</strong> Task Exemplar<br />
Oral Questioning Single Unit Exemplar<br />
Written Questions Single Unit Exemplar<br />
Marking Guide Written Questions Single Unit Exemplar<br />
Written Questions Cluster Unit Exemplar<br />
Observation/Demonstration Single Unit Exemplar<br />
<strong>Assessment</strong> Record Individual Student Exemplar<br />
TAA Training Package Support Materials : Develop<br />
assessment tools TAAASS403A<br />
Print 2009 Charles Darwin University<br />
www.cdu.edu.au/aqpvet/vetresources.html#Assess<br />
mentandrecognition<br />
Learner guide<br />
Print 2005 IBSA<br />
www.ibsa.org.au<br />
Learner guide Shea series : TAAASS403B Develop assessment tools Print 2008 TVET Australia<br />
www.atpl.net.au<br />
Reference Designing assessment tools for quality outcomes in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Validity Accessibility Usability Flexibility Aggregate<br />
1 2 1 1 1.25<br />
2 1 1 1 1.25<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 43
Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />
<strong>Assessment</strong> materials<br />
RATING<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Assessor skills<br />
Presentation<br />
RPL<br />
Effective Questioning Techniques and Training Package<br />
Overview for <strong>Skills</strong> Stores -<br />
Brian Spencer presentation<br />
Resume Example 1<br />
Resume Example 2.<br />
Resume Example 3<br />
On line 2008 TAFE Development centre – Victoria<br />
http://www.tafecentre.vic.edu.au/RPL.php<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2 2 1 1 1.50<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide3 - Print 2001 TVET Australia<br />
2 1 1 1 1.25<br />
Recognition resource<br />
www.atpl.net.au<br />
Conference<br />
Recognition <strong>of</strong> Prior Learning – Recognition <strong>of</strong> Progress Print 2008 http://www.icvet.tafensw.edu.au/focus/documents/r 2 2 1 1 1.50<br />
proceedings<br />
pl-making-connections-forum-report.pdf<br />
Manual RPL resource kit On line 2008 TAFE Development Centre – Victoria<br />
2 2 1 1 1.50<br />
http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />
hp<br />
Manual<br />
Recognition <strong>of</strong> prior learning resources:<br />
Print 2008 NSW Department <strong>of</strong> Education and Training / 1 2 2 2 1.25<br />
The RTO Guide<br />
The Candidate Guide<br />
The Assessor Guide<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au/rpl-resources.html<br />
Online RPL Online Network Online 2007 http://rplnetworkonline.wikispaces.com/ 2 2 1 1 1.50<br />
Reference<br />
Recognition <strong>of</strong> Prior Learning: An <strong>Assessment</strong> Resource for<br />
VET Practitioners<br />
network<br />
Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
1 2 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 44
Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />
<strong>Assessment</strong> materials<br />
RATING<br />
Type <strong>of</strong> resource Title Format Year Source<br />
RPL [continued]<br />
Reference<br />
RPL Fact Sheets<br />
RPL Fact Sheet 1 - Coaches and Mentors<br />
RPL Fact Sheet 2 - What is RPLRPL Fact Sheet 3A - RPL<br />
Mythbusters<br />
RPL Fact Sheet 3B - Mythbusters for VET Providers<br />
RPL Fact Sheet 4 - The Individual<br />
RPL Fact Sheet 5 - The Assessor<br />
RPL Fact Sheet 6 - The Enterprise<br />
RPL Fact sheet 7 - The VET Provider<br />
RPL Fact Sheet 8 - Resources<br />
Print 2008 Department <strong>of</strong> Further Education, Employment,<br />
Science and Technology<br />
http://www.training.sa.gov.au/OVETorgs/pages/def<br />
ault/rpl/<br />
Reference Recognition <strong>of</strong> prior learning – your first step Print 2004 Department <strong>of</strong> Education, Training and the Arts and<br />
Department <strong>of</strong> Education, Science and Training<br />
http://www.training.sa.gov.au/OVETorgs/files/links/r<br />
pl-pdfresource.pdf<br />
www.resourcegenerator.gov.au<br />
Reference<br />
Reference<br />
<strong>Skills</strong> Recognition Information Guides<br />
Assessor Guide to RPL<br />
Have Your <strong>Skills</strong> Recognised: Candidate Guide<br />
Recognition <strong>of</strong> Prior Learning: Resource Catalogue<br />
Recognition <strong>of</strong> prior learning materials:<br />
RPL Book (.doc) (Record <strong>of</strong> Evidence)<br />
RPL Staff Guide (.doc)<br />
Guide for Applicants Template(.doc)<br />
Guide for Applicants Exemplar (.doc)<br />
RPL Book Exemplar (.doc)<br />
Mapping Principles Guidelines and Pr<strong>of</strong>orma (.doc) - CDU<br />
HE units to VET units<br />
Print 2008 www.skillsonline.net.au/iesprplresources/rplassessor.pdf<br />
Print 2009 Charles Darwin University<br />
www.cdu.edu.au/aqpvet/vetresources.html#Assess<br />
mentandrecognition<br />
Research report RPL - Done Well in VET Print 2006 Reframing the Future<br />
www.reframingthefuture.net/docs/2007/Publications<br />
/3EVP-RPL-Done-Well-1mar07.pdf<br />
Research report<br />
Research report<br />
Valuing recognition <strong>of</strong> prior learning: Selected case studies <strong>of</strong><br />
Australian private providers <strong>of</strong> training<br />
Recognition <strong>of</strong> prior learning in the vocational education and<br />
training sector<br />
Print 2004 NCVER<br />
http://www.ncver.edu.au/publications/1473.html<br />
Print 2003 NCVER<br />
http://www.ncver.edu.au/research/commercial/op28<br />
7.pdf<br />
Validity Accessibility Usability Flexibility Aggregate<br />
1 2 1 1 1.25<br />
2 2 1 1 1.50<br />
1 2 1 1 1.25<br />
2 2 1 1 1.50<br />
2 2 1 1 1.50<br />
2 2 1 1 1.50<br />
2 2 1 1 1.50<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 45
Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />
<strong>Assessment</strong> materials<br />
RATING<br />
Type <strong>of</strong> resource Title Format Year Source<br />
RPL [continued]<br />
Self evaluation<br />
tool<br />
Self evaluation tool<br />
Online<br />
self<br />
assess<br />
ment<br />
tool<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2008 http://www.skillsrecognition.nsw.gov.au/ 1 2 1 1 1.25<br />
Toolbox The Training and <strong>Assessment</strong> RPL Guide Toolbox 2005 TVET Australia 2 2 1 1 1.50<br />
Video Recognition <strong>of</strong> Prior Learning - Promotional Movie Video 2008 TAFE SA Production House<br />
1 2 1 1 1.25<br />
www.icvet.tafensw.edu.au/resources/rpl-video.htm<br />
Video RPL: Can we do it better? - trades event - 18 July 2008 On line 2008 TAFE Development Centre – Victoria<br />
http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />
hp<br />
2 2 1 1 1.50<br />
Presentation RPL best practice - An auditor’s perspective On line 2008 TAFE Development Centre – Victoria<br />
http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />
hp<br />
Presentation<br />
Exemplars and<br />
templates<br />
RPL Overview for Administrators<br />
RPL Introduction slides presentation<br />
<strong>Skills</strong> Store presentation<br />
RPL Overview presentation<br />
On line 2008 TAFE Development Centre – Victoria<br />
http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />
hp<br />
RPL assessor kit template Print 2009 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
2 2 1 1 1.50<br />
2 2 1 1 1.50<br />
1 2 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 46
Appendix 3- Rating <strong>of</strong> assessment materials that address specific assessment related issues<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Apprenticeships and traineeship and assessment<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide 5 -<br />
Candidate's Kit: Guide to assessment in New Apprenticeships<br />
Learner guide TAA Training Package Support Materials : Coordinate training<br />
and / or assessment arrangements for apprentice /<br />
traineeships<br />
Reference<br />
Apprenticeships and traineeships – good practice guide for<br />
Registered Training Organisations<br />
AQTF<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
Print 2001 TVET Australia<br />
2 1 1 1 1.25<br />
www.atpl.net.au<br />
Print 2009 IBSA<br />
www.ibsa.org.au 1 1 1 1 1.00<br />
Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Reference The AQTF at Work Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Assessing generic / employability skills<br />
Assessor guide Working Well: Developing Employability <strong>Skills</strong> - Assessor Print 2006 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
DVD Working Well: Employability <strong>Skills</strong> in Action - DVD DVD 2008 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Assessing higher order competencies<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide2 -<br />
Assessing competencies in higher qualifications<br />
<strong>Assessment</strong> judgement<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Research report Maximising confidence in assessment decision-making:<br />
Current approaches and future strategies<br />
Print 2004 NCVER<br />
http://www.ncver.edu.au/research/proj/nr9029-2.pdf<br />
Research report Confident RPL assessors – compliance to creativity Print 2008 Department <strong>of</strong> Education, Training and the Arts<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/tla-research.html<br />
Reference Pr<strong>of</strong>essional judgment in VET Print 2006 Reframing the Future<br />
www.reframingthefuture.net<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
2 2 1 1 1.50<br />
2 2 1 1 1.50<br />
2 1 1 1 1.25<br />
2 1 1 1 1.25<br />
1 2 1 1 1.25<br />
2 1 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 47
Appendix 3- Rating <strong>of</strong> assessment materials that address specific assessment related issues [continued]<br />
<strong>Assessment</strong> materials<br />
RATING<br />
Type <strong>of</strong> resource Title Format Year Source<br />
<strong>Assessment</strong> partnerships<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide7 -<br />
<strong>Assessment</strong> using partnership arrangements<br />
<strong>Assessment</strong> quality assurance<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide8 -<br />
Strategies for ensuring consistency in assessment<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide10 -<br />
<strong>Quality</strong> assurance guide for assessment<br />
<strong>Assessment</strong> validation<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Learner Guide TAA Training Package Support Materials: Participate in<br />
assessment validation TAAASS404A<br />
Print 2005 IBSA<br />
www.ibsa.org.au<br />
Learner guide Shea series : TAAASS404B Participate in assessment<br />
Print 2008 TVET Australia<br />
validation<br />
www.atpl.net.au<br />
Reference A guide to continuous improvement <strong>of</strong> assessment in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Assessor networks<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide9 -<br />
Networking for assessors<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Reference Assessor Networks in Action Print 2004 Reframing the Future<br />
www.reframingthefuture.net<br />
Assessor training<br />
Assessor manual<br />
E learning / assessment<br />
Training Package <strong>Assessment</strong> Materials Project: Guide4 - Kit<br />
to support assessor training<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Toolbox Training and <strong>Assessment</strong> E-learning Electives Toolbox 808 v2 Toolbox 2007 TVET Australia<br />
www.atpl.net.au<br />
Reasonable adjustment<br />
Reference<br />
Reasonable adjustment : A practical guide to reasonable<br />
adjustment in assessment <strong>of</strong> candidates with disability in VET<br />
Print 2008 Western Australian Department <strong>of</strong> Education and<br />
Training<br />
http://vetinfonet.det.wa.edu.au/progDev/resources<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2 1 1 1 1.25<br />
2 1 1 1 1.25<br />
2 1 1 1 1.25<br />
1 1 1 1 1.00<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
2 1 1 1 1.25<br />
2 1 1 1 1.25<br />
2 1 1 1 1.25<br />
2 2 1 1 1.50<br />
1 2 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 48
Appendix 3- Rating <strong>of</strong> assessment materials that address specific assessment related issues [continued]<br />
<strong>Assessment</strong> materials<br />
RATING<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Workplace assessment<br />
Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide 6 -<br />
<strong>Assessment</strong> approaches for small workplaces<br />
Print 2001 TVET Australia<br />
www.atpl.net.au<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2 1 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 49
Appendix 4- Rating <strong>of</strong> industry specific assessment materials<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Arts and Entertainment<br />
<strong>Assessment</strong><br />
Instrument<br />
<strong>Assessment</strong><br />
instrument<br />
Assessor guide<br />
<strong>Skills</strong>Online – <strong>Assessment</strong> Instruments<br />
CUEAUD1A Repair and maintain audiovisual equipment -<br />
<strong>Assessment</strong> Instruments<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
CUF01-<strong>Assessment</strong> for Radio qualifications (Assessors) -<br />
TPI03<br />
CUF01-<strong>Assessment</strong> for Radio qualifications (Candidates) -<br />
TPI03<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate IV in Entertainment - Assessor Guide<br />
Assessor kit <strong>Skills</strong> First RPL Assessor Kit – Arts and Entertainment –<br />
Certificate III in Printing and Graphic Arts (Printing)<br />
Assessor resource<br />
Automotive<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong> /<br />
recognition process<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
<strong>Assessment</strong> Resource Pack - Supporting CUS20101<br />
Certificate II in Music Industry (Foundation)<br />
Automotive Training Australia Workplace <strong>Assessment</strong><br />
Checklists<br />
Certificate II in Automotive (Aftermarket - Retail<br />
Operations)<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
AUR05-<strong>Assessment</strong> practices workshop powerpoint-TPI01<br />
VETASSESS on line automotive assessment tools [test banks,<br />
third party reports, evidence guide and observation checklist]<br />
AUR01166A Repair engines and associated engine<br />
components<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate II in Recreational Vehicles and Accessories<br />
Retailing - Assessor Guide<br />
Print 2001 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2004 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print 2001 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print 2002 TVET Australia<br />
www.atpl.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
2 2 2 1 1.75<br />
3 2 2 2 2.25<br />
Print NA Automotive Training Australia 1 2 2 2 1.75<br />
Power<br />
point<br />
Print /<br />
online<br />
2006 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
NA VETASSESS<br />
www.assessit.net<br />
Print 2004 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
2 2 2 2 2.00<br />
3 3 2 2 2.50<br />
3 2 2 2 2.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 50
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Business<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
Assessor<br />
Instruments<br />
Assessor kit<br />
Westone – <strong>Assessment</strong> instruments<br />
NILAC – Certificate III workplace assessment – portfolio<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
BSB01-Business Management & Human Resources<br />
Validated <strong>Assessment</strong> Tools-TPI06<br />
VETASSESS on line business assessment tools [test banks,<br />
third party reports, evidence guide and observation checklist]<br />
[continued]<br />
BSBADM307A Organise schedules<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate II in Caravan Park Operations - Assessor Guide<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
BSXFMI404A Participate, lead and facilitate work teams<br />
(<strong>Assessment</strong> Instruments)<br />
<strong>Skills</strong> First RPL Assessor Kit – Business<br />
Certificate III in Asset Maintenance (Cleaning Operations)<br />
Print NA Westone<br />
http://wpc.westone.wa.gov.au/<br />
Print 2006 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print /<br />
online<br />
NA<br />
VETASSESS<br />
www.assessit.net<br />
Print 2004 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2004 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
RPL Kit RPL EEEEZY Business Administration Cert IV Print 2004 Resources Generator<br />
http://www.resourcegenerator.gov.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2 2 2 2 2.00<br />
3 2 3 2 2.50<br />
3 3 2 2 2.50<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
1 2 1 1 1.25<br />
3 1 2 2 2.00<br />
Communications<br />
Assessor guide<br />
Assessor kit<br />
Certificate III in Information Technology ICA30199<br />
(S<strong>of</strong>tware Applications) - <strong>Assessment</strong> Guide<br />
<strong>Skills</strong> First RPL Assessor Kit – Communications<br />
Certificate II in Information Technology<br />
Print 1999 TVET Australia<br />
www.atpl.net.au<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
3 1 2 2 2.00<br />
1 2 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 51
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Community Services<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />
Certificate II & III in Community Services (Aged Care<br />
Work) - <strong>Assessment</strong> Packages<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
CHCCS303A Provide physical assistance with medication<br />
Print 2005 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
2 2 3 2 2.25<br />
Assessor guide<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate II & III in Community Services (Aged Care<br />
Work) - <strong>Assessment</strong> Guide<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
3 2 2 2 2.25<br />
Assessor kit<br />
<strong>Skills</strong> First RPL Assessor Kit – Community Services<br />
Advanced Diploma <strong>of</strong> Children's Services<br />
Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Assessor resource Disability Work - <strong>Assessment</strong> Kit (CHC20599) Print NA TVET Australia<br />
www.atpl.net.au<br />
Construction<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
BCF30200 - Sample joinery apprentice assessment<br />
recording tool (on site assessment) TPI03<br />
Print 2006 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
1 2 1 1 1.25<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor kit<br />
VETASSESS on line construction assessment tools [test<br />
banks, third party reports, evidence guide and observation<br />
checklist]<br />
BCG1000A Carry out interactive workplace communication<br />
<strong>Skills</strong> First RPL Assessor Kit – Construction<br />
Certificate III in Bricklaying/Blocklaying<br />
Print /<br />
online<br />
NA<br />
VETASSESS<br />
www.assessit.net<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
3 3 2 2 2.50<br />
2 2 1 1 1.50<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 52
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Engineering<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
Assessor kit<br />
<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />
Certificate II in Engineering Production - <strong>Assessment</strong><br />
Instrument<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
21622VIC-Delivery and assessment strategies for the<br />
Diploma, Advanced Diploma <strong>of</strong> Engineering Technology-<br />
TPI06 248<br />
EE-OZ Training and assessment manual – ESI –<br />
Transmission and distribution<br />
VETASSESS on line engineering assessment tools [test<br />
banks, third party reports, evidence guide and observation<br />
checklist]<br />
MEM11.11AA Manual handling<br />
<strong>Skills</strong>Online – Assessor Guide<br />
<strong>Assessment</strong> Manual for Certificate II - Lift Industry<br />
<strong>Skills</strong> First RPL Assessor Kit – Engineering<br />
Certificate III in Engineering – Mechanical Trade<br />
Print 1999 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2006 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print NA EE-OZ Training <strong>Standards</strong><br />
www.ee-oz.org.au<br />
Print / NA VETASSESS<br />
online<br />
www.assessit.net<br />
Print NA NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Assessor resource Electrotechnology Trainer/Assessor Guide Print 2002 TVET Australia<br />
www.atpl.net.au<br />
Food processing<br />
<strong>Assessment</strong><br />
instrument<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor<br />
Instrument<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
FDF03-Developing Workplace <strong>Assessment</strong> Tools -TPI04<br />
Training and assessment support materials for MTM07<br />
Certificate II in Meat Processing (Abattoirs)<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
Certificate IV in Meat Processing (Leadership) -<br />
<strong>Assessment</strong> Instrument<br />
Print 2004 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
CDRO 2007 Mintrac<br />
M<br />
www.mintrac.com.au/<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
2 2 2 2 2.00<br />
3 2 2 2 2.25<br />
3 3 2 2 2.50<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
2 2 2 2 2.00<br />
1 2 1 1 1.25<br />
3 2 2 2 2.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 53
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Assessor kit <strong>Skills</strong> First RPL Assessor Kit – Food processing<br />
Certificate I in Meat Processing (Meat Retailing)<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
RPL Kit RPL EEEEZY Food Processing Print 2005 Resources Generator<br />
http://www.resourcegenerator.gov.au<br />
Forest and forest products<br />
<strong>Assessment</strong><br />
Instruments<br />
<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />
Certificate II in Forest and Forest Products - <strong>Assessment</strong><br />
Instruments<br />
Print 2004 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
1 2 1 1 1.25<br />
3 1 2 2 2.00<br />
3 2 2 2 2.25<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
FPI99-MNQOP21A Conduct front end loader operations-<br />
TPI05<br />
Forest Industry <strong>Assessment</strong> Plan System (FIAPS) –<br />
subscriber based assessment service that provides:<br />
a national support network <strong>of</strong> forest industry trainers and<br />
assessors<br />
comprehensive assessment materials for all units <strong>of</strong><br />
competency in FPI05, provided in Word format for easy<br />
customisation<br />
active input into the continuous improvement <strong>of</strong> the<br />
assessment tools<br />
moderation workshops for assessors conducted on<br />
request in regional locations<br />
an annual national conference<br />
a quarterly newsletter<br />
participation in committees to review the Training Package<br />
and to help develop support resources.<br />
a standard template for each unit that requires three types<br />
<strong>of</strong> evidence: observation checklist, question bank and<br />
other supplementary evidence (3 rd party, samples <strong>of</strong><br />
product, portfolio, logbook, etc)<br />
assessment tools that are continuously updated via<br />
feedback from users and national workshops. Current<br />
membership <strong>of</strong> FIAPS represents about 85% <strong>of</strong> RTOs<br />
delivering to the industry.<br />
Print 2005 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print<br />
and<br />
electro<br />
nic<br />
2009 Forestworks<br />
www.forestworks.com.au<br />
2 2 2 2 2.00<br />
1 2 1 1 1.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 54
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Furnishing<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
Assessor kit<br />
General education and training<br />
Assessor<br />
Instrument<br />
Assessor kit<br />
General manufacturing<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor Guide<br />
Westone – <strong>Assessment</strong> instruments<br />
Certificate III In Floor Covering And Finishing -<br />
<strong>Assessment</strong> Tool (LMF30102)<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
LMFFM3020A Set up, operate and maintain sawing machines<br />
<strong>Assessment</strong> tool<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate II and III in Mattress and Base Making (7<br />
Mandatory/Specialist Units) - Assessor Guide<br />
<strong>Skills</strong> First RPL Assessor Kit – Furnishing<br />
Certificate III in Glass and Glazing<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
BSZ401A, BSZ402A, BSZ403A Plan, conduct & review<br />
assessment - <strong>Assessment</strong> Instruments<br />
<strong>Skills</strong> First RPL Assessor Kit – General education and training<br />
Certificate IV in Training and <strong>Assessment</strong><br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
PMB01-Delivery and assessment strategy templates to<br />
support quality training and assessment for process<br />
manufacturing industry employees<br />
Assessor Guide for the Manufactured Mineral Products<br />
Training Package PMC99 (includes floppy disk)<br />
Print NA Westone<br />
http://wpc.westone.wa.gov.au/<br />
Print 2006 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print 2007 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print 2001 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print 2005 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print 1999 TVET Australia<br />
www.atpl.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
2 2 1 1 1.50<br />
3 2 2 2 2.25<br />
1 2 1 1 1.25<br />
3 2 2 2 2.25<br />
1 2 1 1 1.25<br />
2 2 3 2 2.25<br />
3 2 2 2 2.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 55
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Government<br />
Assessor guide<br />
Assessor kit<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Diploma <strong>of</strong> Local Government (Environmental Health and<br />
Building <strong>Assessment</strong>) - <strong>Assessment</strong> Guide<br />
<strong>Skills</strong> First RPL Assessor Kit – Government<br />
Certificate III in Government<br />
Print 2008 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print NA TVET Australia<br />
Assessor resource Unit PUAEQU001A Prepare, maintain and test response<br />
equipment<br />
www.atpl.net.au<br />
RPL Kit RPL EEEEZY Government Cert III Print 2005 Resources Generator<br />
http://www.resourcegenerator.gov.au<br />
Health<br />
Assessor kit<br />
Horse<br />
<strong>Assessment</strong><br />
instruments<br />
Hospitality<br />
Assessor kit<br />
Assessor guide<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Skills</strong> First RPL Assessor Kit – Health<br />
Certificate III in Health Service Assistance (Allied Health<br />
Assistance)<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
RGRH206A – RPL – Apply occupational health and safety<br />
in horse codes<br />
<strong>Skills</strong> First RPL Assessor Kit – Hospitality<br />
Certificate III in Hospitality (Commercial Cookery)<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Working Well: Developing Employability <strong>Skills</strong> in the<br />
Hospitality Industry - Assessor Guide<br />
VETASSESS on line hospitality assessment tools [test banks,<br />
third party reports, evidence guide and observation checklist]<br />
[continued]<br />
THHBFB00B Clean and tidy bar areas<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print 2004 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print 2006 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print /<br />
online<br />
NA<br />
VETASSESS<br />
www.assessit.net<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
1 2 1 1 1.25<br />
1 2 1 1 1.25<br />
3 2 2 2 2.25<br />
3 1 2 2 2.00<br />
3 2 1 1 1.75<br />
3 2 3 2 2.50<br />
3 2 1 1 1.75<br />
2 2 2 2 2.00<br />
3 3 2 2 2.50<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 56
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Laboratory Operations<br />
<strong>Assessment</strong><br />
guide<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor kit<br />
Assessor<br />
manual<br />
Mining<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
Pharmaceuticals<br />
<strong>Assessment</strong><br />
instruments<br />
Manufacturing <strong>Skills</strong> Australia assessment guides for eleven<br />
units <strong>of</strong> competency in the PML04 Laboratory Operations<br />
Training Package:<br />
PMLMAIN400A – Maintain and control stocks<br />
Recognition and assessment kit for calibration technicians<br />
<strong>Skills</strong> First RPL Assessor Kit – Laboratory Operations<br />
Certificate IV in Laboratory Techniques<br />
PML04 <strong>Assessment</strong> Solutions<br />
<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />
Module MNMUGC443A Refuel Vehicles/Machines<br />
Underground - <strong>Assessment</strong> Instrument<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Adapting the assessment tools in underground and open cut<br />
Mining - assessor guide<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
Pharmaceutical Manufacturing: FDFCORBM2A Use Basic<br />
Mathematical Concepts - <strong>Assessment</strong> Guide<br />
Print<br />
and CD<br />
ROM<br />
Print<br />
and CD<br />
ROM<br />
NA<br />
NA<br />
Manufacturing <strong>Skills</strong> Australia<br />
www.mskills.com.au<br />
Manufacturing <strong>Skills</strong> Australia<br />
www.mskills.com.au<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Print<br />
and CD<br />
ROM<br />
2000 Manufacturing <strong>Skills</strong> Australia<br />
www.mskills.com.au<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2006 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
1 1 1 2 1.25<br />
1 1 2 2 1.50<br />
2 2 1 1 1.50<br />
2 1 1 1 1.25<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
2 2 2 2 2.00<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 57
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Primary Industries<br />
<strong>Assessment</strong><br />
Instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor kit<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
Module FDFBPBFPB Operate the Bottle Filling Process -<br />
<strong>Assessment</strong> Instrument<br />
Westone – <strong>Assessment</strong> instruments<br />
Certificate III Conservation And Land Management -<br />
<strong>Assessment</strong> Tool<br />
SmartMedia TAFE SA – <strong>Assessment</strong> instruments<br />
(RTC2301A) Undertake operational maintenance <strong>of</strong><br />
machinery<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
RTC2702A Observe environmental practices<br />
VETASSESS on line horticulture assessment tools [test banks,<br />
third party reports, evidence guide and observation checklist]<br />
[continued]<br />
RTC3016A Provide information on plants and their culture<br />
<strong>Skills</strong> First RPL Assessor Kit – Primary Industry<br />
Certificate III in Horticulture [Turf]<br />
Print 2001 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print NA Westone<br />
http://wpc.westone.wa.gov.au/<br />
Print NA SmartMedia TAFE SA<br />
http://wpc.westone.wa.gov.au/<br />
Print 2006 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print / NA VETASSESS<br />
online<br />
www.assessit.net<br />
Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
RPL Kit RPL EEEEZY Horticulture Print 2005 Resources Generator<br />
http://www.resourcegenerator.gov.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
2 2 2 2 2.00<br />
2 2 2 2 2.00<br />
2 2 2 2 2.00<br />
1 3 2 2 2.00<br />
1 2 1 1 1.25<br />
3 1 2 2 2.00<br />
Property Services<br />
<strong>Assessment</strong> &<br />
training kit<br />
<strong>Assessment</strong> & Training Kit to support the Asset Security<br />
Training Package PRS98 - Access Security stream<br />
Print 1999 TVET Australia<br />
www.atpl.net.au<br />
3 2 2 2 2.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 58
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Retail, Wholesale and Personal Services<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
Westone – <strong>Assessment</strong> instruments<br />
Certificate III In Hairdressing - <strong>Assessment</strong> Tool<br />
VETASSESS on line retail assessment tools [test banks, third<br />
party reports, evidence guide and observation checklist]<br />
WRRCA1B Operate retail equipment<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />
Print NA Westone<br />
http://wpc.westone.wa.gov.au/<br />
Print /<br />
online<br />
NA<br />
VETASSESS<br />
www.assessit.net<br />
Print 2002 <strong>Skills</strong> Victoria<br />
WRR02-Retail learning and assessment plans-TPI03<br />
http://trainingsupport.otte.vic.gov.au<br />
Certificate III in Hairdressing CD NA Westone Services – Department <strong>of</strong> Education and<br />
Training<br />
www.westone.wa.gov.au<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Print NA NSW Department <strong>of</strong> Education and Training<br />
Guide to Planning <strong>Assessment</strong> in Certificates II and III in<br />
<strong>Skills</strong>Online<br />
Retail Operations - Assessor Guide<br />
https://www.skillsonline.net.au<br />
Assessor guide Assessor Guide: WRP20102 Certificate II in Community<br />
Pharmacy<br />
Print NA Services <strong>Skills</strong> Industry <strong>Skills</strong> <strong>Council</strong><br />
www.serviceskills.com.au<br />
Assessor guide Certificate III in Hairdressing <strong>Assessment</strong> Tool Print NA Services <strong>Skills</strong> Industry <strong>Skills</strong> <strong>Council</strong><br />
www.serviceskills.com.au<br />
Assessor kit <strong>Skills</strong> First RPL Assessor Kit – Retail<br />
Certificate III in Retail<br />
Print 2009 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
Assessor<br />
resource<br />
Retail Recognition Kit<br />
CDRO<br />
M<br />
2002 TVET Australia<br />
www.atpl.net.au<br />
RPL Kit RPL EEEEZY Hairdressing Print 2005 Resources Generator<br />
http://www.resourcegenerator.gov.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
2 2 2 2 2.00<br />
3 3 2 2 2.50<br />
3 2 2 2 2.25<br />
2 2 2 2 2.00<br />
3 2 2 2 2.25<br />
3 1 2 2 2.00<br />
3 1 2 2 2.00<br />
1 2 1 1 1.25<br />
3 2 2 2 2.25<br />
3 1 2 2 2.00<br />
Sport and Recreation<br />
Assessor kit<br />
Assessor kit<br />
<strong>Skills</strong> First RPL Assessor Kit – Sport and Recreation<br />
Certificate III in Meetings and Events<br />
Sport & Recreation Industry Training Packages - Noted Support<br />
MaterialsV20<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
CDRO<br />
M<br />
NA<br />
TVET Australia<br />
www.atpl.net.au<br />
3 2 1 1 1.75<br />
3 2 2 2 2.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 59
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Tourism<br />
<strong>Assessment</strong><br />
Instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor guide<br />
Assessor<br />
resource<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
Certificate IV in Tourism (Guiding) - <strong>Assessment</strong> Instrument<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
THH02-Hospitality RPL-RCC Project - THH42602 Cert IV in<br />
Hospitality (Supervision)-TPI03<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate IV in Tourism (Guiding)<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print 2003 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
THHGLE06A Monitor Staff Performance Print NA TVET Australia<br />
www.atpl.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
1 2 2 2 1.75<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
Transport and Distribution<br />
<strong>Assessment</strong><br />
Instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
<strong>Assessment</strong><br />
instruments<br />
Assessor kit<br />
<strong>Skills</strong>Online – Assessor Instrument<br />
Diploma <strong>of</strong> Logistics Management - <strong>Assessment</strong> Kit<br />
Westone – <strong>Assessment</strong> instruments<br />
Operate and maintain internal combustion engines engineer<br />
class 3<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
TDM01-<strong>Assessment</strong> Guide for the Maritime Operations<br />
Training Package Certificates I and III-TPI04<br />
VETASSESS on line transport assessment tools [test banks, third<br />
party reports, evidence guide and observation checklist]<br />
TDTA1597B Complete receival/despatch documentation<br />
Print 2006 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
Print NA Westone<br />
http://wpc.westone.wa.gov.au/<br />
Print 2003 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print /<br />
online<br />
NA<br />
VETASSESS<br />
www.assessit.net<br />
Bulk Store Operator - <strong>Assessment</strong> Book Print 1999 TVET Australia / Transport and Logistics Industry<br />
<strong>Skills</strong> <strong>Council</strong><br />
www.atpl.net.au<br />
<strong>Skills</strong> First RPL Assessor Kit – Transport and Distribution<br />
Certificate III in Transport and Distribution (Road Transport)<br />
Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />
<strong>Skills</strong> First<br />
http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />
RPL Kit RPL EEEZY Transport and Distribution Print 2005 Resources Generator<br />
http://www.resourcegenerator.gov.au<br />
3 2 2 2 2.25<br />
2 2 2 2 2.00<br />
1 2 2 2 1.75<br />
3 3 2 2 2.50<br />
3 2 2 2 2.25<br />
3 2 1 1 1.75<br />
3 1 2 2 2.50<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 60
Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />
<strong>Assessment</strong> materials<br />
Type <strong>of</strong> resource Title Format Year Source<br />
Seafood<br />
<strong>Assessment</strong><br />
instruments<br />
Facilitator's<br />
guide &<br />
assessment<br />
package<br />
Water<br />
Assessor guide<br />
<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />
317 SFIAQUA307A-Select and supervise the use <strong>of</strong><br />
chemicals and biological agents in an aquaculture operation-<br />
TPI02<br />
ABF511 Occupational Health and Safety at Sea - Facilitator's<br />
Guide & <strong>Assessment</strong> Package<br />
<strong>Skills</strong>Online – Assessor Guide<br />
Certificate II in Water Industry Operations - Assessor Guide<br />
Print 2004 <strong>Skills</strong> Victoria<br />
http://trainingsupport.otte.vic.gov.au<br />
Print 1997 TVET Australia<br />
www.atpl.net.au<br />
Print 2002 NSW Department <strong>of</strong> Education and Training<br />
<strong>Skills</strong>Online<br />
https://www.skillsonline.net.au<br />
RATING<br />
Validity Accessibility Usability Flexibility Aggregate<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
3 2 2 2 2.25<br />
<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 61