14.04.2014 Views

Quality of Assessment Practices - National Skills Standards Council

Quality of Assessment Practices - National Skills Standards Council

Quality of Assessment Practices - National Skills Standards Council

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Contents<br />

1. Executive Summary ................................................................ 3 <br />

2. Background .......................................................................... 12<br />

3. Structure <strong>of</strong> this report .......................................................... 14<br />

4. Project methodology ............................................................. 15<br />

5 Findings <strong>of</strong> the evaluation <strong>of</strong> the national stock <strong>of</strong><br />

assessment materials ........................................................... 19<br />

5.1 <strong>Assessment</strong> materials that address the general <br />

needs <strong>of</strong> assessors ......................................................... 19<br />

5.2 <strong>Assessment</strong> materials that address key <br />

assessment-related issues .............................................. 22<br />

5.3 Industry specific assessment materials ........................... 27<br />

5.4 Summary <strong>of</strong> findings <strong>of</strong> the evaluation <strong>of</strong> the <br />

national stock <strong>of</strong> assessment materials ........................... 32<br />

6. Strategy to address the key issues impacting on the <br />

national stock <strong>of</strong> assessment support materials .................... 34<br />

6.1 Improve awareness <strong>of</strong> and access to the national <br />

stock <strong>of</strong> assessment materials ........................................ 34<br />

6.2 Improve the quality, range and availability <strong>of</strong> <br />

industry specific assessment materials ........................... 36<br />

6.3 Provide support materials that address the current<br />

and emerging issues impacting on the quality <strong>of</strong><br />

assessment practice ....................................................... 38<br />

Appendix 1 - Participants in consultations .................................. 41<br />

Appendix 2 - Rating <strong>of</strong> assessment materials that address <br />

the general needs <strong>of</strong> assessors .................................................. 42<br />

Appendix 3 - Rating <strong>of</strong> assessment materials that address <br />

specific assessment related issues ............................................. 47<br />

Appendix 4 - Rating <strong>of</strong> industry specific assessment <br />

materials ..................................................................................... 50<br />

Disclaimer<br />

This work has been produced on behalf <strong>of</strong> the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> with funding<br />

provided through the Australian Government Department <strong>of</strong> Education Employment<br />

and Workplace Relations and state and territory governments. The views expressed<br />

herein are not necessarily those <strong>of</strong> the Australian Government or state and territory<br />

governments. Recommendations are under consideration by the NQC but it should<br />

not be assumed that they will necessarily be implemented in the future<br />

© Commonwealth <strong>of</strong> Australia 2009<br />

This document is available under a “Preserve Integrity” licence.<br />

see http://www.aesharenet.com.au/P4 for details. All other rights reserved.<br />

For licensing enquiries contact sales@tvetaustralia.com.au.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2<br />

2


1. Executive Summary<br />

In May 2009, the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> [NQC], through the<br />

<strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> Action Group [QAAG], commissioned<br />

Learning Australia Pty Ltd to undertake the second stage <strong>of</strong><br />

the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> <strong>Practices</strong> project. This involved:<br />

• Conducting an evaluation <strong>of</strong> the assessment related<br />

support materials that were identified through the<br />

national audit <strong>of</strong> assessment support materials which<br />

was completed during the first stage <strong>of</strong> the project; and<br />

• Formulating a strategy for addressing any issues raised<br />

through the evaluation <strong>of</strong> the national stock <strong>of</strong><br />

assessment support materials.<br />

The national audit <strong>of</strong> assessment support materials identified<br />

over seventeen hundred items, which were categorised into<br />

three broad groups, namely:<br />

1. <strong>Assessment</strong> materials which support the general needs<br />

<strong>of</strong> the VET workforce in relation to assessment. This<br />

includes resources that focus on matters such as: the<br />

design <strong>of</strong> assessment / evidence gathering tools, making<br />

assessment judgements, the assessment process,<br />

providing feedback and unpacking competency<br />

standards.<br />

2. <strong>Assessment</strong> materials that address specific assessment<br />

related issues, including: assessing generic /<br />

employability skills, assessing higher order<br />

competencies, peer, self and negotiated assessment,<br />

on-line assessment, graded assessment, workplace<br />

assessment, simulation, <strong>of</strong>f the job assessment,<br />

assessment in apprenticeships/ traineeships,<br />

assessment and international / NESB students and<br />

reasonable adjustment.<br />

3. <strong>Assessment</strong> instruments for the assessment <strong>of</strong> specific<br />

units <strong>of</strong> competency and / or qualifications, such as <br />

observation checklists, portfolios, question banks,<br />

practical tasks, simulations, test items and third party<br />

reports.<br />

The evaluation <strong>of</strong> these materials revealed that:<br />

• The national stock <strong>of</strong> assessment related resources is<br />

highly dispersed across a range <strong>of</strong> national and State /<br />

Territory agencies. This makes it difficult for users to<br />

identify, preview and access relevant assessmentrelated<br />

support materials.<br />

• There is a significant range <strong>of</strong> high quality, up to date<br />

materials dealing with the general needs <strong>of</strong> assessors.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 3


• There is a very limited range <strong>of</strong> up to date, assessment<br />

materials that address the key current and emerging<br />

issues impacting on quality assessment. For example,<br />

the national audit did not identify any materials that<br />

provide assessors with current, high quality advice on:<br />

Peer, self and negotiated assessment;<br />

Formative assessment;<br />

The use <strong>of</strong> simulation;<br />

<strong>Assessment</strong> moderation; and<br />

The assessment <strong>of</strong> international students and<br />

students from non English speaking backgrounds.<br />

• There is an uneven spread <strong>of</strong> industry-specific<br />

assessment materials across the key industry areas.<br />

Some areas, such as primary industries are particularly<br />

well served, whereas others, such as property services,<br />

have very few industry-specific assessment materials.<br />

The evaluation <strong>of</strong> these materials revealed that there are<br />

significant quality issues impacting on this category <strong>of</strong><br />

materials. For example, sixty per cent <strong>of</strong> the assessment<br />

materials are not based on the current version <strong>of</strong> the<br />

relevant Training Package. In addition, there is a lack <strong>of</strong><br />

innovation in assessment materials design in this<br />

category.<br />

• Many <strong>of</strong> the items in the national stock <strong>of</strong> assessment<br />

materials are State or Territory publications. This limits<br />

their accessibility and consideration should be given to<br />

making them more readily available to a wider national<br />

audience.<br />

• Most <strong>of</strong> the items in the national stock <strong>of</strong> assessment<br />

materials are not supported by a systematic<br />

maintenance process. This means that the national stock<br />

<strong>of</strong> assessment materials is at risk <strong>of</strong> becoming obsolete.<br />

• Many <strong>of</strong> the industry specific assessment materials have<br />

been appraised against the quality principles for Training<br />

Package Support Materials and carry the national tick<br />

even though they:<br />

Are not supported by a maintenance strategy,<br />

May not comply with the current version <strong>of</strong> the<br />

Training Package; and<br />

May not represent innovative assessment<br />

materials design.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 4


In response to this situation it is recommended that the<br />

<strong>National</strong> <strong>Quality</strong> <strong>Council</strong> implement the following three-point<br />

strategy that is designed to:<br />

1. Improve awareness <strong>of</strong> and access to the national stock <strong>of</strong><br />

assessment materials;<br />

2. Improve the quality, range and availability <strong>of</strong> industry<br />

specific assessment materials; and<br />

3. Provide support materials that address the current and<br />

emerging issues impacting on the quality <strong>of</strong> assessment<br />

practice.<br />

Improve awareness <strong>of</strong> and access to the<br />

national stock <strong>of</strong> assessment materials<br />

The national audit <strong>of</strong> assessment-related resources showed<br />

that the national stock <strong>of</strong> assessment materials comprises:<br />

• A significant collection <strong>of</strong> high quality, up to date<br />

materials dealing with the general needs <strong>of</strong> assessors, in<br />

areas such as the assessment processes, recognition <strong>of</strong><br />

prior learning and assessment tool design.<br />

• A limited but nevertheless high quality selection <strong>of</strong><br />

materials dealing with key assessment related issues <br />

such as: assessing in apprenticeship and traineeship <br />

programs, assessing higher order competencies,<br />

assessment quality assurance, assessment validation,<br />

assessment judgement, assessor networks, and<br />

assessing generic / employability skills.<br />

• A large number <strong>of</strong> materials, especially industry specific<br />

materials, that are out <strong>of</strong> date and do not meet the<br />

requirements <strong>of</strong> the current version <strong>of</strong> the relevant<br />

Training Package and / or Australian <strong>Quality</strong> Training<br />

Framework.<br />

The audit also showed that:<br />

There is no single location where all these materials can<br />

be identified, previewed and accessed;<br />

It is difficult to establish the currency <strong>of</strong> the materials;<br />

and<br />

There is limited advice on the quality <strong>of</strong> the materials or<br />

how they may be used.<br />

This makes it very difficult for assessors and other users to<br />

identify, access and use these materials.<br />

There is a pressing need for a national clearinghouse for<br />

assessment-related support materials that has:<br />

1. A discovery function that enables assessors to identify<br />

existing high quality assessment materials;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 5


2. A marketing function that promotes existing high<br />

quality assessment materials to potential users;<br />

3. A pr<strong>of</strong>essional development function that informs<br />

assessors about the ways in which the national stock <strong>of</strong><br />

assessment materials may be used and / or customised;<br />

and<br />

4. A maintenance function that monitors assessment<br />

materials held in the clearinghouse and informs<br />

copyright owners about the relevance <strong>of</strong> their materials<br />

and the need for them to be updated or revised.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 6


Recommendation 1<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> request TVET Australia to<br />

establish a comprehensive, national clearinghouse for free<br />

and commercial assessment-related support materials that:<br />

• Enable users to identify and preview the national stock <strong>of</strong><br />

assessment-related support materials, and if required,<br />

obtain copies which are licensed for use via free <strong>of</strong><br />

charge download or immediate electronic purchase and<br />

delivery;<br />

• Actively promotes the national stock <strong>of</strong> assessment-<br />

related support materials to users including industry,<br />

assessors and RTOs;<br />

• Conducts, in conjunction with the Industry <strong>Skills</strong> <br />

<strong>Council</strong>s, industry organisations and State / Territory<br />

VET agencies, pr<strong>of</strong>essional education programs for <br />

assessors on the national stock <strong>of</strong> assessment-related <br />

support materials;<br />

• Actively engages with owners <strong>of</strong> materials promoted<br />

through the clearinghouse to ensure that the<br />

assessment-related support materials are maintained or<br />

withdrawn from the clearinghouse;<br />

• Provides assessors and other users with clear <br />

information on the quality <strong>of</strong> the assessment related<br />

support materials held in the clearinghouse; and<br />

• Provides advice or a referral service for assessors and <br />

other users seeking information on the national stock <strong>of</strong><br />

assessment-related support materials.<br />

Improve the quality, range and availability <strong>of</strong><br />

industry specific assessment materials<br />

The national audit <strong>of</strong> assessment-related resources identified<br />

over seventeen hundred industry specific assessment<br />

resources, including assessment instruments, assessor<br />

guides and candidates materials.<br />

However the evaluation <strong>of</strong> these materials revealed that:<br />

• Many <strong>of</strong> the materials do not comply with the current<br />

version <strong>of</strong> the Training Package;<br />

• The materials are <strong>of</strong>ten developed by State and Territory<br />

agencies and are not well known by assessors working<br />

in other jurisdictions;<br />

• There is a lack <strong>of</strong> good quality assessment materials in <br />

many industry sectors; <br />

• The current national process for quality assuring<br />

assessment-related support materials is inadequate;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 7


• There are no systematic arrangements for the<br />

maintenance <strong>of</strong> these materials; and <br />

• There is a lack <strong>of</strong> innovation in assessment materials <br />

design.<br />

In response to this situation it is recommended that the<br />

<strong>National</strong> <strong>Quality</strong> <strong>Council</strong> take steps to:<br />

1. Develop a quality assurance process for assessmentrelated<br />

support materials for which national endorsement<br />

and inclusion in the proposed national clearinghouse is<br />

sought;<br />

2. Transfer responsibility for the quality assurance <strong>of</strong><br />

assessment-related support materials to the relevant<br />

Industry <strong>Skills</strong> <strong>Council</strong>s; and<br />

3. Fund the Industry <strong>Skills</strong> <strong>Council</strong> to undertake the design,<br />

development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />

assessment-related support materials for each endorsed<br />

Training Package in their area <strong>of</strong> coverage and to<br />

actively promote these materials on a national basis, in<br />

collaboration with relevant national and State / Territory<br />

agencies.<br />

It is envisaged that the Industry <strong>Skills</strong> <strong>Council</strong>s and the<br />

proposed national clearinghouse [see Recommendation 1]<br />

would collaborate to provide an integrated discovery service<br />

for assessment related support materials. Under this<br />

arrangement the Industry <strong>Skills</strong> <strong>Council</strong> would have<br />

responsibility for industry specific materials, whereas the<br />

clearinghouse would focus on promoting cross industry<br />

assessment support materials.<br />

Recommendation 2<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> develop a quality assurance<br />

process for assessment-related support materials for which<br />

national endorsement and inclusion in the proposed national<br />

clearinghouse is sought which:<br />

• Ensures that nationally recognised assessment-related <br />

support materials comply with the principles <strong>of</strong> validity,<br />

flexibility, usability, equity and accessibility;<br />

• Requires developers <strong>of</strong> assessment-related support<br />

materials to engage industry in the design, development<br />

and evaluation <strong>of</strong> the assessment materials;<br />

• Requires developers to implement an active <br />

maintenance process to ensure the currency and <br />

relevance <strong>of</strong> the assessment materials; and<br />

• Fosters innovation in assessment materials design.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 8


Recommendation 3<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> transfer responsibility for the<br />

quality assurance <strong>of</strong> assessment-related support materials,<br />

within nationally agreed guidelines as established through<br />

Recommendation 2, to the relevant Industry <strong>Skills</strong> <strong>Council</strong>s.<br />

Recommendation 4<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support the design and<br />

implementation <strong>of</strong> a capability building program to ensure that<br />

Industry <strong>Skills</strong> <strong>Council</strong>s have the capability to manage the<br />

quality assurance <strong>of</strong> assessment-related support materials.<br />

Recommendation 5<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support each Industry <strong>Skills</strong><br />

<strong>Council</strong> being funded to:<br />

• Undertake, in conjunction with industry, the design,<br />

development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />

assessment-related support materials for each endorsed<br />

Training Package in their area <strong>of</strong> coverage;<br />

• Actively promote these exemplar assessment-related<br />

support materials on a national basis in conjunction with<br />

industry and national, State and Territory VET agencies;<br />

and<br />

• Establish a national pr<strong>of</strong>essional development strategy,<br />

in conjunction with industry and national, State and <br />

Territory VET agencies, to build assessor capability in <br />

the use <strong>of</strong> the exemplar assessment – related support<br />

materials.<br />

Provide support materials that address the<br />

current and emerging issues impacting on<br />

the quality <strong>of</strong> assessment practice<br />

The national audit <strong>of</strong> assessment related support materials<br />

identified a set <strong>of</strong> twenty-one current and emerging issues<br />

impacting on the quality <strong>of</strong> assessment practice. These<br />

included: assessing in apprenticeship and traineeship<br />

programs, assessing higher order competencies, assessment<br />

quality assurance, assessment validation, assessment<br />

judgement, assessor networks, and assessing generic /<br />

employability skills.<br />

The evaluation <strong>of</strong> the national stock <strong>of</strong> assessment-related<br />

support materials showed that:<br />

• There is a very limited range <strong>of</strong> up to date, assessment<br />

materials that address these issues; and<br />

• There are a number <strong>of</strong> key assessment-related issues <br />

for which there are no suitable, nationally available <br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 9


support materials. For example, the national audit did not<br />

identify any materials that provide assessors with<br />

current, high quality advice on: peer, self and negotiated<br />

assessment; formative assessment; the use <strong>of</strong><br />

simulation; and the assessment <strong>of</strong> international students<br />

and students from non-English speaking backgrounds.<br />

The absence <strong>of</strong> quality assessment support materials is an<br />

impediment to improving assessment practice. Consideration<br />

should be given to establishing a national assessment<br />

initiative that is focused on developing support materials and<br />

fostering assessor capability in these key areas.<br />

Recommendation 6<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> sponsor a national<br />

assessment initiative to develop support materials and foster<br />

assessor capability in relation to the key issues impacting on<br />

the quality <strong>of</strong> assessment practice. Specifically the national<br />

assessment initiative should:<br />

1. Commission an integrated series <strong>of</strong> projects designed to<br />

develop support materials and assessor capability in<br />

relation to:<br />

The use <strong>of</strong> formative assessment or assessment for<br />

learning approaches to enhance competency<br />

development;<br />

Improving the quality <strong>of</strong> assessor judgement in the<br />

assessment process;<br />

Assessing in workplace settings, including identifying<br />

and addressing the skill development needs <strong>of</strong><br />

employees, supervisors, human resource practitioners<br />

and other workplace personnel who are engaged in<br />

providing training and assessment functions;<br />

The use <strong>of</strong> peer, self and negotiated assessment to<br />

improve competency development;<br />

Contextualising nationally recognised assessment<br />

resources for use in enterprise based training and<br />

assessment systems;<br />

The use <strong>of</strong> simulation in competency based<br />

assessment;<br />

<strong>Assessment</strong> <strong>of</strong> higher order competencies;<br />

Assessing in international contexts – assessment <strong>of</strong><br />

international students in Australian and international<br />

settings;<br />

The integrated assessment <strong>of</strong> skill sets;<br />

Cost effective approaches to assessment moderation;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 10


<strong>Assessment</strong> in regulated occupations / industries; and<br />

Competency based assessment in online learning<br />

environments.<br />

2. Establish a national implementation program, in<br />

conjunction with the Industry <strong>Skills</strong> <strong>Council</strong> and national,<br />

State and Territory VET agencies, to ensure that all<br />

assessors in private, public and enterprise providers are<br />

provided with training and / or information on:<br />

The issues addressed in the materials; and<br />

How to effectively use the materials with different VET<br />

clients and in varying VET contexts.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 11


2. Background<br />

In May 2009, the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> [NQC], through the<br />

<strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> Action Group [QAAG], commissioned<br />

Learning Australia Pty Ltd to undertake the second stage <strong>of</strong><br />

the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> <strong>Practices</strong> project. This was<br />

designed to:<br />

• Review the materials that were identified through the<br />

national audit <strong>of</strong> assessment materials that was<br />

undertaken during first stage <strong>of</strong> the project;<br />

• Develop a strategy to address gaps in the provision <strong>of</strong><br />

assessment materials required to support quality<br />

assessment; and<br />

• Establish a plan for the dissemination and<br />

implementation <strong>of</strong> any new, updated or existing materials<br />

for supporting quality assessment.<br />

This project built on the outcomes <strong>of</strong> the first stage <strong>of</strong> the<br />

project which was commissioned by the former VET<br />

Workforce Standing Committee <strong>of</strong> the <strong>National</strong> <strong>Quality</strong><br />

<strong>Council</strong> in November 2008. The key outcome <strong>of</strong> stage 1 <strong>of</strong><br />

the project was a report that:<br />

• Identified the characteristics <strong>of</strong> quality assessment;<br />

• Discussed the key issues impacting on quality<br />

assessment in the VET sector in the current context;<br />

• Identified the assessment materials that are currently<br />

available to support quality assessment practices; and<br />

• Identified the critical components <strong>of</strong> quality assessment.<br />

The first stage report sets out seven key actions which<br />

should be taken to improve the quality <strong>of</strong> assessment<br />

practices in the vocational education and training sector. The<br />

key actions are as follows:<br />

1. Build assessment expertise within the VET sector;<br />

2. Provide clear benchmarks for assessment;<br />

3. Build the status and capability <strong>of</strong> assessors;<br />

4. Improve assessment quality assurance by supporting<br />

the effective implementation <strong>of</strong> the current AQTF<br />

standards;<br />

5. Provide high quality, industry endorsed model<br />

assessment support materials;<br />

6. Improve the capability <strong>of</strong> assessors to make quality<br />

assessment judgements; and<br />

7. Ensure that assessment is an integral part <strong>of</strong> the<br />

learning and training process.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 12


The key actions and associated recommendations, which<br />

were considered by the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> Action Group<br />

early in 2009, are fully detailed in the Stage 1 report.<br />

The <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> (NQC) endorsed the final<br />

report, <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong> <strong>Practices</strong> Stage 1 (parts A and<br />

B), for public release in April 2009, with the caveat that the<br />

recommendations were currently under consideration by the<br />

NQC and would not necessarily be implemented in the<br />

future. A number <strong>of</strong> recommendations were directed to NQC<br />

Action Groups for further consideration.<br />

The NQC also agreed that the report on the <strong>National</strong><br />

Mapping <strong>of</strong> <strong>Assessment</strong> Materials, which formed part <strong>of</strong> the<br />

Stage 1 report, would be further reviewed in Stage 2 <strong>of</strong> the<br />

project and that this would also provide recommendations to<br />

the NQC on how gaps in materials might be addressed.<br />

Learning Australia Pty Ltd was granted the tender to<br />

complete Stage 2 <strong>of</strong> the project.<br />

The second stage <strong>of</strong> the project is the focus <strong>of</strong> this report. It<br />

involved Learning Australia in:<br />

1. Undertaking an evaluation <strong>of</strong> the materials identified<br />

through the national audit <strong>of</strong> assessment materials; and<br />

2. Formulating a strategy for addressing the issues raised<br />

through the evaluation <strong>of</strong> the national stock <strong>of</strong><br />

assessment materials. <br />

The work undertaken during this stage <strong>of</strong> the project was<br />

also informed by:<br />

• The findings <strong>of</strong> the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> project<br />

Investigation into industry expectations <strong>of</strong> vocational<br />

education and training assessment;<br />

• The outcomes <strong>of</strong> the NQC project on Alternative<br />

frameworks for recognizing workplace training which was<br />

undertaken in late 2008;<br />

• The findings emerging from the suite <strong>of</strong> assessment-<br />

related projects currently being undertaken by the NQC<br />

dealing with moderation and validation processes,<br />

industry partnerships and graded assessment; and<br />

• The preliminary findings <strong>of</strong> the <strong>National</strong>; <strong>Quality</strong> <strong>Council</strong> /<br />

<strong>Council</strong> <strong>of</strong> Australian Governments Joint Steering<br />

Committee project on VET products for the 21st century<br />

project.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 13


3. Structure <strong>of</strong> this report<br />

This report describes the outcomes <strong>of</strong> the evaluation <strong>of</strong> the<br />

national stock <strong>of</strong> assessment support materials and a strategy<br />

to address the key issues impacting on the national stock <strong>of</strong><br />

assessment support materials.<br />

This report comprises six key sections:<br />

• Section one is an executive summary.<br />

• Section two provides the background to the project.<br />

• Section three outlines the structure <strong>of</strong> the report.<br />

• Section four describes the project methodology.<br />

• Section five discusses the findings <strong>of</strong> the evaluation <strong>of</strong><br />

the national stock <strong>of</strong> assessment support materials.<br />

• Section six details a strategy to address the key issues<br />

impacting on the national stock <strong>of</strong> assessment support<br />

materials.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 14


4. Project methodology<br />

The methodology developed by Learning Australia Pty Ltd for<br />

this project involved four key stages. These were:<br />

1. Project establishment – the consultant met with the NQC<br />

Secretariat Project Director to clarify the scope,<br />

methodology and expected outcomes <strong>of</strong> the project.<br />

2. Review <strong>of</strong> the national stock <strong>of</strong> assessment materials –<br />

the consultant undertook an analysis <strong>of</strong> the three sets <strong>of</strong><br />

assessment materials that were identified through the<br />

national audit <strong>of</strong> assessment materials [see stage one<br />

report]. Materials included in the audit were selected on<br />

the basis <strong>of</strong> the following criteria:<br />

The materials are available to both private and public<br />

RTOs;<br />

The materials are available free or at nominal cost;<br />

The materials have been subject to a relevant quality<br />

assurance process. This was taken to include:<br />

validation by industry, review by a user group or<br />

appraisal against a set <strong>of</strong> quality criteria, such as the<br />

quality principles for Training Package Support<br />

Materials or quality principles established for<br />

educational materials development by any relevant<br />

Australian or international body;<br />

The materials have been designed to support<br />

assessment <strong>of</strong> units <strong>of</strong> competency, modules and /<br />

or qualifications in Training Packages and / or State /<br />

Territory accredited courses;<br />

The materials have been developed for use in the<br />

Australian vocational education and training system;<br />

The materials have been developed since 2000; and<br />

The materials are primarily assessment resources.<br />

As such the audit did not include learning materials<br />

that may incorporate an assessment component.<br />

The analysis <strong>of</strong> the materials was undertaken in two stages.<br />

The first stage involved a meta-evaluation <strong>of</strong> the three sets<br />

<strong>of</strong> assessment materials. This focused on identifying the:<br />

• Number <strong>of</strong> materials;<br />

• Type <strong>of</strong> materials;<br />

• Format <strong>of</strong> materials;<br />

• Age <strong>of</strong> materials;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 15


• Key aspects <strong>of</strong> assessment practice covered by the<br />

materials; and<br />

• Key areas <strong>of</strong> assessment practice in which there are<br />

gaps.<br />

In the case <strong>of</strong> the third set <strong>of</strong> assessment materials, namely<br />

materials which are designed for specific industry /<br />

occupational areas, the meta-evaluation also identified the<br />

industry coverage <strong>of</strong> the materials. The second stage<br />

involved an evaluation <strong>of</strong> the individual items in each <strong>of</strong> the<br />

three sets <strong>of</strong> assessment materials. This involved evaluating<br />

the individual items against the evaluative criteria and scoring<br />

system set out in Figure 1.<br />

It should be noted that as the third set <strong>of</strong> assessment<br />

materials, namely materials for specific industry areas, was<br />

so extensive it was agreed with the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong><br />

Action Group that a sample <strong>of</strong> assessment materials in this<br />

group would be evaluated. The sample:<br />

• Comprised 99 <strong>of</strong> the 1,643 <strong>of</strong> the assessment materials<br />

in this group that were identified through the national<br />

audit;<br />

• Covered each <strong>of</strong> the 27 industry areas identified in the<br />

national audit <strong>of</strong> assessment materials;<br />

• Covered each <strong>of</strong> the agencies, identified through the<br />

audit, that either develop or distribute assessment<br />

materials in each <strong>of</strong> the twenty-seven industry areas;<br />

and<br />

• Was randomly selected across the industry areas and<br />

the agencies engaged in the development or distribution<br />

<strong>of</strong> the assessment materials.<br />

The following table indicates the evaluation criteria and the<br />

scoring system used in the meta- evaluation<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 16


Figure 1: Evaluation criteria and scoring system<br />

VALIDITY<br />

Score<br />

Descriptor<br />

1 The assessment materials clearly comply with the approach to assessment<br />

embodied in the current version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework and,<br />

where relevant, comply with the assessment provisions in the current version <strong>of</strong> the<br />

relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />

2 The assessment materials generally comply with the approach to assessment<br />

embodied in the current version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework and,<br />

where relevant, generally comply with the assessment provisions in the current<br />

version <strong>of</strong> the relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />

3 The assessment materials do not appear to comply with the approach to<br />

assessment embodied in the current version <strong>of</strong> the Australian <strong>Quality</strong> Training<br />

Framework and / or do not appear to comply with the assessment provisions in<br />

the current version <strong>of</strong> the relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />

ACCESSIBILITY<br />

Score<br />

Descriptor<br />

1 The assessment materials are readily accessible to assessors and trainers in all<br />

jurisdictions working in both private and public RTOs in a wide variety <strong>of</strong> VET<br />

contexts ie: institutional settings, workplaces, enterprises and schools. Generally<br />

these materials are marketed nationally; able to be viewed, downloaded and / or<br />

ordered via the Internet; and are free <strong>of</strong> charge or low cost.<br />

2 The assessment materials are generally accessible to assessors and trainers<br />

working in a variety <strong>of</strong> VET contexts ie: institutional settings, workplaces,<br />

enterprises and schools. Accessibility may be limited by lack <strong>of</strong> national marketing;<br />

restricted web access for downloading, ordering or viewing; and / or cost.<br />

3 The assessment materials do not appear to be accessible to all assessors and<br />

trainers. There are significant restrictions, such as cost; licensing; copyright;<br />

subscription and absence <strong>of</strong> web access for downloading, ordering or viewing that<br />

limit the accessibility <strong>of</strong> the assessment materials.<br />

USABILITY<br />

Score<br />

Descriptor<br />

1 The assessment materials are well designed. The materials design is user<br />

friendly [ie: the user knows what to do and how to do it]. The time and effort<br />

needed to customize and use the materials is reasonable.<br />

2 The assessment materials are generally well designed. The materials design<br />

could be more user friendly [ie: the user needs clearer advice on what to do and<br />

how to do it]. Users must invest significant time and effort to customize and / or use<br />

the materials.<br />

3 The assessment materials do not appear to be well designed. The materials<br />

design is not user friendly. The time and/ or effort needed to customize and / or<br />

use the materials is excessive.<br />

FLEXIBILITY<br />

Score<br />

Descriptor<br />

1 The assessment materials: [1] may be adapted for use with a variety <strong>of</strong> VET clients,<br />

[2] take into account equity considerations, [3] make provision for reasonable<br />

adjustment, and [4] may be readily applied in a range <strong>of</strong> VET contexts.<br />

2 The assessment materials require significant user input to: [1] be used with a<br />

variety <strong>of</strong> VET clients, [2] take into account equity considerations, [3] make<br />

provision for reasonable adjustment, and [4] be applied in different VET contexts.<br />

3 The assessment materials do not appear to [1] be suited for use with a variety <strong>of</strong><br />

VET clients, including learners with special needs, [2] take into account equity<br />

considerations, [3] make provision for reasonable adjustment, and [4] be designed<br />

for application in different VET contexts.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2<br />

17


The second stage involved both the preparation <strong>of</strong> a draft<br />

report and consultation. The consultant collated the<br />

information gathered through the analysis <strong>of</strong> the national<br />

stock <strong>of</strong> assessment materials and produced a draft report<br />

that identified:<br />

• The outcomes <strong>of</strong> the analysis <strong>of</strong> the national stock <strong>of</strong><br />

assessment materials; and<br />

• A strategy for addressing issues that arose from the<br />

evaluation <strong>of</strong> the assessment support materials.<br />

During this stage, the consultant met with representatives <strong>of</strong><br />

the following organisations to gather views and opinions on<br />

the outcomes emerging from the analysis <strong>of</strong> the national<br />

stock <strong>of</strong> assessment materials:<br />

Australian Chamber <strong>of</strong> Commerce and Industry<br />

Australian <strong>Council</strong> <strong>of</strong> Trade Unions<br />

Australian Industry Group<br />

Construction and Property Services Industry <strong>Skills</strong><br />

<strong>Council</strong><br />

Department <strong>of</strong> Education and Training –<br />

Queensland<br />

Department <strong>of</strong> Education and Training – Western<br />

Australia<br />

Department <strong>of</strong> Further Education, Employment,<br />

Science and Technology – South Australia.<br />

TVET Australia<br />

A list <strong>of</strong> individuals consulted is provided as Appendix 1.<br />

The draft report was prepared and presented to the NQC<br />

Secretariat and members <strong>of</strong> the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong><br />

Action Group for comment in early June 2009.<br />

The third stage involved preparation <strong>of</strong> the final report and <br />

acquittal <strong>of</strong> the project. The consultant reviewed the<br />

feedback from the members <strong>of</strong> the <strong>Quality</strong> <strong>of</strong> <strong>Assessment</strong><br />

Action Group and prepared the final version <strong>of</strong> the project<br />

report and recommendations. This was presented to the<br />

Action Group in mid June 2009.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 18


5 Findings <strong>of</strong> the evaluation <strong>of</strong> the national<br />

stock <strong>of</strong> assessment materials<br />

The national audit <strong>of</strong> assessment related materials, which<br />

was conducted during the first stage <strong>of</strong> this project, identified<br />

1,705 assessment materials that met the selection criteria.<br />

As discussed earlier in this report, these resources may be<br />

divided in three broad categories. These are:<br />

1. <strong>Assessment</strong> materials which support the general needs<br />

<strong>of</strong> the VET workforce in relation to assessment. This<br />

includes resources that focus on matters such as: the<br />

design <strong>of</strong> assessment / evidence gathering tools, making<br />

assessment judgements, the assessment process,<br />

providing feedback and unpacking competency<br />

standards.<br />

2. <strong>Assessment</strong> materials that address specific assessment<br />

related issues, including: assessing generic /<br />

employability skills, assessing higher order<br />

competencies, peer, self and negotiated assessment,<br />

on-line assessment, graded assessment, workplace<br />

assessment, simulation, <strong>of</strong>f the job assessment,<br />

assessment in apprenticeships/ traineeships,<br />

assessment and international / NESB students and<br />

reasonable adjustment.<br />

3. <strong>Assessment</strong> instruments for the assessment <strong>of</strong> specific<br />

units <strong>of</strong> competency and / or qualifications, such as <br />

observation checklists, portfolios, question banks,<br />

practical tasks, simulations, test items and third party<br />

reports.<br />

The ensuing section <strong>of</strong> this report provides an analysis <strong>of</strong><br />

the availability and quality <strong>of</strong> the resources in each <strong>of</strong><br />

these categories <strong>of</strong> assessment materials.<br />

5.1 <strong>Assessment</strong> materials that address the general<br />

needs <strong>of</strong> assessors<br />

The national audit <strong>of</strong> assessment materials identified forty<br />

resources which address the general needs <strong>of</strong> assessors<br />

[see Appendix 2].<br />

These resources, as shown in Figure 2, deal with five key<br />

themes, namely: the assessment process, assessment<br />

system management, assessment tool design, assessor<br />

skills and recognition <strong>of</strong> prior learning. However most <strong>of</strong><br />

these resources focus on two themes, namely the<br />

assessment process [twelve] and recognition <strong>of</strong> prior<br />

learning [twenty].<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 19


Figure 2: <strong>Assessment</strong> resources that address the general needs <strong>of</strong><br />

assessors – number <strong>of</strong> resources<br />

General needs <strong>of</strong> assessors<br />

Number <strong>of</strong><br />

resources<br />

<strong>Assessment</strong> process 12<br />

<strong>Assessment</strong> system management 3<br />

<strong>Assessment</strong> tool design 4<br />

Assessor skills 1<br />

Recognition <strong>of</strong> prior learning 20<br />

Total 40<br />

As shown in Figure 3, most <strong>of</strong> the resources related to these<br />

two themes are very recent. Fourteen <strong>of</strong> the twenty<br />

resources on recognition <strong>of</strong> prior learning, were developed<br />

through the <strong>Council</strong> <strong>of</strong> Australian Governments Recognition<br />

<strong>of</strong> Prior Learning Program, and eight <strong>of</strong> the twelve resources<br />

dealing with the assessment process have been published<br />

since 2008. Overall, more than three-quarters <strong>of</strong> the<br />

assessment materials in this category have been published<br />

since 2006. As such, there is a relatively extensive stock <strong>of</strong><br />

up to date assessment materials in this category.<br />

Nevertheless the national audit did reveal that there is a lack<br />

<strong>of</strong> assessment support materials dealing with three key<br />

themes, namely:<br />

1. <strong>Assessment</strong> feedback;<br />

2. <strong>Assessment</strong> recording and reporting processes; and<br />

3. <strong>Assessment</strong> moderation.<br />

Whilst there is a lack <strong>of</strong> specialised material dealing with the<br />

first two <strong>of</strong> these themes, the evaluation <strong>of</strong> the materials in<br />

this category revealed that these matters are <strong>of</strong>ten<br />

addressed in broader resources dealing with the assessment<br />

process and recognition <strong>of</strong> prior learning process. This did<br />

not appear to be the case with assessment moderation and<br />

there appears to be a distinct lack <strong>of</strong> up to date support<br />

materials in this area.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 20


Figure 3: <strong>Assessment</strong> resources that address the general needs <strong>of</strong> assessors<br />

– year <strong>of</strong> publication<br />

Year <strong>of</strong> publication<br />

Number <strong>of</strong><br />

resources<br />

2008 - 2009 29<br />

2006 - 2007 2<br />

Prior to 2006 9<br />

Total 40<br />

The forty resources in this category were evaluated against<br />

the four criteria <strong>of</strong> validity, accessibility, usability and flexibility<br />

[see Figure 1]. The individual ratings for each resource are<br />

detailed in Appendix 2.<br />

The ratings show that on a three point scale, with one<br />

indicating clear compliance with the criterion and three<br />

indicating non compliance with the criterion, that four <strong>of</strong> the<br />

forty resources attained an aggregate score <strong>of</strong> 1.0, twentytwo<br />

scored 1.25 and thirteen scored 1.50. It is also<br />

interesting to note that in terms <strong>of</strong> validity, twenty-one <strong>of</strong> the<br />

forty resources scored 1.0 and the remaining nineteen<br />

scored 2.0.<br />

Overall this suggests that the resources in this category are<br />

generally <strong>of</strong> a high quality. Over half <strong>of</strong> the resources fully<br />

comply and the remainder generally comply with the<br />

approach to assessment embodied in the Australian <strong>Quality</strong><br />

Training Framework and / or Training Packages. In addition<br />

the resources:<br />

• Are accessible to trainers and assessors;<br />

• Are user friendly;<br />

• Address equity considerations; and<br />

• Are able to be used with a variety <strong>of</strong> VET clients in a<br />

range <strong>of</strong> contexts, including in workplace, institutional<br />

and on line settings.<br />

While the materials in this category are generally accessible<br />

to trainers and assessors, it is interesting to note that thirtyone<br />

<strong>of</strong> the forty resources rated 2.00 on the accessibility<br />

scale. This reflects the following facts:<br />

• Half <strong>of</strong> the materials have been developed by State and<br />

Territory agencies. While these materials are generally<br />

available on line, they simply may not been known by<br />

assessors and trainers in other jurisdictions; and<br />

• Some <strong>of</strong> the materials, such as the Shea series, are<br />

commercial publications. Even though these materials<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 21


are reasonably priced, the cost <strong>of</strong> these materials may<br />

limit their accessibility for some users.<br />

While accessibility is an important factor, the main issue<br />

impacting on this category <strong>of</strong> materials is maintenance. As<br />

noted earlier, most <strong>of</strong> these materials have been published<br />

since 2006, with twenty nine <strong>of</strong> the forty resources being<br />

published since 2008. However most <strong>of</strong> these materials have<br />

been developed using project funds and are not supported<br />

by a maintenance strategy. This means that there is no<br />

systematic process for ensuring that the materials keep pace<br />

with changes to the Australian <strong>Quality</strong> Training Framework,<br />

Training Packages, industry practice and relevant legislation.<br />

As a result there is a significant risk that these materials will<br />

become obsolete.<br />

In summary, the evaluation <strong>of</strong> the assessment materials in <br />

this category showed that: <br />

• There is a good range <strong>of</strong> high quality, up to date<br />

materials dealing with the general needs <strong>of</strong> assessors;<br />

• There is a lack <strong>of</strong> support materials on assessment <br />

moderation;<br />

• Many <strong>of</strong> the materials are State or Territory publications,<br />

this limits their accessibility and consideration should be<br />

given to making them more readily available to a wider<br />

national audience; and<br />

• In many cases there is no systematic process for<br />

maintaining these materials.<br />

5.2 <strong>Assessment</strong> materials that address key<br />

assessment-related issues<br />

Through the national audit <strong>of</strong> assessment materials,<br />

information was gathered on the availability and quality <strong>of</strong><br />

resources that address twenty-one key assessment-related <br />

issues. These are:<br />

• Apprenticeships and traineeship and assessment;<br />

• AQTF;<br />

• Assessing generic / employability skills;<br />

• Assessing higher order competencies;<br />

• <strong>Assessment</strong> and international / NESB students;<br />

• <strong>Assessment</strong> judgement;<br />

• <strong>Assessment</strong> partnerships;<br />

• <strong>Assessment</strong> quality assurance;<br />

• <strong>Assessment</strong> validation;<br />

• Assessor networks;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 22


• Assessor training;<br />

• E learning and assessment;<br />

• Formative assessment;<br />

• Graded assessment;<br />

• Norm referenced assessment;<br />

• Off the job assessment;<br />

• On-line assessment;<br />

• Peer, self and negotiated assessment;<br />

• Reasonable adjustment;<br />

• Simulation; and<br />

• Workplace assessment, including contextualisation <strong>of</strong><br />

nationally recognised materials for use in enterprise<br />

based programs.<br />

The national audit identified twenty-two resources which<br />

address these issues [see Appendix 3].<br />

These resources, as shown in Figure 4, cover thirteen <strong>of</strong> the<br />

twenty-one key issues. These include assessing within<br />

apprenticeship and traineeship programs, assessing higher<br />

order competencies and assessment quality assurance. For<br />

six <strong>of</strong> these thirteen issues, namely assessment validation,<br />

assessment judgement, assessing within apprenticeship and<br />

traineeship programs, assessor networks, assessment<br />

quality assurance and assessing generic / employability<br />

skills, at least two resources were identified through the<br />

audit.<br />

For seven <strong>of</strong> these assessment-related issues, including<br />

such critical issues as reasonable adjustment and assessing<br />

higher order competencies, there was only one resource<br />

identified through the audit. In the latter case, the resource<br />

was originally published in 2001 and as such predates the<br />

recent reforms to the AQTF and moves to enhance<br />

articulation between the VET and higher education sectors.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 23


Figure 4: Key assessment themes – number <strong>of</strong> resources identified in the<br />

national audit <strong>of</strong> assessment materials<br />

Key assessment theme<br />

Number <strong>of</strong><br />

resources<br />

<strong>Assessment</strong> judgement 3<br />

Apprenticeships and traineeship and assessment 3<br />

<strong>Assessment</strong> validation 3<br />

Assessor networks 2<br />

<strong>Assessment</strong> quality assurance 2<br />

Assessing generic / employability skills 2<br />

Workplace assessment 1<br />

Reasonable adjustment 1<br />

E learning / assessment 1<br />

Assessor training 1<br />

<strong>Assessment</strong> partnerships 1<br />

Assessing higher order competencies 1<br />

AQTF 1<br />

Total 22<br />

In addition, as shown in Figure 5, there were eight key<br />

assessment-related issues for which no resources were<br />

identified. This included key issues impacting on the quality<br />

<strong>of</strong> assessment practice, such as formative assessment, the<br />

use <strong>of</strong> peer, self and negotiated assessment and assessing<br />

international students and students from non-English<br />

speaking backgrounds.<br />

Figure 5 – Key assessment themes not represented in national audit <strong>of</strong><br />

assessment materials<br />

Key assessment theme<br />

Peer, self and negotiated assessment<br />

Formative assessment<br />

On-line assessment<br />

Graded assessment<br />

Simulation<br />

Norm referenced assessment<br />

Off the job assessment<br />

<strong>Assessment</strong> and international / NESB students<br />

Furthermore, as shown in Figure 6, half <strong>of</strong> the resources in<br />

this category were published prior to 2006.<br />

Figure 6 – Key assessment – related resources – year <strong>of</strong> publication<br />

Year <strong>of</strong> publication<br />

Number <strong>of</strong><br />

resources<br />

2008 - 2009 8<br />

2006 - 2007 3<br />

Prior to 2006 11<br />

Total 22<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 24


The twenty-two resources in this category were evaluated<br />

against the four criteria <strong>of</strong> validity, accessibility, usability and<br />

flexibility [see Figure 1]. The individual ratings for each<br />

resource are detailed in Appendix 3.<br />

The ratings show that on a three point scale, with one<br />

indicating clear compliance with the criterion and three<br />

indicating non compliance with the criterion, that two <strong>of</strong> the<br />

resources attained an aggregate score <strong>of</strong> 1.0, seventeen<br />

scored 1.25 and three scored 1.50. Overall this suggests that<br />

the resources are generally <strong>of</strong> high quality in that they:<br />

• Generally comply with the approach to assessment<br />

embodied in the Australian <strong>Quality</strong> Training Framework<br />

and / or Training Packages;<br />

• Are accessible to trainers and assessors;<br />

• Are user friendly;<br />

• Address equity considerations; and<br />

• Are able to be used with a variety <strong>of</strong> VET clients in a<br />

range <strong>of</strong> contexts, including in workplace, institutional<br />

and on line settings.<br />

Nevertheless the evaluation <strong>of</strong> the individual items indicated<br />

that:<br />

• Fourteen <strong>of</strong> the twenty-two resources, while generally<br />

complying with the Australian <strong>Quality</strong> Training<br />

Framework and / or Training Packages do not fully<br />

comply with the current versions <strong>of</strong> these documents<br />

[see Appendix 2]. In most cases, this is due to the fact<br />

that the resources have become dated and there has<br />

been no maintenance strategy to ensure that the<br />

resources are updated to accommodate changes in<br />

assessment practice, the AQTF and / or Training<br />

Packages. A clear example <strong>of</strong> this is the assessment<br />

guides that were developed through the Training<br />

Materials <strong>Assessment</strong> Project by the former Australian<br />

<strong>National</strong> Training Authority and the Department <strong>of</strong><br />

Education, Science and Training in 2001. These guides,<br />

which address matters such as assessment quality<br />

assurance, assessing higher order competencies and<br />

assessing in partnerships, while providing a valuable<br />

resource have not been updated and do not reflect the<br />

changes that have occurred in assessment practice and<br />

the AQTF over the past eight years.<br />

• A number <strong>of</strong> resources have been developed by State<br />

and Territory training authorities in response to local<br />

needs. For example, the Western Australian Department<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 25


<strong>of</strong> Education and Training has developed a series <strong>of</strong><br />

guides for assessors that focus on issues such as<br />

assessment validation and assessing apprenticeships<br />

and traineeships. Similar materials have also been<br />

developed by the Department <strong>of</strong> Education and Training<br />

in Queensland on assessment judgement and the NSW<br />

Department <strong>of</strong> Education and Training on assessment<br />

judgement and assessing generic and employability<br />

skills. While primarily developed for local audiences<br />

these materials have national relevance and should be<br />

made more accessible to trainers and assessors in other<br />

jurisdictions. Even though these materials may be<br />

accessed via the Internet, assessors in other<br />

jurisdictions are <strong>of</strong>ten simply unaware that the materials<br />

exist.<br />

• While most <strong>of</strong> the resources identified in this category<br />

are available either free <strong>of</strong> charge via download from the<br />

Internet or at relatively low cost, there are some items,<br />

such as the tool box on E-learning assessment that is<br />

distributed by TVET Australia, which are relatively<br />

inaccessible due to cost.<br />

In summary, the evaluation <strong>of</strong> the assessment materials in<br />

this category showed that:<br />

1. There is a very limited range <strong>of</strong> up to date, assessment<br />

materials that address the key issues impacting on<br />

quality assessment;<br />

2. Most <strong>of</strong> the existing assessment materials are not<br />

supported by a maintenance strategy and this means<br />

that there is risk that these materials will become<br />

obsolete;<br />

3. A number <strong>of</strong> high quality resources have been<br />

developed by State and Territory training authorities<br />

which should be made available to assessors in other<br />

jurisdictions;<br />

4. The cost <strong>of</strong> some <strong>of</strong> the materials may limit their<br />

accessibility; and<br />

5. There are a number <strong>of</strong> key assessment-related issues<br />

for which there are no suitable, nationally available<br />

support materials. For example, the national audit did not<br />

identify any materials that provide assessors with<br />

current, high quality advice on: peer, self and negotiated<br />

assessment; formative assessment; the use <strong>of</strong><br />

simulation; and the assessment <strong>of</strong> international students<br />

and students from non English speaking backgrounds.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 26


5.3 Industry specific assessment materials<br />

The national audit identified 1,643 industry specific<br />

assessment-related resources across twenty-one industry<br />

areas [see Appendix 4]. These materials included<br />

assessment tools, assessor guides and candidate resources.<br />

The distinguishing feature <strong>of</strong> these materials is that they have<br />

been prepared to address assessment requirements within a<br />

specific industry or occupational area. In many cases, the<br />

materials have been designed to assist with the assessment<br />

<strong>of</strong> a specific unit <strong>of</strong> competency in a Training Package.<br />

Most <strong>of</strong> the materials in this category have been developed<br />

by State and Territory training authorities, particularly New<br />

South Wales, Victoria and Queensland and national Industry<br />

<strong>Skills</strong> <strong>Council</strong>s.<br />

As shown in Figure 7, the assessment materials in this<br />

category are unevenly spread across the twenty-one industry<br />

areas. For example, the audit identified six hundred and<br />

thirteen resources that are designed to support the<br />

assessment process in primary industries. This represents<br />

37% <strong>of</strong> the national stock <strong>of</strong> industry specific assessment<br />

resources. In contrast, less than twenty assessment-related<br />

resources were identified in each <strong>of</strong> the following sectors:<br />

communications, general education and training,<br />

government, health, laboratory operations, pharmaceuticals,<br />

property services, sport and recreation, seafood and water.<br />

The industry areas which appear to be most well serviced in<br />

terms <strong>of</strong> industry specific assessment resources are: primary<br />

industries, business, construction and engineering.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 27


Figure 7: Industry specific assessment resources – number <strong>of</strong> items<br />

Industry area<br />

Number <strong>of</strong> resources<br />

Audit<br />

Sample<br />

Total<br />

Arts and Entertainment 29 5<br />

Automotive 66 4<br />

Business 129 7<br />

Communications 19 2<br />

Community Services 25 5<br />

Construction 100 3<br />

Engineering 95 7<br />

Food processing 31 5<br />

Forest and forest products 92 3<br />

Furnishing 20 4<br />

General education and training 3 2<br />

General manufacturing 42 2<br />

Government 11 4<br />

Health 1 1<br />

Horse 56 1<br />

Hospitality 35 3<br />

Laboratory Operations 14 4<br />

Mining 94 2<br />

Pharmaceuticals 14 1<br />

Primary Industries 613 7<br />

Property Services 3 1<br />

Retail, Wholesale and Personal Services 45 10<br />

Sport and Recreation 8 2<br />

Tourism 45 4<br />

Transport and Distribution 34 7<br />

Seafood 18 2<br />

Water 1 1<br />

1643 99<br />

The analysis <strong>of</strong> the assessment materials in this category is<br />

based on a sample <strong>of</strong> ninety-nine resources [see Figure 7].<br />

The criteria for selecting this sample are outlined in section 4<br />

<strong>of</strong> this report.<br />

As shown in Figure 8, forty-four <strong>of</strong> the ninety-nine [44.4%]<br />

resources in this category were published prior to 2006. This<br />

means that many <strong>of</strong> the resources, such as assessment<br />

instruments for specific units <strong>of</strong> competency, are not based<br />

on the current version <strong>of</strong> either the relevant Training Package<br />

and / or the Australian Qualifications Training Framework.<br />

It also means that many <strong>of</strong> these resources may not be<br />

consistent with current legislation, regulations, codes <strong>of</strong><br />

practice and work practices that apply in the relevant industry<br />

sectors.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 28


Figure 8: Industry specific assessment resources – year <strong>of</strong> publication <strong>of</strong><br />

sample assessment resources<br />

Year <strong>of</strong> publication<br />

Number <strong>of</strong><br />

resources<br />

2008 - 2009 8<br />

2006 - 2007 21<br />

Prior to 2006 44<br />

Not available 29<br />

Total 99<br />

As illustrated in Figure 9 many <strong>of</strong> the assessment materials<br />

in this category ranked low in terms <strong>of</strong> validity. The<br />

evaluation revealed that only eighteen <strong>of</strong> the ninety- nine<br />

resources in the sample [18.1%] were fully compliant with the<br />

current version <strong>of</strong> the relevant Training Package and / or the<br />

Australian Qualifications Training Framework. Sixty items<br />

[60.6%] in the sample were assessed as not appearing to<br />

comply with the approach to assessment embodied in the<br />

current version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework<br />

and / or the assessment provisions in the current version <strong>of</strong><br />

the relevant Training Package and / or unit[s] <strong>of</strong> competency.<br />

Figure 9: Industry specific assessment resources – validity <strong>of</strong> sample<br />

assessment resources<br />

Validity rating scale<br />

Number <strong>of</strong><br />

resources<br />

1. The assessment materials clearly comply with the<br />

18 [18.1%]<br />

approach to assessment embodied in the current version<br />

<strong>of</strong> the Australian <strong>Quality</strong> Training Framework and, where<br />

relevant, comply with the assessment provisions in the<br />

current version <strong>of</strong> the relevant Training Package and / or<br />

unit[s] <strong>of</strong> competency.<br />

2. The assessment materials generally comply with the 21 [21.2%]<br />

approach to assessment embodied in the current version<br />

<strong>of</strong> the Australian <strong>Quality</strong> Training Framework and, where<br />

relevant, generally comply with the assessment<br />

provisions in the current version <strong>of</strong> the relevant Training<br />

Package and / or unit[s] <strong>of</strong> competency.<br />

3. The assessment materials do not appear to comply with 60 [60.6%]<br />

the approach to assessment embodied in the current<br />

version <strong>of</strong> the Australian <strong>Quality</strong> Training Framework and<br />

/ or do not appear to comply with the assessment<br />

provisions in the current version <strong>of</strong> the relevant Training<br />

Package and / or unit[s] <strong>of</strong> competency.<br />

Total 99 [99.9%]<br />

Overall the assessment materials in this category rated lower<br />

than the materials in the other two categories. The individual<br />

ratings for each resource are detailed in Appendix 4.<br />

As illustrated in Figure 10, none <strong>of</strong> the ninety-nine resources<br />

attained an aggregate score <strong>of</strong> 1.0, twenty-six scored less<br />

than 2.0 and seventy -three scored 2.0 or over, with ten<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 29


scoring 2.5. Overall this suggests that the resources in this<br />

category rate poorly in terms <strong>of</strong> quality. This is primarily<br />

because many <strong>of</strong> the materials are dated and do not comply<br />

with the current version <strong>of</strong> the relevant Training Package and<br />

/ or the Australian <strong>Quality</strong> Training Framework. In addition,<br />

the accessibility <strong>of</strong> many <strong>of</strong> the materials is limited because<br />

they have been developed by State and Territory training<br />

authorities and may not be known to assessors in other<br />

jurisdictions. Also a number <strong>of</strong> the materials are only<br />

available on a commercial basis, such as the VETASSESS<br />

materials, which limits their accessibility to some users.<br />

On the positive side most <strong>of</strong> the materials in this category<br />

were assessed as being:<br />

• Generally well designed; and<br />

• Able to be used with a variety <strong>of</strong> VET clients in a range <br />

<strong>of</strong> contexts, including in workplace, institutional and on<br />

line settings.<br />

Figure 10: Industry specific assessment resources – overall rating <strong>of</strong> sample<br />

assessment resources<br />

Rating <strong>of</strong> assessment resources<br />

Number <strong>of</strong><br />

resources<br />

1.00 0<br />

1.25 14<br />

1.50 4<br />

1.75 8<br />

2.00 22<br />

2.25 41<br />

2.50 10<br />

2.75 0<br />

3.00 0<br />

Total 99<br />

While the overall picture suggests that the assessment<br />

materials in this category do not rate well in terms <strong>of</strong> validity,<br />

there were examples <strong>of</strong> high quality, up to date materials in<br />

this category. The key examples were the assessment<br />

materials developed by ForestWorks the Industry <strong>Skills</strong><br />

<strong>Council</strong> for the forest and forest products sector, MINTRAC,<br />

the industry advisory group for the meat industry and the<br />

<strong>Skills</strong> First RPL resources developed by the Department <strong>of</strong><br />

Education and Training in Queensland. Each <strong>of</strong> these sets <strong>of</strong><br />

materials scored highly in the overall ranking and particularly<br />

in relation to validity.<br />

The <strong>Skills</strong> First materials are relatively new and in most<br />

cases are based on the latest version <strong>of</strong> the Training<br />

Package. The challenge for these materials will be the<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 30


Department <strong>of</strong> Education and Training’s capacity to maintain<br />

the materials.<br />

The distinguishing feature <strong>of</strong> the materials developed by both<br />

ForestWorks and MINTRAC is the active role that these<br />

organisations have taken in developing and maintaining the<br />

assessment materials. In both cases, the organisations have<br />

produced a range <strong>of</strong> low cost, high quality assessment<br />

materials that:<br />

• Are benchmarked against the relevant standards;<br />

• Use assessment methods that are appropriate for the<br />

industry and the client group;<br />

• Are endorsed by the key industry parties; and<br />

• Are maintained by the host organization.<br />

A further issue that emerged in the evaluation <strong>of</strong> this<br />

category <strong>of</strong> assessment materials is the lack <strong>of</strong> innovation in<br />

assessment materials design. All too <strong>of</strong>ten the assessment<br />

materials, especially those developed for particular units <strong>of</strong><br />

competency, are based on fairly conventional evidence<br />

gathering techniques, such as observation checklists, lists <strong>of</strong><br />

oral questions and third party reports. Further, the materials<br />

<strong>of</strong>ten lack advice on how to make the assessment judgement<br />

or decision once the assessment evidence has been<br />

collected.<br />

Finally, many <strong>of</strong> the assessment resources in this and the<br />

other two categories, have been appraised against the<br />

quality principles for Training Package Support Materials and<br />

carry the national tick. Given that 60% <strong>of</strong> the sample <strong>of</strong> the<br />

materials in this category was assessed as not appearing to<br />

comply with the current version <strong>of</strong> the Training Package and /<br />

or the AQTF, it is questionable whether the existing appraisal<br />

process for assessment-related support materials is<br />

adequate.<br />

In summary, the evaluation <strong>of</strong> the assessment materials in<br />

this category showed that:<br />

1. There is an uneven spread <strong>of</strong> assessment materials<br />

across key the twenty-one industry areas. Some areas,<br />

such as primary industries are particularly well served,<br />

whereas in others, such as property services, there are<br />

very few resources;<br />

2. Many <strong>of</strong> the materials are not based on the current<br />

version <strong>of</strong> the relevant Training Package;<br />

3. There is a lack <strong>of</strong> innovation in training materials design;<br />

4. Many <strong>of</strong> the materials are State or Territory publications.<br />

This limits their accessibility and consideration should be<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 31


given to making them more readily available to a wider<br />

national audience; and<br />

5. In most cases the materials are not supported by a<br />

systematic maintenance process.<br />

5.4 Summary <strong>of</strong> findings <strong>of</strong> the evaluation <strong>of</strong> the<br />

national stock <strong>of</strong> assessment materials<br />

As noted earlier in this report, the national audit <strong>of</strong><br />

assessment materials identified 1,705 items. The evaluation<br />

<strong>of</strong> these materials revealed that:<br />

1. The national stock <strong>of</strong> assessment related resources is<br />

highly dispersed across a range <strong>of</strong> national and State /<br />

Territory agencies. This makes it difficult for users to<br />

locate assessment-related support materials.<br />

2. There is a good range <strong>of</strong> high quality, up to date<br />

materials dealing with the general needs <strong>of</strong> assessors.<br />

3. There is a very limited range <strong>of</strong> up to date, assessment<br />

materials that address the key current and emerging<br />

issues impacting on quality assessment. For example,<br />

the national audit did not identify any materials that<br />

provide assessors with current, high quality advice on:<br />

• Peer, self and negotiated assessment;<br />

• Formative assessment;<br />

• The use <strong>of</strong> simulation;<br />

• <strong>Assessment</strong> moderation; or<br />

• The assessment <strong>of</strong> international students and students<br />

from non-English speaking backgrounds.<br />

4. There is an uneven spread <strong>of</strong> industry-specific<br />

assessment materials across the key industry areas.<br />

Some areas, such as primary industries are particularly<br />

well served, whereas others, such as property services,<br />

have very few industry-specific assessment materials.<br />

The evaluation <strong>of</strong> the sample <strong>of</strong> assessment materials<br />

also revealed that there are significant quality issues<br />

impacting on this category <strong>of</strong> materials. For example,<br />

sixty per cent <strong>of</strong> the assessment materials are not based<br />

on the current version <strong>of</strong> the relevant Training Package.<br />

In addition, there is a lack <strong>of</strong> innovation in assessment<br />

materials design in this category.<br />

5. Many <strong>of</strong> the assessment materials examined in this<br />

project are State or Territory publications. This limits<br />

their accessibility. Consideration should be given to<br />

making them more readily available to a wider national<br />

audience.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 32


6. Most <strong>of</strong> the assessment materials examined in this<br />

project are not supported by a systematic maintenance<br />

process. This means that the national stock <strong>of</strong><br />

assessment materials is at risk <strong>of</strong> becoming obsolete.<br />

7. Many <strong>of</strong> the industry specific assessment materials have<br />

been appraised against the quality principles for Training<br />

Package Support Materials and carry the national tick<br />

even though they:<br />

• Are not supported by a maintenance strategy;<br />

• May not comply with the current version <strong>of</strong> the Training<br />

Package; or<br />

• May not represent innovative assessment materials<br />

design. This suggests that the current approach for<br />

appraising and giving national recognition to assessment<br />

related support materials needs to be reviewed.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 33


6. Strategy to address the key issues<br />

impacting on the national stock <strong>of</strong><br />

assessment support materials<br />

The ensuing section <strong>of</strong> this paper sets out a strategy for<br />

addressing key issues impacting on the national stock <strong>of</strong><br />

assessment support materials. This strategy is designed to:<br />

1. Improve awareness <strong>of</strong> and access to the national stock<br />

<strong>of</strong> assessment materials;<br />

2. Improve the quality, range and availability <strong>of</strong> industry<br />

specific assessment materials; and<br />

3. Provide support materials that address the current and<br />

emerging issues impacting on the quality <strong>of</strong> assessment<br />

practice.<br />

6.1 Improve awareness <strong>of</strong> and access to the<br />

national stock <strong>of</strong> assessment materials<br />

The national audit <strong>of</strong> assessment-related resources showed<br />

that there is a large national stock <strong>of</strong> assessment materials<br />

and that within this there is:<br />

• A significant collection <strong>of</strong> high quality, up to date<br />

materials dealing with the general needs <strong>of</strong> assessors, in<br />

areas such as the assessment processes, recognition <strong>of</strong><br />

prior learning and assessment tool design;<br />

• A limited but nevertheless high quality selection <strong>of</strong><br />

materials dealing with key assessment related issues<br />

such as: assessing in apprenticeship and traineeship<br />

programs, assessing higher order competencies,<br />

assessment quality assurance, assessment validation,<br />

assessment judgement, assessor networks, and<br />

assessing generic / employability skills; and<br />

• A large number <strong>of</strong> materials, especially industry specific<br />

materials, that are out <strong>of</strong> date and do not meet the<br />

requirements <strong>of</strong> the current version <strong>of</strong> the relevant<br />

Training Package and / or Australian <strong>Quality</strong> Training<br />

Framework.<br />

The problem for assessors is that:<br />

• There is no single location where all these materials can<br />

be identified, previewed and accessed;<br />

• It is difficult to establish the currency <strong>of</strong> the materials;<br />

and<br />

• There is limited advice on the quality <strong>of</strong> the materials or<br />

how they may be used.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 34


This makes it very difficult for assessors and other users to<br />

identify, access and use these materials.<br />

There is a pressing need for a national clearinghouse for<br />

assessment-related support materials that provides<br />

assessors and other users with access to a comprehensive<br />

range <strong>of</strong> free and commercial assessment materials. The<br />

clearinghouse should provide:<br />

1. A discovery function that enables assessors to identify<br />

existing high quality assessment materials;<br />

2. A marketing function that promotes existing high<br />

quality assessment materials to potential users;<br />

3. A pr<strong>of</strong>essional development function that informs<br />

assessors about the ways in which the national stock <strong>of</strong><br />

assessment materials may be used and / or customised;<br />

and<br />

4. A maintenance function that monitors assessment<br />

materials held in the clearinghouse and informs<br />

copyright owners about the relevance <strong>of</strong> their materials<br />

and the need for them to be updated or revised.<br />

Specifically the clearinghouse should:<br />

• Enable users to identify and preview the national stock <strong>of</strong><br />

assessment-related support materials, and if required,<br />

obtain copies which are licensed for use via free <strong>of</strong><br />

charge download or immediate electronic purchase and<br />

delivery;<br />

• Actively promote the national stock <strong>of</strong> assessmentrelated<br />

support materials to users including industry,<br />

assessors and RTOs;<br />

• Conduct, in conjunction with the Industry <strong>Skills</strong> <strong>Council</strong>s,<br />

industry organisations and State / Territory VET<br />

agencies, pr<strong>of</strong>essional education programs for<br />

assessors on the national stock <strong>of</strong> assessment-related<br />

support materials;<br />

• Actively engage with the owners <strong>of</strong> materials promoted<br />

through the clearinghouse to ensure that the<br />

assessment-related support materials are maintained or<br />

withdrawn from the clearinghouse;<br />

• Provide assessors and other users with clear information<br />

on the quality <strong>of</strong> the assessment related resource<br />

materials; and<br />

• Provide advice or a referral service for assessors and<br />

other users seeking information on the national stock <strong>of</strong><br />

assessment-related support materials.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 35


This function is highly compatible with the core role <strong>of</strong> TVET<br />

Australia which was initially conceived <strong>of</strong> as a national, one<br />

stop shop for VET products and services. However this type<br />

<strong>of</strong> service could also be facilitated through the <strong>National</strong><br />

Training Information Service or the Education Network<br />

Australia [Edna].<br />

Recommendation 1<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> request TVET Australia to <br />

establish a comprehensive, national clearinghouse for free<br />

and commercial assessment-related support materials that:<br />

• Enables users to identify and preview the national stock<br />

<strong>of</strong> assessment-related support materials, and if required,<br />

obtain copies which are licensed for use via free <strong>of</strong><br />

charge download or immediate electronic purchase and<br />

delivery;<br />

• Actively promotes the national stock <strong>of</strong> assessment-<br />

related support materials to users including industry,<br />

assessors and RTOs;<br />

• Conducts, in conjunction with the Industry <strong>Skills</strong> <strong>Council</strong>s,<br />

industry organisations and State / Territory VET<br />

agencies, pr<strong>of</strong>essional education programs for assessors<br />

on the national stock <strong>of</strong> assessment-related support<br />

materials;<br />

• Actively engages with owners <strong>of</strong> materials promoted <br />

through the clearinghouse to ensure that the<br />

assessment-related support materials are maintained or <br />

withdrawn from the clearinghouse;<br />

• Provides assessors and other users with clear <br />

information on the quality <strong>of</strong> the assessment related<br />

support materials held in the clearinghouse;<br />

• Provides advice or a referral service for assessors and <br />

other users seeking information on the national stock <strong>of</strong><br />

assessment-related support materials.<br />

6.2 Improve the quality, range and availability <strong>of</strong><br />

industry specific assessment materials<br />

The national audit <strong>of</strong> assessment-related resources identified<br />

over seventeen hundred industry specific assessment<br />

resources, including assessment instruments, assessor<br />

guides and candidates materials.<br />

However the evaluation <strong>of</strong> these materials revealed that:<br />

• Many <strong>of</strong> the materials do not comply with the current<br />

version <strong>of</strong> the Training Package;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 36


• The materials are <strong>of</strong>ten developed by State and<br />

Territory agencies and are not well known by assessors<br />

working in other jurisdictions;<br />

• There is a lack <strong>of</strong> good quality assessment materials in<br />

many industry sectors;<br />

• The current national process for quality assuring<br />

assessment-related support materials is inadequate;<br />

• There are no systematic arrangements for the<br />

maintenance <strong>of</strong> these materials; and<br />

• There is a lack <strong>of</strong> innovation in assessment materials<br />

design.<br />

In response to this situation it is recommended that the<br />

<strong>National</strong> <strong>Quality</strong> <strong>Council</strong> take steps to:<br />

1. Develop a quality assurance process for assessmentrelated<br />

support materials for which national endorsement<br />

and inclusion in the proposed national clearinghouse is<br />

sought;<br />

2. Transfer responsibility for the quality assurance <strong>of</strong><br />

assessment-related support materials to the relevant<br />

Industry <strong>Skills</strong> <strong>Council</strong>s;<br />

3. Fund the Industry <strong>Skills</strong> <strong>Council</strong> to undertake the design,<br />

development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />

assessment-related support materials for each endorsed<br />

Training Package in their area <strong>of</strong> coverage and to<br />

actively promote these materials on a national basis, in<br />

collaboration with relevant national and State/ Territory<br />

agencies.<br />

It is envisaged that the Industry <strong>Skills</strong> <strong>Council</strong>s and the<br />

proposed national clearinghouse [see Recommendation 1]<br />

would collaborate to provide an integrated discovery service<br />

for assessment related support materials. Under this<br />

arrangement the Industry <strong>Skills</strong> <strong>Council</strong> would have<br />

responsibility for industry specific materials, whereas the<br />

clearinghouse would focus on promoting cross industry<br />

assessment support materials.<br />

Recommendation 2<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> develop a quality<br />

assurance process for assessment-related support materials<br />

for which national endorsement and inclusion in the proposed<br />

national clearinghouse is sought which:<br />

1. Ensures that nationally recognised assessment-related<br />

support materials comply with the principles <strong>of</strong> validity,<br />

flexibility, usability, equity and accessibility;<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 37


2. Requires developers <strong>of</strong> assessment-related support<br />

materials to engage industry in the design, development<br />

and evaluation <strong>of</strong> the assessment materials;<br />

3. Requires developers to implement an active<br />

maintenance process to ensure the currency and<br />

relevance <strong>of</strong> the assessment materials; and<br />

4. Fosters innovation in assessment materials design.<br />

Recommendation 3<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> transfer responsibility for<br />

the quality assurance <strong>of</strong> assessment-related support<br />

materials, within nationally agreed guidelines as established<br />

through Recommendation 2, to the relevant Industry <strong>Skills</strong><br />

<strong>Council</strong>s.<br />

Recommendation 4<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support the design and<br />

implementation <strong>of</strong> a capability building program to ensure<br />

that Industry <strong>Skills</strong> <strong>Council</strong>s have the capability to manage<br />

the quality assurance <strong>of</strong> assessment-related support<br />

materials.<br />

Recommendation 5<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> support each Industry <strong>Skills</strong><br />

<strong>Council</strong> being funded to:<br />

1. Undertake, in conjunction with industry, the design,<br />

development and maintenance <strong>of</strong> an exemplar set <strong>of</strong><br />

assessment-related support materials for each endorsed<br />

Training Package in their area <strong>of</strong> coverage;<br />

2. Actively promote these exemplar assessment-related<br />

support materials on a national basis in conjunction with<br />

industry and national, State and Territory VET agencies;<br />

and<br />

3. Establish a national pr<strong>of</strong>essional development strategy,<br />

in conjunction with industry and national, State and<br />

Territory VET agencies, to build assessor capability in<br />

the use <strong>of</strong> the exemplar assessment – related support<br />

materials.<br />

6.3 Provide support materials that address the<br />

current and emerging issues impacting on the<br />

quality <strong>of</strong> assessment practice<br />

The national audit <strong>of</strong> assessment related support materials<br />

identified a range <strong>of</strong> key issues impacting on the quality <strong>of</strong><br />

assessment practice. The evaluation <strong>of</strong> the national stock <strong>of</strong><br />

assessment-related support materials showed that:<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 38


• There is a very limited range <strong>of</strong> up to date, assessment<br />

materials that address these issues; and<br />

• There are a number <strong>of</strong> key assessment-related issues<br />

for which there are no suitable, nationally available<br />

support materials. For example, the national audit did not<br />

identify any materials that provide assessors with<br />

current, high quality advice on: peer, self and negotiated<br />

assessment; formative assessment; the use <strong>of</strong><br />

simulation; and the assessment <strong>of</strong> international students<br />

and students from non English speaking backgrounds.<br />

This suggests that there is a need to develop support<br />

materials and assessor capability in relation to:<br />

• The use <strong>of</strong> formative assessment or assessment for<br />

learning approaches to enhance competency<br />

development;<br />

• Improving the quality <strong>of</strong> assessor judgement in the<br />

assessment process;<br />

• Assessing in workplace settings, including identifying<br />

and addressing the skill development needs <strong>of</strong><br />

employees, supervisors, human resource practitioners<br />

and other workplace personnel who are engaged in<br />

providing training and assessment functions, which may<br />

only form part <strong>of</strong> their work role;<br />

• The use <strong>of</strong> peer, self and negotiated assessment to<br />

improve competency development;<br />

• Contextualising nationally recognised assessment<br />

resources for use in enterprise based training and<br />

assessment systems;<br />

• The use <strong>of</strong> simulation in competency based<br />

assessment;<br />

• <strong>Assessment</strong> <strong>of</strong> higher order competencies;<br />

• Assessing in international contexts – assessment <strong>of</strong><br />

international students in Australian and international<br />

settings;<br />

• The integrated assessment <strong>of</strong> skill sets;<br />

• Cost effective approaches to assessment moderation;<br />

• <strong>Assessment</strong> in regulated occupations / industries; and<br />

• Competency based assessment in online learning<br />

environments.<br />

Recommendation 6<br />

That the <strong>National</strong> <strong>Quality</strong> <strong>Council</strong> sponsor a national<br />

assessment initiative to develop support materials and foster<br />

assessor capability in relation to the key issues impacting on<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 39


the quality <strong>of</strong> assessment practice. Specifically the national<br />

assessment initiative should:<br />

1. Commission an integrated series <strong>of</strong> projects designed to<br />

develop support materials and assessor capability in<br />

relation to:<br />

The use <strong>of</strong> formative assessment or assessment<br />

for learning approaches to enhance competency<br />

development;<br />

Improving the quality <strong>of</strong> assessor judgement in the<br />

assessment process;<br />

Assessing in workplace settings, including<br />

identifying and addressing the skill development<br />

needs <strong>of</strong> employees, supervisors, human resource<br />

practitioners and other workplace personnel who<br />

are engaged in providing training and assessment<br />

functions;<br />

The use <strong>of</strong> peer, self and negotiated assessment<br />

to improve competency development;<br />

Contextualising nationally recognised assessment<br />

resources for use in enterprise based training and<br />

assessment systems;<br />

The use <strong>of</strong> simulation in competency based<br />

assessment;<br />

<strong>Assessment</strong> <strong>of</strong> higher order competencies;<br />

Assessing in international contexts – assessment<br />

<strong>of</strong> international students in Australian and<br />

international settings;<br />

The integrated assessment <strong>of</strong> skill sets;<br />

Cost effective approaches to assessment<br />

moderation;<br />

<strong>Assessment</strong> in regulated occupations / industries;<br />

and<br />

Competency based assessment in online learning<br />

environments.<br />

2. Establish a national implementation program, in<br />

conjunction with the Industry <strong>Skills</strong> <strong>Council</strong>s and national,<br />

State and Territory VET agencies, to ensure that all<br />

assessors in private, public and enterprise providers are<br />

provided with training and / or information on:<br />

• The issues addressed in the materials and<br />

• How to effectively use the materials with different VET<br />

clients and in varying VET contexts.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 40


Appendix 1 – Participants in consultations<br />

Name<br />

Mary Hicks<br />

Michelle Bissett<br />

Megan Lilly<br />

David Magee<br />

Organisation<br />

Australian Chamber <strong>of</strong> Commerce and<br />

Industry<br />

Australian <strong>Council</strong> <strong>of</strong> Trade Unions<br />

Australian Industry Group<br />

Construction and Property Services<br />

Industry <strong>Skills</strong> <strong>Council</strong><br />

Peter Skippington Department <strong>of</strong> Education and Training –<br />

Queensland<br />

Brenda Micale Department <strong>of</strong> Education and Training –<br />

Western Australia<br />

Elizabeth Owers<br />

Margaret Thornton<br />

Department <strong>of</strong> Further Education,<br />

Employment, Science and Technology –<br />

South Australia.<br />

Department <strong>of</strong> Further Education,<br />

Employment, Science and Technology –<br />

South Australia.<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2<br />

41


Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

<strong>Assessment</strong> process<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide1 -<br />

Training Package assessment materials kit<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Learner guide TAA Training Package Support Materials : Contribute to<br />

Print 2008 IBSA<br />

assessment TAASS301B<br />

www.ibsa.org.au<br />

Learner guide TAA Training Package Support Materials : Plan and organize Print 2005 IBSA<br />

assessment TAAASS401A<br />

www.ibsa.org.au<br />

Learner guide TAA Training Package Support Materials : Assess<br />

Print 2005 IBSA<br />

competence TAASS402A<br />

www.ibsa.org.au<br />

Learner guide Shea series : TAAASS301B Contribute to assessment Print 2008 TVET Australia<br />

www.atpl.net.au<br />

Learner guide Shea series : TAAASS401C Plan and organise assessment Print 2008 TVET Australia<br />

www.atpl.net.au<br />

Learner guide Shea series : TAAASS402C Assess competence Print 2008 TVET Australia<br />

www.atpl.net.au<br />

Reference Guidelines for assessing competence in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Reference Troubleshooting guide – <strong>Assessment</strong> in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Toolbox Training and <strong>Assessment</strong> Toolbox 607 v 2 Toolbox 2007 TVET Australia<br />

www.atpl.net.au<br />

Video <strong>Assessment</strong> case study video – Stone masonry Video on 2008 Department <strong>of</strong> Education, Training and the Arts<br />

line<br />

http://www.vetpd.qld.gov.au/teaching-learning-and-<br />

Video <strong>Assessment</strong> case study video - Aquaculture Video on<br />

line<br />

<strong>Assessment</strong> system management<br />

Learner guide<br />

Learner guide<br />

Learner guide<br />

TAA Training Package Support Materials : Lead and<br />

coordinate assessment systems and services<br />

TAA Training Package Support Materials : Develop training<br />

and or assessment organizational policies and procedures<br />

TAA Training Package Support Materials : Lead and conduct<br />

training , assessment evaluations<br />

assessment/resources/case-study/index.html<br />

2008 Department <strong>of</strong> Education, Training and the Arts<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/case-study/index.html<br />

Print 2009 IBSA<br />

www.ibsa.org.au<br />

Print 2009 IBSA<br />

www.ibsa.org.au<br />

Print 2009 IBSA<br />

www.ibsa.org.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2 1 1 1 1.25<br />

1 1 1 1 1.00<br />

2 1 1 1 1.25<br />

2 1 1 1 1.25<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

2 2 2 2 2.00<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

1 1 1 1 1.00<br />

1 1 1 1 1.00<br />

1 1 1 1 1.00<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 42


Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />

<strong>Assessment</strong> materials<br />

RATING<br />

Type <strong>of</strong> resource Title Format Year Source<br />

<strong>Assessment</strong> tool design<br />

Exemplars and<br />

templates<br />

<strong>Assessment</strong> templates and exemplars:<br />

<strong>Assessment</strong> Plan Template<br />

<strong>Assessment</strong> Task Template<br />

Questions Single Unit<br />

Questions Cluster <strong>of</strong> Units<br />

Observations Single Unit<br />

Observations Cluster <strong>of</strong> Units<br />

Assignment Cover Sheet<br />

<strong>Assessment</strong> Record Individual Student Template<br />

Student Feedback Form<br />

<strong>Assessment</strong> Plan Exemplar<br />

<strong>Assessment</strong> Task Exemplar<br />

Oral Questioning Single Unit Exemplar<br />

Written Questions Single Unit Exemplar<br />

Marking Guide Written Questions Single Unit Exemplar<br />

Written Questions Cluster Unit Exemplar<br />

Observation/Demonstration Single Unit Exemplar<br />

<strong>Assessment</strong> Record Individual Student Exemplar<br />

TAA Training Package Support Materials : Develop<br />

assessment tools TAAASS403A<br />

Print 2009 Charles Darwin University<br />

www.cdu.edu.au/aqpvet/vetresources.html#Assess<br />

mentandrecognition<br />

Learner guide<br />

Print 2005 IBSA<br />

www.ibsa.org.au<br />

Learner guide Shea series : TAAASS403B Develop assessment tools Print 2008 TVET Australia<br />

www.atpl.net.au<br />

Reference Designing assessment tools for quality outcomes in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Validity Accessibility Usability Flexibility Aggregate<br />

1 2 1 1 1.25<br />

2 1 1 1 1.25<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 43


Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />

<strong>Assessment</strong> materials<br />

RATING<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Assessor skills<br />

Presentation<br />

RPL<br />

Effective Questioning Techniques and Training Package<br />

Overview for <strong>Skills</strong> Stores -<br />

Brian Spencer presentation<br />

Resume Example 1<br />

Resume Example 2.<br />

Resume Example 3<br />

On line 2008 TAFE Development centre – Victoria<br />

http://www.tafecentre.vic.edu.au/RPL.php<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2 2 1 1 1.50<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide3 - Print 2001 TVET Australia<br />

2 1 1 1 1.25<br />

Recognition resource<br />

www.atpl.net.au<br />

Conference<br />

Recognition <strong>of</strong> Prior Learning – Recognition <strong>of</strong> Progress Print 2008 http://www.icvet.tafensw.edu.au/focus/documents/r 2 2 1 1 1.50<br />

proceedings<br />

pl-making-connections-forum-report.pdf<br />

Manual RPL resource kit On line 2008 TAFE Development Centre – Victoria<br />

2 2 1 1 1.50<br />

http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />

hp<br />

Manual<br />

Recognition <strong>of</strong> prior learning resources:<br />

Print 2008 NSW Department <strong>of</strong> Education and Training / 1 2 2 2 1.25<br />

The RTO Guide<br />

The Candidate Guide<br />

The Assessor Guide<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au/rpl-resources.html<br />

Online RPL Online Network Online 2007 http://rplnetworkonline.wikispaces.com/ 2 2 1 1 1.50<br />

Reference<br />

Recognition <strong>of</strong> Prior Learning: An <strong>Assessment</strong> Resource for<br />

VET Practitioners<br />

network<br />

Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

1 2 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 44


Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />

<strong>Assessment</strong> materials<br />

RATING<br />

Type <strong>of</strong> resource Title Format Year Source<br />

RPL [continued]<br />

Reference<br />

RPL Fact Sheets<br />

RPL Fact Sheet 1 - Coaches and Mentors<br />

RPL Fact Sheet 2 - What is RPLRPL Fact Sheet 3A - RPL<br />

Mythbusters<br />

RPL Fact Sheet 3B - Mythbusters for VET Providers<br />

RPL Fact Sheet 4 - The Individual<br />

RPL Fact Sheet 5 - The Assessor<br />

RPL Fact Sheet 6 - The Enterprise<br />

RPL Fact sheet 7 - The VET Provider<br />

RPL Fact Sheet 8 - Resources<br />

Print 2008 Department <strong>of</strong> Further Education, Employment,<br />

Science and Technology<br />

http://www.training.sa.gov.au/OVETorgs/pages/def<br />

ault/rpl/<br />

Reference Recognition <strong>of</strong> prior learning – your first step Print 2004 Department <strong>of</strong> Education, Training and the Arts and<br />

Department <strong>of</strong> Education, Science and Training<br />

http://www.training.sa.gov.au/OVETorgs/files/links/r<br />

pl-pdfresource.pdf<br />

www.resourcegenerator.gov.au<br />

Reference<br />

Reference<br />

<strong>Skills</strong> Recognition Information Guides<br />

Assessor Guide to RPL<br />

Have Your <strong>Skills</strong> Recognised: Candidate Guide<br />

Recognition <strong>of</strong> Prior Learning: Resource Catalogue<br />

Recognition <strong>of</strong> prior learning materials:<br />

RPL Book (.doc) (Record <strong>of</strong> Evidence)<br />

RPL Staff Guide (.doc)<br />

Guide for Applicants Template(.doc)<br />

Guide for Applicants Exemplar (.doc)<br />

RPL Book Exemplar (.doc)<br />

Mapping Principles Guidelines and Pr<strong>of</strong>orma (.doc) - CDU<br />

HE units to VET units<br />

Print 2008 www.skillsonline.net.au/iesprplresources/rplassessor.pdf<br />

Print 2009 Charles Darwin University<br />

www.cdu.edu.au/aqpvet/vetresources.html#Assess<br />

mentandrecognition<br />

Research report RPL - Done Well in VET Print 2006 Reframing the Future<br />

www.reframingthefuture.net/docs/2007/Publications<br />

/3EVP-RPL-Done-Well-1mar07.pdf<br />

Research report<br />

Research report<br />

Valuing recognition <strong>of</strong> prior learning: Selected case studies <strong>of</strong><br />

Australian private providers <strong>of</strong> training<br />

Recognition <strong>of</strong> prior learning in the vocational education and<br />

training sector<br />

Print 2004 NCVER<br />

http://www.ncver.edu.au/publications/1473.html<br />

Print 2003 NCVER<br />

http://www.ncver.edu.au/research/commercial/op28<br />

7.pdf<br />

Validity Accessibility Usability Flexibility Aggregate<br />

1 2 1 1 1.25<br />

2 2 1 1 1.50<br />

1 2 1 1 1.25<br />

2 2 1 1 1.50<br />

2 2 1 1 1.50<br />

2 2 1 1 1.50<br />

2 2 1 1 1.50<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 45


Appendix 2- Rating <strong>of</strong> assessment materials that address the general needs <strong>of</strong> assessors [continued]<br />

<strong>Assessment</strong> materials<br />

RATING<br />

Type <strong>of</strong> resource Title Format Year Source<br />

RPL [continued]<br />

Self evaluation<br />

tool<br />

Self evaluation tool<br />

Online<br />

self<br />

assess<br />

ment<br />

tool<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2008 http://www.skillsrecognition.nsw.gov.au/ 1 2 1 1 1.25<br />

Toolbox The Training and <strong>Assessment</strong> RPL Guide Toolbox 2005 TVET Australia 2 2 1 1 1.50<br />

Video Recognition <strong>of</strong> Prior Learning - Promotional Movie Video 2008 TAFE SA Production House<br />

1 2 1 1 1.25<br />

www.icvet.tafensw.edu.au/resources/rpl-video.htm<br />

Video RPL: Can we do it better? - trades event - 18 July 2008 On line 2008 TAFE Development Centre – Victoria<br />

http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />

hp<br />

2 2 1 1 1.50<br />

Presentation RPL best practice - An auditor’s perspective On line 2008 TAFE Development Centre – Victoria<br />

http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />

hp<br />

Presentation<br />

Exemplars and<br />

templates<br />

RPL Overview for Administrators<br />

RPL Introduction slides presentation<br />

<strong>Skills</strong> Store presentation<br />

RPL Overview presentation<br />

On line 2008 TAFE Development Centre – Victoria<br />

http://www.tafecentre.vic.edu.au/RPLevents2007.p<br />

hp<br />

RPL assessor kit template Print 2009 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

2 2 1 1 1.50<br />

2 2 1 1 1.50<br />

1 2 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 46


Appendix 3- Rating <strong>of</strong> assessment materials that address specific assessment related issues<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Apprenticeships and traineeship and assessment<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide 5 -<br />

Candidate's Kit: Guide to assessment in New Apprenticeships<br />

Learner guide TAA Training Package Support Materials : Coordinate training<br />

and / or assessment arrangements for apprentice /<br />

traineeships<br />

Reference<br />

Apprenticeships and traineeships – good practice guide for<br />

Registered Training Organisations<br />

AQTF<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

Print 2001 TVET Australia<br />

2 1 1 1 1.25<br />

www.atpl.net.au<br />

Print 2009 IBSA<br />

www.ibsa.org.au 1 1 1 1 1.00<br />

Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Reference The AQTF at Work Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Assessing generic / employability skills<br />

Assessor guide Working Well: Developing Employability <strong>Skills</strong> - Assessor Print 2006 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

DVD Working Well: Employability <strong>Skills</strong> in Action - DVD DVD 2008 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Assessing higher order competencies<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide2 -<br />

Assessing competencies in higher qualifications<br />

<strong>Assessment</strong> judgement<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Research report Maximising confidence in assessment decision-making:<br />

Current approaches and future strategies<br />

Print 2004 NCVER<br />

http://www.ncver.edu.au/research/proj/nr9029-2.pdf<br />

Research report Confident RPL assessors – compliance to creativity Print 2008 Department <strong>of</strong> Education, Training and the Arts<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/tla-research.html<br />

Reference Pr<strong>of</strong>essional judgment in VET Print 2006 Reframing the Future<br />

www.reframingthefuture.net<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

2 2 1 1 1.50<br />

2 2 1 1 1.50<br />

2 1 1 1 1.25<br />

2 1 1 1 1.25<br />

1 2 1 1 1.25<br />

2 1 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 47


Appendix 3- Rating <strong>of</strong> assessment materials that address specific assessment related issues [continued]<br />

<strong>Assessment</strong> materials<br />

RATING<br />

Type <strong>of</strong> resource Title Format Year Source<br />

<strong>Assessment</strong> partnerships<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide7 -<br />

<strong>Assessment</strong> using partnership arrangements<br />

<strong>Assessment</strong> quality assurance<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide8 -<br />

Strategies for ensuring consistency in assessment<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide10 -<br />

<strong>Quality</strong> assurance guide for assessment<br />

<strong>Assessment</strong> validation<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Learner Guide TAA Training Package Support Materials: Participate in<br />

assessment validation TAAASS404A<br />

Print 2005 IBSA<br />

www.ibsa.org.au<br />

Learner guide Shea series : TAAASS404B Participate in assessment<br />

Print 2008 TVET Australia<br />

validation<br />

www.atpl.net.au<br />

Reference A guide to continuous improvement <strong>of</strong> assessment in VET Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Assessor networks<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide9 -<br />

Networking for assessors<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Reference Assessor Networks in Action Print 2004 Reframing the Future<br />

www.reframingthefuture.net<br />

Assessor training<br />

Assessor manual<br />

E learning / assessment<br />

Training Package <strong>Assessment</strong> Materials Project: Guide4 - Kit<br />

to support assessor training<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Toolbox Training and <strong>Assessment</strong> E-learning Electives Toolbox 808 v2 Toolbox 2007 TVET Australia<br />

www.atpl.net.au<br />

Reasonable adjustment<br />

Reference<br />

Reasonable adjustment : A practical guide to reasonable<br />

adjustment in assessment <strong>of</strong> candidates with disability in VET<br />

Print 2008 Western Australian Department <strong>of</strong> Education and<br />

Training<br />

http://vetinfonet.det.wa.edu.au/progDev/resources<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2 1 1 1 1.25<br />

2 1 1 1 1.25<br />

2 1 1 1 1.25<br />

1 1 1 1 1.00<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

2 1 1 1 1.25<br />

2 1 1 1 1.25<br />

2 1 1 1 1.25<br />

2 2 1 1 1.50<br />

1 2 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 48


Appendix 3- Rating <strong>of</strong> assessment materials that address specific assessment related issues [continued]<br />

<strong>Assessment</strong> materials<br />

RATING<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Workplace assessment<br />

Assessor manual Training Package <strong>Assessment</strong> Materials Project: Guide 6 -<br />

<strong>Assessment</strong> approaches for small workplaces<br />

Print 2001 TVET Australia<br />

www.atpl.net.au<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2 1 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 49


Appendix 4- Rating <strong>of</strong> industry specific assessment materials<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Arts and Entertainment<br />

<strong>Assessment</strong><br />

Instrument<br />

<strong>Assessment</strong><br />

instrument<br />

Assessor guide<br />

<strong>Skills</strong>Online – <strong>Assessment</strong> Instruments<br />

CUEAUD1A Repair and maintain audiovisual equipment -<br />

<strong>Assessment</strong> Instruments<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

CUF01-<strong>Assessment</strong> for Radio qualifications (Assessors) -<br />

TPI03<br />

CUF01-<strong>Assessment</strong> for Radio qualifications (Candidates) -<br />

TPI03<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate IV in Entertainment - Assessor Guide<br />

Assessor kit <strong>Skills</strong> First RPL Assessor Kit – Arts and Entertainment –<br />

Certificate III in Printing and Graphic Arts (Printing)<br />

Assessor resource<br />

Automotive<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong> /<br />

recognition process<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

<strong>Assessment</strong> Resource Pack - Supporting CUS20101<br />

Certificate II in Music Industry (Foundation)<br />

Automotive Training Australia Workplace <strong>Assessment</strong><br />

Checklists<br />

Certificate II in Automotive (Aftermarket - Retail<br />

Operations)<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

AUR05-<strong>Assessment</strong> practices workshop powerpoint-TPI01<br />

VETASSESS on line automotive assessment tools [test banks,<br />

third party reports, evidence guide and observation checklist]<br />

AUR01166A Repair engines and associated engine<br />

components<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate II in Recreational Vehicles and Accessories<br />

Retailing - Assessor Guide<br />

Print 2001 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2004 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print 2001 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print 2002 TVET Australia<br />

www.atpl.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

2 2 2 1 1.75<br />

3 2 2 2 2.25<br />

Print NA Automotive Training Australia 1 2 2 2 1.75<br />

Power<br />

point<br />

Print /<br />

online<br />

2006 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

NA VETASSESS<br />

www.assessit.net<br />

Print 2004 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

2 2 2 2 2.00<br />

3 3 2 2 2.50<br />

3 2 2 2 2.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 50


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Business<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

Assessor<br />

Instruments<br />

Assessor kit<br />

Westone – <strong>Assessment</strong> instruments<br />

NILAC – Certificate III workplace assessment – portfolio<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

BSB01-Business Management & Human Resources<br />

Validated <strong>Assessment</strong> Tools-TPI06<br />

VETASSESS on line business assessment tools [test banks,<br />

third party reports, evidence guide and observation checklist]<br />

[continued]<br />

BSBADM307A Organise schedules<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate II in Caravan Park Operations - Assessor Guide<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

BSXFMI404A Participate, lead and facilitate work teams<br />

(<strong>Assessment</strong> Instruments)<br />

<strong>Skills</strong> First RPL Assessor Kit – Business<br />

Certificate III in Asset Maintenance (Cleaning Operations)<br />

Print NA Westone<br />

http://wpc.westone.wa.gov.au/<br />

Print 2006 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print /<br />

online<br />

NA<br />

VETASSESS<br />

www.assessit.net<br />

Print 2004 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2004 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

RPL Kit RPL EEEEZY Business Administration Cert IV Print 2004 Resources Generator<br />

http://www.resourcegenerator.gov.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2 2 2 2 2.00<br />

3 2 3 2 2.50<br />

3 3 2 2 2.50<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

1 2 1 1 1.25<br />

3 1 2 2 2.00<br />

Communications<br />

Assessor guide<br />

Assessor kit<br />

Certificate III in Information Technology ICA30199<br />

(S<strong>of</strong>tware Applications) - <strong>Assessment</strong> Guide<br />

<strong>Skills</strong> First RPL Assessor Kit – Communications<br />

Certificate II in Information Technology<br />

Print 1999 TVET Australia<br />

www.atpl.net.au<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

3 1 2 2 2.00<br />

1 2 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 51


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Community Services<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />

Certificate II & III in Community Services (Aged Care<br />

Work) - <strong>Assessment</strong> Packages<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

CHCCS303A Provide physical assistance with medication<br />

Print 2005 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

2 2 3 2 2.25<br />

Assessor guide<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate II & III in Community Services (Aged Care<br />

Work) - <strong>Assessment</strong> Guide<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

3 2 2 2 2.25<br />

Assessor kit<br />

<strong>Skills</strong> First RPL Assessor Kit – Community Services<br />

Advanced Diploma <strong>of</strong> Children's Services<br />

Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Assessor resource Disability Work - <strong>Assessment</strong> Kit (CHC20599) Print NA TVET Australia<br />

www.atpl.net.au<br />

Construction<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

BCF30200 - Sample joinery apprentice assessment<br />

recording tool (on site assessment) TPI03<br />

Print 2006 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

1 2 1 1 1.25<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor kit<br />

VETASSESS on line construction assessment tools [test<br />

banks, third party reports, evidence guide and observation<br />

checklist]<br />

BCG1000A Carry out interactive workplace communication<br />

<strong>Skills</strong> First RPL Assessor Kit – Construction<br />

Certificate III in Bricklaying/Blocklaying<br />

Print /<br />

online<br />

NA<br />

VETASSESS<br />

www.assessit.net<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

3 3 2 2 2.50<br />

2 2 1 1 1.50<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 52


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Engineering<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

Assessor kit<br />

<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />

Certificate II in Engineering Production - <strong>Assessment</strong><br />

Instrument<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

21622VIC-Delivery and assessment strategies for the<br />

Diploma, Advanced Diploma <strong>of</strong> Engineering Technology-<br />

TPI06 248<br />

EE-OZ Training and assessment manual – ESI –<br />

Transmission and distribution<br />

VETASSESS on line engineering assessment tools [test<br />

banks, third party reports, evidence guide and observation<br />

checklist]<br />

MEM11.11AA Manual handling<br />

<strong>Skills</strong>Online – Assessor Guide<br />

<strong>Assessment</strong> Manual for Certificate II - Lift Industry<br />

<strong>Skills</strong> First RPL Assessor Kit – Engineering<br />

Certificate III in Engineering – Mechanical Trade<br />

Print 1999 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2006 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print NA EE-OZ Training <strong>Standards</strong><br />

www.ee-oz.org.au<br />

Print / NA VETASSESS<br />

online<br />

www.assessit.net<br />

Print NA NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Assessor resource Electrotechnology Trainer/Assessor Guide Print 2002 TVET Australia<br />

www.atpl.net.au<br />

Food processing<br />

<strong>Assessment</strong><br />

instrument<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor<br />

Instrument<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

FDF03-Developing Workplace <strong>Assessment</strong> Tools -TPI04<br />

Training and assessment support materials for MTM07<br />

Certificate II in Meat Processing (Abattoirs)<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

Certificate IV in Meat Processing (Leadership) -<br />

<strong>Assessment</strong> Instrument<br />

Print 2004 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

CDRO 2007 Mintrac<br />

M<br />

www.mintrac.com.au/<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

2 2 2 2 2.00<br />

3 2 2 2 2.25<br />

3 3 2 2 2.50<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

2 2 2 2 2.00<br />

1 2 1 1 1.25<br />

3 2 2 2 2.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 53


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Assessor kit <strong>Skills</strong> First RPL Assessor Kit – Food processing<br />

Certificate I in Meat Processing (Meat Retailing)<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

RPL Kit RPL EEEEZY Food Processing Print 2005 Resources Generator<br />

http://www.resourcegenerator.gov.au<br />

Forest and forest products<br />

<strong>Assessment</strong><br />

Instruments<br />

<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />

Certificate II in Forest and Forest Products - <strong>Assessment</strong><br />

Instruments<br />

Print 2004 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

1 2 1 1 1.25<br />

3 1 2 2 2.00<br />

3 2 2 2 2.25<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

FPI99-MNQOP21A Conduct front end loader operations-<br />

TPI05<br />

Forest Industry <strong>Assessment</strong> Plan System (FIAPS) –<br />

subscriber based assessment service that provides:<br />

a national support network <strong>of</strong> forest industry trainers and<br />

assessors<br />

comprehensive assessment materials for all units <strong>of</strong><br />

competency in FPI05, provided in Word format for easy<br />

customisation<br />

active input into the continuous improvement <strong>of</strong> the<br />

assessment tools<br />

moderation workshops for assessors conducted on<br />

request in regional locations<br />

an annual national conference<br />

a quarterly newsletter<br />

participation in committees to review the Training Package<br />

and to help develop support resources.<br />

a standard template for each unit that requires three types<br />

<strong>of</strong> evidence: observation checklist, question bank and<br />

other supplementary evidence (3 rd party, samples <strong>of</strong><br />

product, portfolio, logbook, etc)<br />

assessment tools that are continuously updated via<br />

feedback from users and national workshops. Current<br />

membership <strong>of</strong> FIAPS represents about 85% <strong>of</strong> RTOs<br />

delivering to the industry.<br />

Print 2005 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print<br />

and<br />

electro<br />

nic<br />

2009 Forestworks<br />

www.forestworks.com.au<br />

2 2 2 2 2.00<br />

1 2 1 1 1.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 54


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Furnishing<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

Assessor kit<br />

General education and training<br />

Assessor<br />

Instrument<br />

Assessor kit<br />

General manufacturing<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor Guide<br />

Westone – <strong>Assessment</strong> instruments<br />

Certificate III In Floor Covering And Finishing -<br />

<strong>Assessment</strong> Tool (LMF30102)<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

LMFFM3020A Set up, operate and maintain sawing machines<br />

<strong>Assessment</strong> tool<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate II and III in Mattress and Base Making (7<br />

Mandatory/Specialist Units) - Assessor Guide<br />

<strong>Skills</strong> First RPL Assessor Kit – Furnishing<br />

Certificate III in Glass and Glazing<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

BSZ401A, BSZ402A, BSZ403A Plan, conduct & review<br />

assessment - <strong>Assessment</strong> Instruments<br />

<strong>Skills</strong> First RPL Assessor Kit – General education and training<br />

Certificate IV in Training and <strong>Assessment</strong><br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

PMB01-Delivery and assessment strategy templates to<br />

support quality training and assessment for process<br />

manufacturing industry employees<br />

Assessor Guide for the Manufactured Mineral Products<br />

Training Package PMC99 (includes floppy disk)<br />

Print NA Westone<br />

http://wpc.westone.wa.gov.au/<br />

Print 2006 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print 2007 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print 2001 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print 2005 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print 1999 TVET Australia<br />

www.atpl.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

2 2 1 1 1.50<br />

3 2 2 2 2.25<br />

1 2 1 1 1.25<br />

3 2 2 2 2.25<br />

1 2 1 1 1.25<br />

2 2 3 2 2.25<br />

3 2 2 2 2.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 55


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Government<br />

Assessor guide<br />

Assessor kit<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Diploma <strong>of</strong> Local Government (Environmental Health and<br />

Building <strong>Assessment</strong>) - <strong>Assessment</strong> Guide<br />

<strong>Skills</strong> First RPL Assessor Kit – Government<br />

Certificate III in Government<br />

Print 2008 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print NA TVET Australia<br />

Assessor resource Unit PUAEQU001A Prepare, maintain and test response<br />

equipment<br />

www.atpl.net.au<br />

RPL Kit RPL EEEEZY Government Cert III Print 2005 Resources Generator<br />

http://www.resourcegenerator.gov.au<br />

Health<br />

Assessor kit<br />

Horse<br />

<strong>Assessment</strong><br />

instruments<br />

Hospitality<br />

Assessor kit<br />

Assessor guide<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Skills</strong> First RPL Assessor Kit – Health<br />

Certificate III in Health Service Assistance (Allied Health<br />

Assistance)<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

RGRH206A – RPL – Apply occupational health and safety<br />

in horse codes<br />

<strong>Skills</strong> First RPL Assessor Kit – Hospitality<br />

Certificate III in Hospitality (Commercial Cookery)<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Working Well: Developing Employability <strong>Skills</strong> in the<br />

Hospitality Industry - Assessor Guide<br />

VETASSESS on line hospitality assessment tools [test banks,<br />

third party reports, evidence guide and observation checklist]<br />

[continued]<br />

THHBFB00B Clean and tidy bar areas<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print 2004 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print 2006 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print /<br />

online<br />

NA<br />

VETASSESS<br />

www.assessit.net<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

1 2 1 1 1.25<br />

1 2 1 1 1.25<br />

3 2 2 2 2.25<br />

3 1 2 2 2.00<br />

3 2 1 1 1.75<br />

3 2 3 2 2.50<br />

3 2 1 1 1.75<br />

2 2 2 2 2.00<br />

3 3 2 2 2.50<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 56


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Laboratory Operations<br />

<strong>Assessment</strong><br />

guide<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor kit<br />

Assessor<br />

manual<br />

Mining<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

Pharmaceuticals<br />

<strong>Assessment</strong><br />

instruments<br />

Manufacturing <strong>Skills</strong> Australia assessment guides for eleven<br />

units <strong>of</strong> competency in the PML04 Laboratory Operations<br />

Training Package:<br />

PMLMAIN400A – Maintain and control stocks<br />

Recognition and assessment kit for calibration technicians<br />

<strong>Skills</strong> First RPL Assessor Kit – Laboratory Operations<br />

Certificate IV in Laboratory Techniques<br />

PML04 <strong>Assessment</strong> Solutions<br />

<strong>Skills</strong>Online – <strong>Assessment</strong> Instrument<br />

Module MNMUGC443A Refuel Vehicles/Machines<br />

Underground - <strong>Assessment</strong> Instrument<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Adapting the assessment tools in underground and open cut<br />

Mining - assessor guide<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

Pharmaceutical Manufacturing: FDFCORBM2A Use Basic<br />

Mathematical Concepts - <strong>Assessment</strong> Guide<br />

Print<br />

and CD<br />

ROM<br />

Print<br />

and CD<br />

ROM<br />

NA<br />

NA<br />

Manufacturing <strong>Skills</strong> Australia<br />

www.mskills.com.au<br />

Manufacturing <strong>Skills</strong> Australia<br />

www.mskills.com.au<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Print<br />

and CD<br />

ROM<br />

2000 Manufacturing <strong>Skills</strong> Australia<br />

www.mskills.com.au<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2006 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

1 1 1 2 1.25<br />

1 1 2 2 1.50<br />

2 2 1 1 1.50<br />

2 1 1 1 1.25<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

2 2 2 2 2.00<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 57


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Primary Industries<br />

<strong>Assessment</strong><br />

Instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor kit<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

Module FDFBPBFPB Operate the Bottle Filling Process -<br />

<strong>Assessment</strong> Instrument<br />

Westone – <strong>Assessment</strong> instruments<br />

Certificate III Conservation And Land Management -<br />

<strong>Assessment</strong> Tool<br />

SmartMedia TAFE SA – <strong>Assessment</strong> instruments<br />

(RTC2301A) Undertake operational maintenance <strong>of</strong><br />

machinery<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

RTC2702A Observe environmental practices<br />

VETASSESS on line horticulture assessment tools [test banks,<br />

third party reports, evidence guide and observation checklist]<br />

[continued]<br />

RTC3016A Provide information on plants and their culture<br />

<strong>Skills</strong> First RPL Assessor Kit – Primary Industry<br />

Certificate III in Horticulture [Turf]<br />

Print 2001 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print NA Westone<br />

http://wpc.westone.wa.gov.au/<br />

Print NA SmartMedia TAFE SA<br />

http://wpc.westone.wa.gov.au/<br />

Print 2006 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print / NA VETASSESS<br />

online<br />

www.assessit.net<br />

Print 2008 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

RPL Kit RPL EEEEZY Horticulture Print 2005 Resources Generator<br />

http://www.resourcegenerator.gov.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

2 2 2 2 2.00<br />

2 2 2 2 2.00<br />

2 2 2 2 2.00<br />

1 3 2 2 2.00<br />

1 2 1 1 1.25<br />

3 1 2 2 2.00<br />

Property Services<br />

<strong>Assessment</strong> &<br />

training kit<br />

<strong>Assessment</strong> & Training Kit to support the Asset Security<br />

Training Package PRS98 - Access Security stream<br />

Print 1999 TVET Australia<br />

www.atpl.net.au<br />

3 2 2 2 2.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 58


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Retail, Wholesale and Personal Services<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

Westone – <strong>Assessment</strong> instruments<br />

Certificate III In Hairdressing - <strong>Assessment</strong> Tool<br />

VETASSESS on line retail assessment tools [test banks, third<br />

party reports, evidence guide and observation checklist]<br />

WRRCA1B Operate retail equipment<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> and recognition resources<br />

Print NA Westone<br />

http://wpc.westone.wa.gov.au/<br />

Print /<br />

online<br />

NA<br />

VETASSESS<br />

www.assessit.net<br />

Print 2002 <strong>Skills</strong> Victoria<br />

WRR02-Retail learning and assessment plans-TPI03<br />

http://trainingsupport.otte.vic.gov.au<br />

Certificate III in Hairdressing CD NA Westone Services – Department <strong>of</strong> Education and<br />

Training<br />

www.westone.wa.gov.au<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Print NA NSW Department <strong>of</strong> Education and Training<br />

Guide to Planning <strong>Assessment</strong> in Certificates II and III in<br />

<strong>Skills</strong>Online<br />

Retail Operations - Assessor Guide<br />

https://www.skillsonline.net.au<br />

Assessor guide Assessor Guide: WRP20102 Certificate II in Community<br />

Pharmacy<br />

Print NA Services <strong>Skills</strong> Industry <strong>Skills</strong> <strong>Council</strong><br />

www.serviceskills.com.au<br />

Assessor guide Certificate III in Hairdressing <strong>Assessment</strong> Tool Print NA Services <strong>Skills</strong> Industry <strong>Skills</strong> <strong>Council</strong><br />

www.serviceskills.com.au<br />

Assessor kit <strong>Skills</strong> First RPL Assessor Kit – Retail<br />

Certificate III in Retail<br />

Print 2009 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

Assessor<br />

resource<br />

Retail Recognition Kit<br />

CDRO<br />

M<br />

2002 TVET Australia<br />

www.atpl.net.au<br />

RPL Kit RPL EEEEZY Hairdressing Print 2005 Resources Generator<br />

http://www.resourcegenerator.gov.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

2 2 2 2 2.00<br />

3 3 2 2 2.50<br />

3 2 2 2 2.25<br />

2 2 2 2 2.00<br />

3 2 2 2 2.25<br />

3 1 2 2 2.00<br />

3 1 2 2 2.00<br />

1 2 1 1 1.25<br />

3 2 2 2 2.25<br />

3 1 2 2 2.00<br />

Sport and Recreation<br />

Assessor kit<br />

Assessor kit<br />

<strong>Skills</strong> First RPL Assessor Kit – Sport and Recreation<br />

Certificate III in Meetings and Events<br />

Sport & Recreation Industry Training Packages - Noted Support<br />

MaterialsV20<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

CDRO<br />

M<br />

NA<br />

TVET Australia<br />

www.atpl.net.au<br />

3 2 1 1 1.75<br />

3 2 2 2 2.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 59


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Tourism<br />

<strong>Assessment</strong><br />

Instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor guide<br />

Assessor<br />

resource<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

Certificate IV in Tourism (Guiding) - <strong>Assessment</strong> Instrument<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

THH02-Hospitality RPL-RCC Project - THH42602 Cert IV in<br />

Hospitality (Supervision)-TPI03<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate IV in Tourism (Guiding)<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print 2003 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

THHGLE06A Monitor Staff Performance Print NA TVET Australia<br />

www.atpl.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

1 2 2 2 1.75<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

Transport and Distribution<br />

<strong>Assessment</strong><br />

Instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

<strong>Assessment</strong><br />

instruments<br />

Assessor kit<br />

<strong>Skills</strong>Online – Assessor Instrument<br />

Diploma <strong>of</strong> Logistics Management - <strong>Assessment</strong> Kit<br />

Westone – <strong>Assessment</strong> instruments<br />

Operate and maintain internal combustion engines engineer<br />

class 3<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

TDM01-<strong>Assessment</strong> Guide for the Maritime Operations<br />

Training Package Certificates I and III-TPI04<br />

VETASSESS on line transport assessment tools [test banks, third<br />

party reports, evidence guide and observation checklist]<br />

TDTA1597B Complete receival/despatch documentation<br />

Print 2006 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

Print NA Westone<br />

http://wpc.westone.wa.gov.au/<br />

Print 2003 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print /<br />

online<br />

NA<br />

VETASSESS<br />

www.assessit.net<br />

Bulk Store Operator - <strong>Assessment</strong> Book Print 1999 TVET Australia / Transport and Logistics Industry<br />

<strong>Skills</strong> <strong>Council</strong><br />

www.atpl.net.au<br />

<strong>Skills</strong> First RPL Assessor Kit – Transport and Distribution<br />

Certificate III in Transport and Distribution (Road Transport)<br />

Print 2007 Department <strong>of</strong> Education, Training and the Arts –<br />

<strong>Skills</strong> First<br />

http://www.vetpd.qld.gov.au/teaching-learning-andassessment/resources/rpl.html<br />

RPL Kit RPL EEEZY Transport and Distribution Print 2005 Resources Generator<br />

http://www.resourcegenerator.gov.au<br />

3 2 2 2 2.25<br />

2 2 2 2 2.00<br />

1 2 2 2 1.75<br />

3 3 2 2 2.50<br />

3 2 2 2 2.25<br />

3 2 1 1 1.75<br />

3 1 2 2 2.50<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 60


Appendix 4- Rating <strong>of</strong> industry specific assessment materials [continued]<br />

<strong>Assessment</strong> materials<br />

Type <strong>of</strong> resource Title Format Year Source<br />

Seafood<br />

<strong>Assessment</strong><br />

instruments<br />

Facilitator's<br />

guide &<br />

assessment<br />

package<br />

Water<br />

Assessor guide<br />

<strong>Skills</strong> Victoria – <strong>Assessment</strong> instruments<br />

317 SFIAQUA307A-Select and supervise the use <strong>of</strong><br />

chemicals and biological agents in an aquaculture operation-<br />

TPI02<br />

ABF511 Occupational Health and Safety at Sea - Facilitator's<br />

Guide & <strong>Assessment</strong> Package<br />

<strong>Skills</strong>Online – Assessor Guide<br />

Certificate II in Water Industry Operations - Assessor Guide<br />

Print 2004 <strong>Skills</strong> Victoria<br />

http://trainingsupport.otte.vic.gov.au<br />

Print 1997 TVET Australia<br />

www.atpl.net.au<br />

Print 2002 NSW Department <strong>of</strong> Education and Training<br />

<strong>Skills</strong>Online<br />

https://www.skillsonline.net.au<br />

RATING<br />

Validity Accessibility Usability Flexibility Aggregate<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

3 2 2 2 2.25<br />

<strong>Quality</strong> <strong>of</strong> assessment practices Stage 2 61

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!