Active IQ Level 4 Award in Understanding the Internal Quality Assurance of Assessment Processes and Practice (sample manual)

For more information, please visit http://www.activeiq.co.uk/qualifications/level-4/active-iq-level-4-award-in-understanding-the-internal-quality-assurance-of-assessment-processes-and-practice For more information, please visit http://www.activeiq.co.uk/qualifications/level-4/active-iq-level-4-award-in-understanding-the-internal-quality-assurance-of-assessment-processes-and-practice

activeiqresources
from activeiqresources More from this publisher
03.07.2020 Views

Manual Level 4 Award in Understanding the Internal Quality Assurance of Assessment Processes and Practice Version AIQ005733

Manual<br />

<strong>Level</strong> 4 <strong>Award</strong> <strong>in</strong><br />

Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> <strong>Internal</strong><br />

<strong>Quality</strong> <strong>Assurance</strong> <strong>of</strong><br />

<strong>Assessment</strong> <strong>Processes</strong><br />

<strong>and</strong> <strong>Practice</strong><br />

Version A<strong>IQ</strong>005733


Underst<strong>and</strong><strong>in</strong>g <strong>the</strong><br />

pr<strong>in</strong>ciples <strong>and</strong> practice<br />

<strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong><br />

quality <strong>of</strong> assessment<br />

Aim<br />

This unit will provide you with <strong>the</strong> underp<strong>in</strong>n<strong>in</strong>g knowledge required to underst<strong>and</strong> <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice<br />

<strong>of</strong> <strong>in</strong>ternal quality assurance. This <strong>in</strong>formation will give those who wish to have, or currently have, responsibility<br />

for <strong>in</strong>ternal quality assurance <strong>of</strong> tra<strong>in</strong><strong>in</strong>g programmes <strong>the</strong> good practice, requirements <strong>and</strong> key processes to be<br />

effective <strong>in</strong> <strong>the</strong>ir role.<br />

Learn<strong>in</strong>g outcomes<br />

At <strong>the</strong> end <strong>of</strong> this unit you will:<br />

• Underst<strong>and</strong> <strong>the</strong> context <strong>and</strong> pr<strong>in</strong>ciples <strong>of</strong> <strong>in</strong>ternal quality assurance<br />

• Underst<strong>and</strong> how to plan <strong>the</strong> <strong>in</strong>ternal quality assurance <strong>of</strong> assessment<br />

• Underst<strong>and</strong> techniques <strong>and</strong> criteria for monitor<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment <strong>in</strong>ternally<br />

• Underst<strong>and</strong> how to <strong>in</strong>ternally ma<strong>in</strong>ta<strong>in</strong> <strong>and</strong> improve <strong>the</strong> quality <strong>of</strong> assessment<br />

• Underst<strong>and</strong> how to manage <strong>in</strong>formation relevant to <strong>the</strong> <strong>in</strong>ternal quality assurance <strong>of</strong> assessment<br />

• Underst<strong>and</strong> <strong>the</strong> legal <strong>and</strong> good practice requirements for <strong>the</strong> <strong>in</strong>ternal quality<br />

assurance <strong>of</strong> assessment<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale<br />

1


Regulations, legal requirements <strong>and</strong> good practice<br />

Section 2<br />

Section 2: Regulations, legal<br />

requirements <strong>and</strong> good<br />

practice<br />

The AO is responsible for regulat<strong>in</strong>g <strong>the</strong> delivery <strong>and</strong> assessment <strong>of</strong> its qualifications. To deliver <strong>the</strong>se, <strong>the</strong> tra<strong>in</strong><strong>in</strong>g<br />

provider, through <strong>the</strong>ir own <strong>IQ</strong>A processes <strong>and</strong> practice, must demonstrate <strong>the</strong>y are meet<strong>in</strong>g <strong>the</strong> requirements<br />

stipulated by <strong>the</strong> follow<strong>in</strong>g external bodies <strong>and</strong> regulators:<br />

Ofsted<br />

• Office for St<strong>and</strong>ards <strong>in</strong> Education, Children’s Services <strong>and</strong> Skills. They <strong>in</strong>spect<br />

<strong>and</strong> regulate services that care for children <strong>and</strong> young people <strong>and</strong> services<br />

provid<strong>in</strong>g education <strong>and</strong> skills for learners <strong>of</strong> all ages, <strong>in</strong>clud<strong>in</strong>g schools,<br />

colleges <strong>and</strong> tra<strong>in</strong><strong>in</strong>g providers.<br />

Ofqual<br />

• The Office <strong>of</strong> Qualifications <strong>and</strong> Exam<strong>in</strong>ations Regulation, a non-m<strong>in</strong>isterial<br />

government department that regulates qualifications, exams <strong>and</strong> tests <strong>in</strong> Engl<strong>and</strong><br />

<strong>and</strong> Nor<strong>the</strong>n Irel<strong>and</strong> (Qualifications Wales <strong>in</strong> Wales <strong>and</strong> SCQF (Scottish Credit <strong>and</strong><br />

Qualifications Framework) <strong>in</strong> Scotl<strong>and</strong>).<br />

Regulated Qualifications Framework<br />

• A national framework to help people underst<strong>and</strong> all <strong>the</strong> qualifications<br />

regulated – general <strong>and</strong> vocational <strong>in</strong> Engl<strong>and</strong>, <strong>and</strong> vocational <strong>in</strong> Nor<strong>the</strong>rn<br />

Irel<strong>and</strong> – <strong>and</strong> how <strong>the</strong>y relate to each o<strong>the</strong>r. They aim to improve consistency<br />

<strong>in</strong> how award<strong>in</strong>g organisations describe <strong>the</strong> size, challenge or dem<strong>and</strong> <strong>of</strong> <strong>the</strong><br />

qualifications <strong>the</strong>y <strong>of</strong>fer.<br />

<strong>Award</strong><strong>in</strong>g organisation<br />

• An organisation or external body that issues qualifications formally, recognis<strong>in</strong>g<br />

<strong>the</strong> learn<strong>in</strong>g outcomes (knowledge, skills <strong>and</strong>/or competences) <strong>of</strong> an <strong>in</strong>dividual<br />

follow<strong>in</strong>g an assessent <strong>and</strong> validation procedure.<br />

The requirements you need to follow may differ depend<strong>in</strong>g on <strong>the</strong> <strong>in</strong>dustry, environment <strong>and</strong> context <strong>in</strong> which you<br />

quality assure. However, <strong>the</strong>re are some general requirements that are relevant to all IV roles, <strong>in</strong>clud<strong>in</strong>g:<br />

Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice <strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment<br />

• Regulation <strong>of</strong> course content <strong>and</strong> assessment practice<br />

• Health <strong>and</strong> safety<br />

• Equality <strong>and</strong> diversity<br />

• Data protection<br />

• Safeguard<strong>in</strong>g<br />

• Policies, procedures <strong>and</strong> codes <strong>of</strong> practice<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale 9


Section 2<br />

Regulations, legal requirements <strong>and</strong> good practice<br />

Valu<strong>in</strong>g reflective practice <strong>and</strong> cont<strong>in</strong>u<strong>in</strong>g pr<strong>of</strong>essional<br />

development<br />

Refl ective practice is important for <strong>the</strong> IV. This means th<strong>in</strong>k<strong>in</strong>g about (or refl ect<strong>in</strong>g on) what you did or <strong>the</strong> experience<br />

you had <strong>and</strong> decid<strong>in</strong>g from that what you would do <strong>the</strong> same or differently next time.<br />

Refl ective practice requires a conscious effort to th<strong>in</strong>k about <strong>the</strong> experience <strong>and</strong> develop future ideas. All <strong>in</strong>dividuals<br />

<strong>in</strong>volved <strong>in</strong> <strong>the</strong> learn<strong>in</strong>g <strong>and</strong> development process can benefi t from it.<br />

Gravells’ (2011) EDAR approach provides a simple mechanism for refl ection:<br />

Experience<br />

Describe<br />

Analyse<br />

Revise<br />

Experience – <strong>the</strong> quality assurance performed which you would like to improve<br />

or reflect on<br />

Describe – who was <strong>in</strong>volved, what happened, when <strong>and</strong> where it happened<br />

Analyse – th<strong>in</strong>k more deeply, th<strong>in</strong>k how <strong>and</strong> why it happened<br />

Revise – what you would do differently, what you would keep <strong>the</strong> same, try it<br />

out next time<br />

Follow<strong>in</strong>g this method can allow any IV to refl ect on <strong>the</strong>ir own quality assurance practice <strong>and</strong> identify areas <strong>the</strong>y<br />

may wish to change. IVs can refl ect on <strong>the</strong>ir assurance experiences <strong>in</strong> a variety <strong>of</strong> ways <strong>in</strong>clud<strong>in</strong>g simple templates,<br />

notebooks, evaluation forms, self-refl ection logs, learn<strong>in</strong>g logs or diaries.<br />

Cont<strong>in</strong>ual pr<strong>of</strong>essional development (CPD) is a means by which verifi ers can ma<strong>in</strong>ta<strong>in</strong>, improve <strong>and</strong> broaden<br />

<strong>the</strong>ir knowledge, skills <strong>and</strong> quality assurance practice. This can be achieved <strong>in</strong> many ways, <strong>in</strong>clud<strong>in</strong>g attend<strong>in</strong>g<br />

workshops, onl<strong>in</strong>e tra<strong>in</strong><strong>in</strong>g, conferences, shadow<strong>in</strong>g, buddy<strong>in</strong>g, mentor<strong>in</strong>g o<strong>the</strong>rs or fur<strong>the</strong>r qualifi cations. With<br />

respect to assessment practice, CPD is vital as st<strong>and</strong>ards <strong>and</strong> qualifi cations change, regulations are amended, <strong>and</strong><br />

subject knowledge <strong>and</strong> skills are constantly evolv<strong>in</strong>g. Without CPD an IV risks not be<strong>in</strong>g occupationally competent<br />

<strong>and</strong> be<strong>in</strong>g unable to perform <strong>the</strong>ir role. Most award<strong>in</strong>g organisations <strong>and</strong> tra<strong>in</strong><strong>in</strong>g providers will require evidence <strong>of</strong><br />

regular CPD to ma<strong>in</strong>ta<strong>in</strong> <strong>the</strong> st<strong>and</strong>ards, licence or qualifi cations to assess. As an IV, it is important to:<br />

✓<br />

✓<br />

✓<br />

Develop how to cope positively <strong>and</strong> confi dently with assessment challenges <strong>and</strong> changes.<br />

Showcase verifi er’s achievements <strong>and</strong> enhance credibility.<br />

Defi ne, monitor <strong>and</strong> achieve career goals.<br />

ACTIVITY<br />

Refl ect on your current experience as a new IV us<strong>in</strong>g <strong>the</strong> EDAR approach above. Include <strong>the</strong><br />

opportunities you will take over <strong>the</strong> com<strong>in</strong>g months to develop your knowledge, skills <strong>and</strong> practice.<br />

16<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale


Plann<strong>in</strong>g <strong>in</strong>ternal quality assurance<br />

Section 3<br />

Section 3: Plann<strong>in</strong>g <strong>in</strong>ternal<br />

quality assurance<br />

Importance <strong>of</strong> plann<strong>in</strong>g <strong>and</strong> preparation<br />

As with any aspect <strong>of</strong> learn<strong>in</strong>g <strong>and</strong> development provision, plann<strong>in</strong>g is essential <strong>in</strong> ensur<strong>in</strong>g a smooth, efficient <strong>and</strong><br />

effective quality assurance process.<br />

To be effective, <strong>the</strong> <strong>IQ</strong>A plan needs to consider <strong>the</strong> follow<strong>in</strong>g factors:<br />

Involvement <strong>of</strong> <strong>the</strong><br />

assessors<br />

Date, time <strong>and</strong><br />

duration<br />

<strong>Award</strong><strong>in</strong>g organisation<br />

requirements<br />

Staff/support availability <strong>and</strong><br />

expertise<br />

Type <strong>of</strong><br />

assessment<br />

Number <strong>and</strong> ability <strong>of</strong><br />

learners<br />

Type <strong>of</strong> <strong>IQ</strong>A method –<br />

desktop/live<br />

<strong>Assessment</strong> method<br />

<strong>and</strong> type<br />

Environmental<br />

conditions<br />

Resources <strong>and</strong><br />

materials<br />

Subject <strong>and</strong> qualification<br />

specification<br />

An <strong>in</strong>itial <strong>sample</strong> plan cover<strong>in</strong>g all aspects needs to be put <strong>in</strong> place to ensure that <strong>the</strong> <strong>IQ</strong>A activities are fair,<br />

thorough <strong>and</strong> st<strong>and</strong>ardised. The nature <strong>of</strong> <strong>the</strong> plan (i.e. <strong>the</strong> size <strong>and</strong> frequency) should be adjusted accord<strong>in</strong>g to <strong>the</strong><br />

qualification (i.e. level, new or well-established), experience <strong>and</strong> competence <strong>of</strong> <strong>the</strong> assessor <strong>in</strong>volved <strong>and</strong> <strong>the</strong> size<br />

<strong>and</strong> characteristics <strong>of</strong> <strong>the</strong> cohort be<strong>in</strong>g <strong>sample</strong>d.<br />

An effective <strong>sample</strong> plan should also <strong>in</strong>clude a clearly written rationale provid<strong>in</strong>g justification for <strong>the</strong> size <strong>and</strong><br />

nature <strong>of</strong> <strong>the</strong> proposed <strong>sample</strong> so that assessors, o<strong>the</strong>r IVs, quality managers or EVs have a clear context for <strong>the</strong><br />

plann<strong>in</strong>g strategy <strong>and</strong> <strong>the</strong> reasons beh<strong>in</strong>d its design.<br />

Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice <strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale 19


Section 4<br />

Monitor<strong>in</strong>g <strong>and</strong> improv<strong>in</strong>g <strong>in</strong>ternal quality assurance<br />

Judg<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> <strong>the</strong> assessment process<br />

When consider<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> <strong>the</strong> assessment process, <strong>the</strong> IV must determ<strong>in</strong>e <strong>the</strong> extent to which <strong>the</strong> assessor<br />

has adhered to <strong>the</strong> appropriate underly<strong>in</strong>g pr<strong>in</strong>ciples <strong>of</strong> assessment:<br />

Sufficient<br />

• Has <strong>the</strong> learner provided enough evidence to meet <strong>the</strong> requirements – number <strong>of</strong> occasions, across a<br />

number <strong>of</strong> contexts, presented <strong>in</strong> different formats?<br />

• The IV needs to ensure that <strong>the</strong> assessor has made judgements on <strong>the</strong> suffi ciency <strong>of</strong> <strong>the</strong> evidence <strong>in</strong> relation<br />

to <strong>the</strong> qualifi cation requirements.<br />

Au<strong>the</strong>ntic<br />

• The evidence must be <strong>the</strong> product <strong>of</strong> <strong>the</strong> learner.<br />

• Practical observations are an effective way <strong>of</strong> confi rm<strong>in</strong>g this due to direct observation.<br />

• Au<strong>the</strong>nticity has become <strong>in</strong>creas<strong>in</strong>gly diffi cult to manage <strong>in</strong> a digital age, with electronic evidence <strong>in</strong>creas<strong>in</strong>g<br />

<strong>the</strong> risk <strong>of</strong> plagiarism.<br />

• The IV must be satisfi ed that <strong>the</strong> assessor has made all reasonable efforts to ensure that <strong>the</strong> work is<br />

au<strong>the</strong>ntic. This could <strong>in</strong>clude additional verbal question<strong>in</strong>g <strong>and</strong> pr<strong>of</strong>essional discussions, as well as<br />

au<strong>the</strong>nticity declarations signed by <strong>the</strong> learner.<br />

Reliable<br />

• It must be possible for an assessment to be repeated with similar learners <strong>in</strong> similar contexts to give <strong>the</strong><br />

same results.<br />

• Different assessors, poorly defi ned criteria <strong>and</strong> variations <strong>in</strong> assessment locations <strong>and</strong> resources all have <strong>the</strong><br />

potential to affect reliability.<br />

• Through portfolio sampl<strong>in</strong>g <strong>the</strong> IV can determ<strong>in</strong>e <strong>the</strong> extent to which <strong>the</strong> assessment judgements are<br />

consistent over time <strong>and</strong> between assessors. The IV can check, where stipulated, <strong>the</strong> secondary mark<strong>in</strong>g <strong>and</strong><br />

moderation <strong>of</strong> exam papers.<br />

• Good practice would be for an IV to quality assure <strong>the</strong> same assessor over a period <strong>of</strong> time <strong>and</strong>/or for<br />

developmental feedback to be shared across <strong>the</strong> <strong>IQ</strong>A team, to allow trends <strong>and</strong> need for support to be picked<br />

up, <strong>and</strong> reliability improved.<br />

28<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale


Monitor<strong>in</strong>g <strong>and</strong> improv<strong>in</strong>g <strong>in</strong>ternal quality assurance<br />

Section 4<br />

St<strong>and</strong>ardisation requirements for assessment<br />

One <strong>of</strong> <strong>the</strong> ma<strong>in</strong> challenges <strong>of</strong> <strong>the</strong> <strong>IQ</strong>A process is ensur<strong>in</strong>g that both delivery <strong>and</strong> assessment <strong>of</strong> qualifi cations is<br />

consistent throughout <strong>the</strong> organisation. This can be challeng<strong>in</strong>g when assessment is occurr<strong>in</strong>g across a large,<br />

remote work<strong>in</strong>g team, across multiple venues all at different times, year-round.<br />

The IV must ensure that:<br />

✦ All assessors consistently make valid decisions.<br />

✦ All assessors make <strong>the</strong> same decisions based on <strong>the</strong> same evidence.<br />

✦ All learners are treated fairly.<br />

The most common <strong>and</strong> effective way to do this is through conduct<strong>in</strong>g st<strong>and</strong>ardisation activities.<br />

Beyond <strong>the</strong> requirements from <strong>the</strong> AO, <strong>the</strong> frequency, format, duration <strong>and</strong> characteristics <strong>of</strong> <strong>the</strong>se activities can be<br />

determ<strong>in</strong>ed by <strong>the</strong> tra<strong>in</strong><strong>in</strong>g provider with <strong>in</strong>put from <strong>the</strong> <strong>IQ</strong>A team. Although st<strong>and</strong>ardisation may be led or facilitated<br />

by an IV or lead IV, <strong>the</strong> assessors <strong>and</strong> IVs should all work as a team for shared responsibility. Activities could be:<br />

Shared unit assessment<br />

Real examples from a specific unit, all<br />

assessed by assessors us<strong>in</strong>g normal<br />

practice. These are collated, discussed<br />

<strong>and</strong> reviewed, <strong>and</strong> feedback is given by<br />

<strong>the</strong> IV.<br />

Alternative evidence<br />

New or unfamiliar forms <strong>of</strong> evidence can<br />

be reviewed by assessors <strong>and</strong> consensus<br />

is established to meet st<strong>and</strong>ards.<br />

Old v new<br />

As a team, work produced to old<br />

st<strong>and</strong>ards is evaluated aga<strong>in</strong>st new<br />

st<strong>and</strong>ards to help highlight where<br />

new evidence may be required <strong>and</strong> old<br />

evidence is no longer needed.<br />

Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice <strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale 31


THE PURPOSE OF INTERNAL<br />

QUALITY ASSURANCE<br />

Check<strong>in</strong>g<br />

learner<br />

registration<br />

<strong>and</strong><br />

process<strong>in</strong>g<br />

Monitor<strong>in</strong>g<br />

quality <strong>of</strong><br />

assessment<br />

decisions<br />

Ensur<strong>in</strong>g<br />

consistent<br />

<strong>and</strong> reliable<br />

judgements<br />

are made<br />

Determ<strong>in</strong><strong>in</strong>g<br />

effectiveness<br />

<strong>of</strong> assessment<br />

activities /<br />

methods<br />

QUALITY ASSURANCE<br />

SATISFACTION<br />

100%<br />

G U A R A N<br />

T E E D<br />

Highlight<strong>in</strong>g<br />

problems,<br />

trends <strong>and</strong><br />

development<br />

needs<br />

Ensur<strong>in</strong>g<br />

adherence<br />

to award<strong>in</strong>g<br />

policies<br />

EQUALITY AND DIVERSITY<br />

DATA PROTECTION (GDPR)<br />

SAFEGUARDING<br />

HEALTH AND SAFETY<br />

Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!