Active IQ Level 4 Award in Understanding the Internal Quality Assurance of Assessment Processes and Practice (sample manual)
For more information, please visit http://www.activeiq.co.uk/qualifications/level-4/active-iq-level-4-award-in-understanding-the-internal-quality-assurance-of-assessment-processes-and-practice For more information, please visit http://www.activeiq.co.uk/qualifications/level-4/active-iq-level-4-award-in-understanding-the-internal-quality-assurance-of-assessment-processes-and-practice
Manual Level 4 Award in Understanding the Internal Quality Assurance of Assessment Processes and Practice Version AIQ005733
- Page 2 and 3: Understanding the principles and pr
- Page 4 and 5: Section 2 Regulations, legal requir
- Page 6 and 7: Section 4 Monitoring and improving
- Page 8: THE PURPOSE OF INTERNAL QUALITY ASS
Manual<br />
<strong>Level</strong> 4 <strong>Award</strong> <strong>in</strong><br />
Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> <strong>Internal</strong><br />
<strong>Quality</strong> <strong>Assurance</strong> <strong>of</strong><br />
<strong>Assessment</strong> <strong>Processes</strong><br />
<strong>and</strong> <strong>Practice</strong><br />
Version A<strong>IQ</strong>005733
Underst<strong>and</strong><strong>in</strong>g <strong>the</strong><br />
pr<strong>in</strong>ciples <strong>and</strong> practice<br />
<strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong><br />
quality <strong>of</strong> assessment<br />
Aim<br />
This unit will provide you with <strong>the</strong> underp<strong>in</strong>n<strong>in</strong>g knowledge required to underst<strong>and</strong> <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice<br />
<strong>of</strong> <strong>in</strong>ternal quality assurance. This <strong>in</strong>formation will give those who wish to have, or currently have, responsibility<br />
for <strong>in</strong>ternal quality assurance <strong>of</strong> tra<strong>in</strong><strong>in</strong>g programmes <strong>the</strong> good practice, requirements <strong>and</strong> key processes to be<br />
effective <strong>in</strong> <strong>the</strong>ir role.<br />
Learn<strong>in</strong>g outcomes<br />
At <strong>the</strong> end <strong>of</strong> this unit you will:<br />
• Underst<strong>and</strong> <strong>the</strong> context <strong>and</strong> pr<strong>in</strong>ciples <strong>of</strong> <strong>in</strong>ternal quality assurance<br />
• Underst<strong>and</strong> how to plan <strong>the</strong> <strong>in</strong>ternal quality assurance <strong>of</strong> assessment<br />
• Underst<strong>and</strong> techniques <strong>and</strong> criteria for monitor<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment <strong>in</strong>ternally<br />
• Underst<strong>and</strong> how to <strong>in</strong>ternally ma<strong>in</strong>ta<strong>in</strong> <strong>and</strong> improve <strong>the</strong> quality <strong>of</strong> assessment<br />
• Underst<strong>and</strong> how to manage <strong>in</strong>formation relevant to <strong>the</strong> <strong>in</strong>ternal quality assurance <strong>of</strong> assessment<br />
• Underst<strong>and</strong> <strong>the</strong> legal <strong>and</strong> good practice requirements for <strong>the</strong> <strong>in</strong>ternal quality<br />
assurance <strong>of</strong> assessment<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale<br />
1
Regulations, legal requirements <strong>and</strong> good practice<br />
Section 2<br />
Section 2: Regulations, legal<br />
requirements <strong>and</strong> good<br />
practice<br />
The AO is responsible for regulat<strong>in</strong>g <strong>the</strong> delivery <strong>and</strong> assessment <strong>of</strong> its qualifications. To deliver <strong>the</strong>se, <strong>the</strong> tra<strong>in</strong><strong>in</strong>g<br />
provider, through <strong>the</strong>ir own <strong>IQ</strong>A processes <strong>and</strong> practice, must demonstrate <strong>the</strong>y are meet<strong>in</strong>g <strong>the</strong> requirements<br />
stipulated by <strong>the</strong> follow<strong>in</strong>g external bodies <strong>and</strong> regulators:<br />
Ofsted<br />
• Office for St<strong>and</strong>ards <strong>in</strong> Education, Children’s Services <strong>and</strong> Skills. They <strong>in</strong>spect<br />
<strong>and</strong> regulate services that care for children <strong>and</strong> young people <strong>and</strong> services<br />
provid<strong>in</strong>g education <strong>and</strong> skills for learners <strong>of</strong> all ages, <strong>in</strong>clud<strong>in</strong>g schools,<br />
colleges <strong>and</strong> tra<strong>in</strong><strong>in</strong>g providers.<br />
Ofqual<br />
• The Office <strong>of</strong> Qualifications <strong>and</strong> Exam<strong>in</strong>ations Regulation, a non-m<strong>in</strong>isterial<br />
government department that regulates qualifications, exams <strong>and</strong> tests <strong>in</strong> Engl<strong>and</strong><br />
<strong>and</strong> Nor<strong>the</strong>n Irel<strong>and</strong> (Qualifications Wales <strong>in</strong> Wales <strong>and</strong> SCQF (Scottish Credit <strong>and</strong><br />
Qualifications Framework) <strong>in</strong> Scotl<strong>and</strong>).<br />
Regulated Qualifications Framework<br />
• A national framework to help people underst<strong>and</strong> all <strong>the</strong> qualifications<br />
regulated – general <strong>and</strong> vocational <strong>in</strong> Engl<strong>and</strong>, <strong>and</strong> vocational <strong>in</strong> Nor<strong>the</strong>rn<br />
Irel<strong>and</strong> – <strong>and</strong> how <strong>the</strong>y relate to each o<strong>the</strong>r. They aim to improve consistency<br />
<strong>in</strong> how award<strong>in</strong>g organisations describe <strong>the</strong> size, challenge or dem<strong>and</strong> <strong>of</strong> <strong>the</strong><br />
qualifications <strong>the</strong>y <strong>of</strong>fer.<br />
<strong>Award</strong><strong>in</strong>g organisation<br />
• An organisation or external body that issues qualifications formally, recognis<strong>in</strong>g<br />
<strong>the</strong> learn<strong>in</strong>g outcomes (knowledge, skills <strong>and</strong>/or competences) <strong>of</strong> an <strong>in</strong>dividual<br />
follow<strong>in</strong>g an assessent <strong>and</strong> validation procedure.<br />
The requirements you need to follow may differ depend<strong>in</strong>g on <strong>the</strong> <strong>in</strong>dustry, environment <strong>and</strong> context <strong>in</strong> which you<br />
quality assure. However, <strong>the</strong>re are some general requirements that are relevant to all IV roles, <strong>in</strong>clud<strong>in</strong>g:<br />
Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice <strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment<br />
• Regulation <strong>of</strong> course content <strong>and</strong> assessment practice<br />
• Health <strong>and</strong> safety<br />
• Equality <strong>and</strong> diversity<br />
• Data protection<br />
• Safeguard<strong>in</strong>g<br />
• Policies, procedures <strong>and</strong> codes <strong>of</strong> practice<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale 9
Section 2<br />
Regulations, legal requirements <strong>and</strong> good practice<br />
Valu<strong>in</strong>g reflective practice <strong>and</strong> cont<strong>in</strong>u<strong>in</strong>g pr<strong>of</strong>essional<br />
development<br />
Refl ective practice is important for <strong>the</strong> IV. This means th<strong>in</strong>k<strong>in</strong>g about (or refl ect<strong>in</strong>g on) what you did or <strong>the</strong> experience<br />
you had <strong>and</strong> decid<strong>in</strong>g from that what you would do <strong>the</strong> same or differently next time.<br />
Refl ective practice requires a conscious effort to th<strong>in</strong>k about <strong>the</strong> experience <strong>and</strong> develop future ideas. All <strong>in</strong>dividuals<br />
<strong>in</strong>volved <strong>in</strong> <strong>the</strong> learn<strong>in</strong>g <strong>and</strong> development process can benefi t from it.<br />
Gravells’ (2011) EDAR approach provides a simple mechanism for refl ection:<br />
Experience<br />
Describe<br />
Analyse<br />
Revise<br />
Experience – <strong>the</strong> quality assurance performed which you would like to improve<br />
or reflect on<br />
Describe – who was <strong>in</strong>volved, what happened, when <strong>and</strong> where it happened<br />
Analyse – th<strong>in</strong>k more deeply, th<strong>in</strong>k how <strong>and</strong> why it happened<br />
Revise – what you would do differently, what you would keep <strong>the</strong> same, try it<br />
out next time<br />
Follow<strong>in</strong>g this method can allow any IV to refl ect on <strong>the</strong>ir own quality assurance practice <strong>and</strong> identify areas <strong>the</strong>y<br />
may wish to change. IVs can refl ect on <strong>the</strong>ir assurance experiences <strong>in</strong> a variety <strong>of</strong> ways <strong>in</strong>clud<strong>in</strong>g simple templates,<br />
notebooks, evaluation forms, self-refl ection logs, learn<strong>in</strong>g logs or diaries.<br />
Cont<strong>in</strong>ual pr<strong>of</strong>essional development (CPD) is a means by which verifi ers can ma<strong>in</strong>ta<strong>in</strong>, improve <strong>and</strong> broaden<br />
<strong>the</strong>ir knowledge, skills <strong>and</strong> quality assurance practice. This can be achieved <strong>in</strong> many ways, <strong>in</strong>clud<strong>in</strong>g attend<strong>in</strong>g<br />
workshops, onl<strong>in</strong>e tra<strong>in</strong><strong>in</strong>g, conferences, shadow<strong>in</strong>g, buddy<strong>in</strong>g, mentor<strong>in</strong>g o<strong>the</strong>rs or fur<strong>the</strong>r qualifi cations. With<br />
respect to assessment practice, CPD is vital as st<strong>and</strong>ards <strong>and</strong> qualifi cations change, regulations are amended, <strong>and</strong><br />
subject knowledge <strong>and</strong> skills are constantly evolv<strong>in</strong>g. Without CPD an IV risks not be<strong>in</strong>g occupationally competent<br />
<strong>and</strong> be<strong>in</strong>g unable to perform <strong>the</strong>ir role. Most award<strong>in</strong>g organisations <strong>and</strong> tra<strong>in</strong><strong>in</strong>g providers will require evidence <strong>of</strong><br />
regular CPD to ma<strong>in</strong>ta<strong>in</strong> <strong>the</strong> st<strong>and</strong>ards, licence or qualifi cations to assess. As an IV, it is important to:<br />
✓<br />
✓<br />
✓<br />
Develop how to cope positively <strong>and</strong> confi dently with assessment challenges <strong>and</strong> changes.<br />
Showcase verifi er’s achievements <strong>and</strong> enhance credibility.<br />
Defi ne, monitor <strong>and</strong> achieve career goals.<br />
ACTIVITY<br />
Refl ect on your current experience as a new IV us<strong>in</strong>g <strong>the</strong> EDAR approach above. Include <strong>the</strong><br />
opportunities you will take over <strong>the</strong> com<strong>in</strong>g months to develop your knowledge, skills <strong>and</strong> practice.<br />
16<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale
Plann<strong>in</strong>g <strong>in</strong>ternal quality assurance<br />
Section 3<br />
Section 3: Plann<strong>in</strong>g <strong>in</strong>ternal<br />
quality assurance<br />
Importance <strong>of</strong> plann<strong>in</strong>g <strong>and</strong> preparation<br />
As with any aspect <strong>of</strong> learn<strong>in</strong>g <strong>and</strong> development provision, plann<strong>in</strong>g is essential <strong>in</strong> ensur<strong>in</strong>g a smooth, efficient <strong>and</strong><br />
effective quality assurance process.<br />
To be effective, <strong>the</strong> <strong>IQ</strong>A plan needs to consider <strong>the</strong> follow<strong>in</strong>g factors:<br />
Involvement <strong>of</strong> <strong>the</strong><br />
assessors<br />
Date, time <strong>and</strong><br />
duration<br />
<strong>Award</strong><strong>in</strong>g organisation<br />
requirements<br />
Staff/support availability <strong>and</strong><br />
expertise<br />
Type <strong>of</strong><br />
assessment<br />
Number <strong>and</strong> ability <strong>of</strong><br />
learners<br />
Type <strong>of</strong> <strong>IQ</strong>A method –<br />
desktop/live<br />
<strong>Assessment</strong> method<br />
<strong>and</strong> type<br />
Environmental<br />
conditions<br />
Resources <strong>and</strong><br />
materials<br />
Subject <strong>and</strong> qualification<br />
specification<br />
An <strong>in</strong>itial <strong>sample</strong> plan cover<strong>in</strong>g all aspects needs to be put <strong>in</strong> place to ensure that <strong>the</strong> <strong>IQ</strong>A activities are fair,<br />
thorough <strong>and</strong> st<strong>and</strong>ardised. The nature <strong>of</strong> <strong>the</strong> plan (i.e. <strong>the</strong> size <strong>and</strong> frequency) should be adjusted accord<strong>in</strong>g to <strong>the</strong><br />
qualification (i.e. level, new or well-established), experience <strong>and</strong> competence <strong>of</strong> <strong>the</strong> assessor <strong>in</strong>volved <strong>and</strong> <strong>the</strong> size<br />
<strong>and</strong> characteristics <strong>of</strong> <strong>the</strong> cohort be<strong>in</strong>g <strong>sample</strong>d.<br />
An effective <strong>sample</strong> plan should also <strong>in</strong>clude a clearly written rationale provid<strong>in</strong>g justification for <strong>the</strong> size <strong>and</strong><br />
nature <strong>of</strong> <strong>the</strong> proposed <strong>sample</strong> so that assessors, o<strong>the</strong>r IVs, quality managers or EVs have a clear context for <strong>the</strong><br />
plann<strong>in</strong>g strategy <strong>and</strong> <strong>the</strong> reasons beh<strong>in</strong>d its design.<br />
Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice <strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale 19
Section 4<br />
Monitor<strong>in</strong>g <strong>and</strong> improv<strong>in</strong>g <strong>in</strong>ternal quality assurance<br />
Judg<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> <strong>the</strong> assessment process<br />
When consider<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> <strong>the</strong> assessment process, <strong>the</strong> IV must determ<strong>in</strong>e <strong>the</strong> extent to which <strong>the</strong> assessor<br />
has adhered to <strong>the</strong> appropriate underly<strong>in</strong>g pr<strong>in</strong>ciples <strong>of</strong> assessment:<br />
Sufficient<br />
• Has <strong>the</strong> learner provided enough evidence to meet <strong>the</strong> requirements – number <strong>of</strong> occasions, across a<br />
number <strong>of</strong> contexts, presented <strong>in</strong> different formats?<br />
• The IV needs to ensure that <strong>the</strong> assessor has made judgements on <strong>the</strong> suffi ciency <strong>of</strong> <strong>the</strong> evidence <strong>in</strong> relation<br />
to <strong>the</strong> qualifi cation requirements.<br />
Au<strong>the</strong>ntic<br />
• The evidence must be <strong>the</strong> product <strong>of</strong> <strong>the</strong> learner.<br />
• Practical observations are an effective way <strong>of</strong> confi rm<strong>in</strong>g this due to direct observation.<br />
• Au<strong>the</strong>nticity has become <strong>in</strong>creas<strong>in</strong>gly diffi cult to manage <strong>in</strong> a digital age, with electronic evidence <strong>in</strong>creas<strong>in</strong>g<br />
<strong>the</strong> risk <strong>of</strong> plagiarism.<br />
• The IV must be satisfi ed that <strong>the</strong> assessor has made all reasonable efforts to ensure that <strong>the</strong> work is<br />
au<strong>the</strong>ntic. This could <strong>in</strong>clude additional verbal question<strong>in</strong>g <strong>and</strong> pr<strong>of</strong>essional discussions, as well as<br />
au<strong>the</strong>nticity declarations signed by <strong>the</strong> learner.<br />
Reliable<br />
• It must be possible for an assessment to be repeated with similar learners <strong>in</strong> similar contexts to give <strong>the</strong><br />
same results.<br />
• Different assessors, poorly defi ned criteria <strong>and</strong> variations <strong>in</strong> assessment locations <strong>and</strong> resources all have <strong>the</strong><br />
potential to affect reliability.<br />
• Through portfolio sampl<strong>in</strong>g <strong>the</strong> IV can determ<strong>in</strong>e <strong>the</strong> extent to which <strong>the</strong> assessment judgements are<br />
consistent over time <strong>and</strong> between assessors. The IV can check, where stipulated, <strong>the</strong> secondary mark<strong>in</strong>g <strong>and</strong><br />
moderation <strong>of</strong> exam papers.<br />
• Good practice would be for an IV to quality assure <strong>the</strong> same assessor over a period <strong>of</strong> time <strong>and</strong>/or for<br />
developmental feedback to be shared across <strong>the</strong> <strong>IQ</strong>A team, to allow trends <strong>and</strong> need for support to be picked<br />
up, <strong>and</strong> reliability improved.<br />
28<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale
Monitor<strong>in</strong>g <strong>and</strong> improv<strong>in</strong>g <strong>in</strong>ternal quality assurance<br />
Section 4<br />
St<strong>and</strong>ardisation requirements for assessment<br />
One <strong>of</strong> <strong>the</strong> ma<strong>in</strong> challenges <strong>of</strong> <strong>the</strong> <strong>IQ</strong>A process is ensur<strong>in</strong>g that both delivery <strong>and</strong> assessment <strong>of</strong> qualifi cations is<br />
consistent throughout <strong>the</strong> organisation. This can be challeng<strong>in</strong>g when assessment is occurr<strong>in</strong>g across a large,<br />
remote work<strong>in</strong>g team, across multiple venues all at different times, year-round.<br />
The IV must ensure that:<br />
✦ All assessors consistently make valid decisions.<br />
✦ All assessors make <strong>the</strong> same decisions based on <strong>the</strong> same evidence.<br />
✦ All learners are treated fairly.<br />
The most common <strong>and</strong> effective way to do this is through conduct<strong>in</strong>g st<strong>and</strong>ardisation activities.<br />
Beyond <strong>the</strong> requirements from <strong>the</strong> AO, <strong>the</strong> frequency, format, duration <strong>and</strong> characteristics <strong>of</strong> <strong>the</strong>se activities can be<br />
determ<strong>in</strong>ed by <strong>the</strong> tra<strong>in</strong><strong>in</strong>g provider with <strong>in</strong>put from <strong>the</strong> <strong>IQ</strong>A team. Although st<strong>and</strong>ardisation may be led or facilitated<br />
by an IV or lead IV, <strong>the</strong> assessors <strong>and</strong> IVs should all work as a team for shared responsibility. Activities could be:<br />
Shared unit assessment<br />
Real examples from a specific unit, all<br />
assessed by assessors us<strong>in</strong>g normal<br />
practice. These are collated, discussed<br />
<strong>and</strong> reviewed, <strong>and</strong> feedback is given by<br />
<strong>the</strong> IV.<br />
Alternative evidence<br />
New or unfamiliar forms <strong>of</strong> evidence can<br />
be reviewed by assessors <strong>and</strong> consensus<br />
is established to meet st<strong>and</strong>ards.<br />
Old v new<br />
As a team, work produced to old<br />
st<strong>and</strong>ards is evaluated aga<strong>in</strong>st new<br />
st<strong>and</strong>ards to help highlight where<br />
new evidence may be required <strong>and</strong> old<br />
evidence is no longer needed.<br />
Underst<strong>and</strong><strong>in</strong>g <strong>the</strong> pr<strong>in</strong>ciples <strong>and</strong> practice <strong>of</strong> <strong>in</strong>ternally assur<strong>in</strong>g <strong>the</strong> quality <strong>of</strong> assessment<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale 31
THE PURPOSE OF INTERNAL<br />
QUALITY ASSURANCE<br />
Check<strong>in</strong>g<br />
learner<br />
registration<br />
<strong>and</strong><br />
process<strong>in</strong>g<br />
Monitor<strong>in</strong>g<br />
quality <strong>of</strong><br />
assessment<br />
decisions<br />
Ensur<strong>in</strong>g<br />
consistent<br />
<strong>and</strong> reliable<br />
judgements<br />
are made<br />
Determ<strong>in</strong><strong>in</strong>g<br />
effectiveness<br />
<strong>of</strong> assessment<br />
activities /<br />
methods<br />
QUALITY ASSURANCE<br />
SATISFACTION<br />
100%<br />
G U A R A N<br />
T E E D<br />
Highlight<strong>in</strong>g<br />
problems,<br />
trends <strong>and</strong><br />
development<br />
needs<br />
Ensur<strong>in</strong>g<br />
adherence<br />
to award<strong>in</strong>g<br />
policies<br />
EQUALITY AND DIVERSITY<br />
DATA PROTECTION (GDPR)<br />
SAFEGUARDING<br />
HEALTH AND SAFETY<br />
Copyright © 2019 <strong>Active</strong> <strong>IQ</strong> Ltd. Not for resale