18.05.2014 Views

A Guide to Core Psychiatry (CPT) Workplace Based Assessments ...

A Guide to Core Psychiatry (CPT) Workplace Based Assessments ...

A Guide to Core Psychiatry (CPT) Workplace Based Assessments ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

A <strong>Guide</strong> <strong>to</strong> <strong>Core</strong> <strong>Psychiatry</strong> (<strong>CPT</strong>) <strong>Workplace</strong> <strong>Based</strong><br />

<strong>Assessments</strong> (WPBAs) & ARCP<br />

Competence Attainment<br />

All trainees will have an Annual Review of Competence Progression (ARCP) organised by<br />

their deanery. This is described in the Gold <strong>Guide</strong> and replaces the RITA process. The key<br />

elements of this review are:<br />

Appraisal<br />

i. Educational<br />

ii. NHS<br />

Assessment of performance<br />

i. <strong>Workplace</strong> <strong>Based</strong> <strong>Assessments</strong> (WBAs)<br />

ii. Experience demonstrated e.g. from portfolio including audit, research and<br />

other aspects of non-clinical competence<br />

Planning<br />

Achievement of competencies will be considered in the Educational Supervisor’s Report and<br />

the Educational Supervisor will consider WPBA and other evidence such as examinations<br />

passed and experiential outcomes recorded in the portfolio. The competencies will be<br />

considered under 11 domains:<br />

i. Providing a good standard of practice and care<br />

ii. Decisions about access <strong>to</strong> care<br />

iii. Treatment in emergencies<br />

iv. Maintaining good medical practice<br />

v. Maintaining performance<br />

vi. Teaching and training, appraising and assessing<br />

vii. Relationships with patients<br />

viii. Dealing with problems in professional practice<br />

ix. Working with colleagues<br />

x. Maintaining probity<br />

xi. Ensuring that health problems do not put patients at risk<br />

Underlying Principles of <strong>Workplace</strong> <strong>Based</strong> <strong>Assessments</strong><br />

<strong>Workplace</strong> based assessments must comply with the following:<br />

They must focus on performance (i.e. what you actually do in the workplace)<br />

They must be evidence based<br />

Evidence must be triangulated whenever possible (i.e. it must be provided by<br />

different assessors, on different occasions, and if possible using different methods)<br />

Records must be permanent – assessment forms must not be lost or destroyed (this<br />

is achieved by online s<strong>to</strong>rage).<br />

Purpose of <strong>Workplace</strong> <strong>Based</strong> <strong>Assessments</strong><br />

The purpose of the workplace based assessments is twofold:<br />

Firstly, they have a formative function as the basis for feedback and educational<br />

planning. This helps included helping identify any specially focused teaching and<br />

learning that might be necessary <strong>to</strong> fill gaps or resolve weaknesses. You should have


WPBAS completed regularly throughout your placement <strong>to</strong> demonstrate effective review<br />

and appraisal. Therefore, do not leave them until the end of each stage of training or<br />

clinical placement.<br />

Secondly, although individually they have no ‘pass’ or ‘fail’ score, taken <strong>to</strong>gether WPBAs<br />

contribute <strong>to</strong> the Annual Review of Competence Progression (ARCP), which has a<br />

summative function providing evidence of the attainment of competencies. Successful<br />

completion of the ARCP process is manda<strong>to</strong>ry for eligibility for the MRCPsych<br />

examinations.<br />

Type of <strong>Workplace</strong> <strong>Based</strong> <strong>Assessments</strong><br />

There are 8 workplace based assessments currently available. These are described in detail<br />

in the trainee and assessor guidance for each WPBA <strong>to</strong>ol and are merely outlined below.<br />

Assessment of Clinical Expertise (ACE)<br />

The assessor observes a whole new patient encounter in order <strong>to</strong> be able <strong>to</strong> assess<br />

your ability <strong>to</strong> take a full his<strong>to</strong>ry and mental state examination and arrive at a diagnosis<br />

and management plan.<br />

Mini-Assessed Clinical Encounter (mini-ACE)<br />

The assessor observes part of a patient interaction, for example his<strong>to</strong>ry taking or<br />

negotiating a treatment plan, and rates your performance.<br />

Case-based Discussion (CbD)<br />

You select two sets of notes of patients you have recently seen and the assessor picks<br />

one <strong>to</strong> discuss. The discussion will allow demonstration of clinical decision-making and<br />

the application of clinical knowledge.<br />

Case Presentation (CP)<br />

This <strong>to</strong>ol can be used when you give clinical presentations and involves assessment of<br />

domains such as presentation skills and interpretation of evidence.<br />

Journal Club Presentation (JCP)<br />

This can be used when you present a journal article and covers domains such as<br />

analysis and critique and answering questions.<br />

Directly Observed Procedural Skills (DOPS)<br />

This has more limited use in psychiatry compared <strong>to</strong> other areas of medicine but can<br />

used in situations such as administering ECT.<br />

Mini-Peer Assessment Tool (mini-PAT)<br />

It allows co-workers <strong>to</strong> assess your attitudes and behaviours and ability <strong>to</strong> work well with<br />

colleagues.<br />

Assessment of Teaching (AoT)<br />

This is a new <strong>to</strong>ol that has been developed after feedback from the pilot programme. It<br />

allows an assessment <strong>to</strong> be made of teaching skills and may relate <strong>to</strong> a lecture, tu<strong>to</strong>rial<br />

or small group teaching session that you lead.<br />

Carrying out <strong>Workplace</strong> <strong>Based</strong> <strong>Assessments</strong><br />

You are responsible for organising your assessments. You should discuss the areas in<br />

which you need <strong>to</strong> be assessed with your Educational Supervisor and plan your WPBAs<br />

accordingly. Remember that you will need <strong>to</strong> be assessed by a range of different assessors<br />

in different situations <strong>to</strong> ensure triangulation of evidence. Don’t rely on your Educational<br />

Supervisor <strong>to</strong> perform all the assessments! Also remember that you must ask for the<br />

patient’s agreement when you perform a WPBA that involves a patient.<br />

There is an online system for the completion and s<strong>to</strong>rage of WPBAs. You can register for<br />

this through the College website and it can be accessed at http://training.rcpsych.ac.uk/.<br />

After you register you will be able <strong>to</strong> access the forms relevant <strong>to</strong> the manda<strong>to</strong>ry WPBAs (ie


ACE, mini-ACE, CbD and mini-PAT). Your assessors must then complete these<br />

assessments online.<br />

<strong>Workplace</strong> <strong>Based</strong> Assessment Requirements<br />

The learning needs of individual trainees will determine which competencies they need <strong>to</strong> be<br />

assessed in and the number of assessments that need <strong>to</strong> be performed; the College<br />

Assessment Programme’s eligibility structure should be regarded as a minimum number.<br />

Briefly, the number of WPBA’s stipulated in the Assessment Programme for CT1 and ST2&3<br />

is as follows<br />

Minimum Number required per year<br />

WPBA CT1 CT2 / ST2 CT3 / ST3<br />

Ace 2 3 3<br />

Mini-ACE 4 4 4<br />

CbD 2 2 2<br />

mini-PAT* 2 2 2<br />

Recommended Number per year<br />

WPBA CT1 CT2 / ST2 CT3 / ST3<br />

CP 1 1 1<br />

JCP 1 1 1<br />

DOPS<br />

As the opportunity arises<br />

AoT<br />

As the opportunity arises<br />

*There will be 5 rounds of mini-PAT’s per year of which 2 must be completed<br />

The guidelines in the above tables should be regarded as the minimum number of<br />

WPBAs: many trainees will need <strong>to</strong> do more, for example <strong>to</strong> provide additional evidence of<br />

achievement in a particular area of professional practice. It is important <strong>to</strong> again note that<br />

there is no ‘pass’ or ‘fail’ score for WPBA.<br />

You must note that, since they form the basis for feedback and educational planning, you<br />

must arrange WPBAs at appropriate intervals throughout your training rather than leaving<br />

them until the end of each stage. In particular, we strongly suggest that within the early<br />

stages of each phase of training or clinical placement (i.e. within the first month) you<br />

undertake a mini-ACE or ACE and a CbD. This is because these <strong>to</strong>ols reflect closely the<br />

expected day-<strong>to</strong>-day work of a psychiatric trainee both in terms of the assessment of cases<br />

and clinical reasoning and judgement. The purpose of these early assessments is <strong>to</strong> identify<br />

what you are doing well and in which areas you need <strong>to</strong> develop. They contribute valuable<br />

information <strong>to</strong> the educational planning of your placement. Therefore it is most unlikely that<br />

assessments made early will produce ratings consistent with performance at the standard<br />

expected for the completion of the stage of training.<br />

Educational Supervisors Report / College Tu<strong>to</strong>r’s Report<br />

The Educational Supervisor’s Report and the College Tu<strong>to</strong>r’s Report will be submitted for<br />

consideration by the ARCP. It is the ARCP that validates the achievement of competence<br />

after considering the presented portfolio information. It is important <strong>to</strong> note that as the ARCP


considers a range of evidence, it is possible for you <strong>to</strong> have performed well in your WPBAs<br />

but be considered by the ARCP panel <strong>to</strong> require further development. The outcomes for<br />

ARCP are described in the Gold <strong>Guide</strong> http://www.mmc.nhs.uk/Docs/A <strong>Guide</strong> <strong>to</strong><br />

Postgraduate Specialty Training in the UK (Gold <strong>Guide</strong>).doc<br />

Portfolio<br />

This replaces the previous College logbook. It allows you <strong>to</strong> collate other evidence in<br />

addition <strong>to</strong> your WPBA. A template can be found here on the Royal College of Psychiatrists<br />

Website:<br />

http://www.rcpsych.ac.uk/docs/Portfolio framework - May 2008 (2).doc<br />

This document is intended <strong>to</strong> provide a framework from which trainees can build a portfolio<br />

of evidence of their progress and attainment. It should be modified and adapted <strong>to</strong> suit<br />

individual training needs. Duplicate pages of each section should be created as necessary.<br />

This framework should be used electronically and updated regularly. It can then be printed<br />

out when necessary, for example for the Annual Review of Competence Progression.<br />

Suggested timetable for submission of WPBA’s<br />

This is a suggested timetable for a trainee in a six-month placement; schedules for individual<br />

trainees will vary depending upon local requirements and the trainee’s needs.<br />

Month 1 Month 2 Month 3 Month 4 Month 5 Month 6<br />

SPECIFIC FORMS TO BE SUBMITTED DURING CERTAIN MONTHS<br />

Individual<br />

learning plan<br />

1st self<br />

appraisal<br />

It is<br />

recommended<br />

that one of the<br />

patient<br />

encounter<br />

forms (ACE or<br />

mini-ACE) is<br />

completed now<br />

*Self appraisal<br />

form for 3<br />

months<br />

*Mid term<br />

assessment<br />

form<br />

Mini-Peer<br />

Assessment<br />

Tool<br />

*Self appraisal<br />

form (month<br />

5)<br />

OVER THE 6 MONTH PERIOD<br />

Combination of ACE/Mini ACE/CbD – <strong>to</strong>tal of 4 forms <strong>to</strong> be submitted during 6 month rotation<br />

Case Conference Presentation – at least 1 form <strong>to</strong> be submitted every 12 months<br />

Journal Club Presentation - at least 1 form <strong>to</strong> be submitted every 12 months<br />

AoT should be completed as the opportunity arises<br />

DOPS (for the those carrying out ECT) submit until lead clinician is satisfied with progress<br />

*Where these are required by your Trust and/or Programme, also note your local arrangements for<br />

submission of the Educational Supervisor’s Structured Report and workplace based (NHS) appraisal<br />

ARCP Requirements


Trainees are required <strong>to</strong> complete the following in preparation of their ARCP assessment.<br />

1. WPBAs completed as directed above<br />

2. Educational Supervisor Form – 1 completed for each rotation (e.g. 2 posts in 12<br />

months = 2 reports)<br />

3. College Tu<strong>to</strong>r Form<br />

4. Evidence of Psychotherapy Development<br />

5. Evidence of PCT training<br />

6. Portfolio (completed in accordance with the Royal College of Psychiatrists Portfolio<br />

Guidance inc. results of WPBAs and Exam Certificates) Must include:<br />

i. Evidence of Clinical Activity (logbook)<br />

ii. Educational Plan<br />

iii. Evidence of MRCPsych attendance<br />

iv. Exam Sitting / Results / Certificates<br />

v. NHS Appraisal<br />

vi. Any other evidence<br />

7. Confirmation of completion of PMETB survey<br />

8. Form R<br />

9. Any other evidence that they feel will be beneficial <strong>to</strong> the ARCP process<br />

All the information must be presented <strong>to</strong> the trainees’ Educational Supervisor / College Tu<strong>to</strong>r<br />

at the Pre-ARCP meeting. The Educational Supervisors / College Tu<strong>to</strong>r will make a<br />

recommendation of Outcome <strong>to</strong> the ARCP panel. Failure <strong>to</strong> produce this information will<br />

result the Educational Supervisors / College Tu<strong>to</strong>r recommending <strong>to</strong> the panel that an<br />

Unsatisfac<strong>to</strong>ry Outcome be issued. The trainee will then be required <strong>to</strong> meet with the panel<br />

and discuss the missing evidence and agree future action.<br />

Paperwork Required for ARCP<br />

Trainees will be required <strong>to</strong> submit prior <strong>to</strong> the ARCP the following documentation:<br />

Educational Supervisors Report (signed copy with original being retained by the trainee)<br />

College Tu<strong>to</strong>r Report (signed copy with original being retained by the trainee)<br />

Trainees who attend a face <strong>to</strong> face ARCP will also be expected <strong>to</strong> bring the following with<br />

documentation for review:<br />

Portfolio – completed in accordance with the Royal College of Psychiatrists Portfolio<br />

Guidance inc. results of WPBAs and Exam Certificates<br />

Educational Supervisors Report (original copy)<br />

College Tu<strong>to</strong>r Report (original copy)<br />

Evidence of Psychotherapy Development<br />

Any other evidence they feel will be beneficial<br />

Key Contact Details<br />

Head of School of <strong>Psychiatry</strong><br />

Dr Kate Lovett


Training Programme Direc<strong>to</strong>rs<br />

Child and Adolescent <strong>Psychiatry</strong><br />

General and Old Age <strong>Psychiatry</strong><br />

Forensic <strong>Psychiatry</strong><br />

Dr Sarah Huline-Dickens<br />

Dr Giles Richards<br />

Dr Eluned Dorkins<br />

Clinical Tu<strong>to</strong>rs<br />

Cornwall Partnership Trust<br />

Devon Partnership Trust<br />

North Devon Partnership Trust<br />

Plymouth Partnership Trust<br />

South Devon Partnership Trust<br />

Dr David Cox<br />

Dr Charles Dixon<br />

Dr Alison Collins<br />

Dr David Bicker<strong>to</strong>n<br />

Dr San Sreenath<br />

Regional Advisor<br />

Regional Advisor - Peninsula<br />

Dr Mike Metcalfe<br />

Deanery Contacts<br />

School Manager<br />

School Administra<strong>to</strong>r<br />

Heather Rowley<br />

Carla Miners

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!