Abstract
Objective
Work Place-Based Assessments (WPBAs) were introduced into psychiatry along with the new curriculum in 2005. The Royal College of Psychiatrists decided to pilot several WPBAs to ascertain their suitability.
Method
Eight types of assessments (Case-Based Discussion, Assessment of Clinical Expertise, Mini-Assessed Clinical Encounter, Mini-Peer Assessment Tool, Direct Observations of Procedural Skills, Patient Satisfaction Questionnaires, Case Conference, and Journal Club Presentation) were piloted, either singly or in combination, on 16 sites, with 600 psychiatric trainees.
Results
Consultant psychiatrists carried out most of the assessments. Case-Based Discussion was the most popular, and high levels of correlation were obtained across several assessment tools.
Conclusions
There is evidence that with suitable training of assessors and trainees, WPBAs can be introduced and are feasible in assessing some competencies.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Davies H, Archer J, Southgate L, et al: Initial evaluation of the first year of the Foundation Assessment Programme. Med Educ 2009; 43:74–81
Brittlebank AD: Piloting workplace-based assessment in psychiatry, in Workplace-Based Assessments in Psychiatry. Edited by Bhugra D, Malik A, Brown N. London, U.K., Gaskell, 2007, pp 96–108
Fitch C: Assessing psychiatric competencies: what does the literature tell us about methods of workplace-based assessment? Adv Psychiatr Treat 2008; 14:122
Norcini JJ: The death of the long case? BMJ 2002; 324:408–409
Norcini JJ, Blank LL, Arnold GK, et al: The mini-CEX (Clinical Evaluation Exercise): a preliminary investigation. Ann Intern Med 1995; 123:795–799
Kogan JR, Bellini LM, Shea JA: Feasibility, reliability, and validity of the mini-Clinical Evaluation Exercise (mCEX) in a medicine core clerkship. Acad Med 2003; 78(Suppl):S33–S35
Holmboe ES, Huot S, Chung J, et al: Construct validity of the mini-Clinical Evaluation Exercise (miniCEX). Acad Med 2003; 78:826–830
Wilkinson J, Benjamin A, Wade W: Assessing the performance of doctors in training. BMJ 2003; 327:s91–s92
Wilkinson JR, Crossley JG, Wragg A, et al: Implementing workplace-based assessment across the medical specialties in the United Kingdom. Med Educ 2008; 42:364–373
Archer JC, Norcini J, Southgate L, et al: mini-PAT (Peer Assessment Tool): a valid component of a national assessment programme in the UK? Adv Health Sci Educ Theory Pract 2008; 13:181–192
Archer JC, Norcini J, Davies HA: Use of SPRAT for peer review of paediatricians in training. BMJ 2005; 330:1251–1253
Chisolm A, Askham J: What Do You Think of Your Doctor?: a review of questionnaires for gathering patients’ feedback on their doctor. Oxford, U.K., Picker Institute, 2006
Violato C, Lockyer J, Fidler H: Multi-source feedback: amethod of assessing surgical practice. BMJ 2003; 326:546–548
Crossley J, Eiser C, Davies HA: Children and their parents assessing the doctor-patient interaction: a rating system for doctors’ communication skills. Med Educ 2005; 39:820–828
Searle G: Evidence-based medicine: case presentation and journal club assessments, in Workplace-Based Assessments in Psychiatry. Edited by Bhugra D, Malik A, Brown N. London, U.K., Gaskell, 2007, pp 76–82
Holmboe ES, Hawkins RE, Huot SJ: Effects of training in direct observation of medical residents’ clinical competence: a randomized trial. Ann Intern Med 2004; 140:874–881
Schuwirth LW, van der Vleuten CPM: A plea for new psychometric models in educational assessment. Med Educ 2006; 40:296–300
Crossley J, Russell J, Jolly B, et al: “I’m pickin’ up good regressions:” the governance of generalisability analyses. Med Educ 2007; 41:926–934
van der Vleuten CPM, Schuwirth LWT: Assessing professional competence: from methods to programmes. Med Educ 2005;39:309–317
Lydall GJ, Malik A, Bhugra D: MTAS: Mental health of applicants seems to be deteriorating. BMJ 2007; 334:1335
Webb LC, Juul D, Reynolds CF III, et al: How well does the psychiatry residency in-training examination predict performance on the American Board of Psychiatry and Neurology. Part I Examination? Am J Psychiatry 1996; 153: 831–832
Juul D, Scully JH Jr, Scheiber SC: Achieving board certification in psychiatry: a cohort study. Am J Psychiatry 2003; 160:563–565
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Brittlebank, A., Archer, J., Longson, D. et al. Workplace-Based Assessments in Psychiatry: Evaluation of a Whole Assessment System. Acad Psychiatry 37, 301–307 (2013). https://doi.org/10.1176/appi.ap.11110198
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1176/appi.ap.11110198