Using consensus methods to develop a communication process assessment tool for Year one undergraduate pharmacy students in Great Britain
Keywords:
Counselling, Health Humanities, Interviewing, Patients’ Experiences, Self-ReflectionAbstract
Introduction: Effective communication is important for delivering patient-centred care and has two components: content (what is said) and process (how it is said). However, assessing communication process is often overlooked. This paper describes the development of a tool for the assessment of communication process in Year one British undergraduate M.Pharm. students.
Description of innovation: Tool development involved three stages: initial construction (Stage 1); testing for inter-rater reliability then revising the tool using consensus methods (Stage 2); re-testing to determine inter-rater reliability and usability (Stage 3).
Evaluation: Inter-rater reliability improved following revision of the tool, with kappa score increasing from 0.065 (Stage 2) to 0.217 (Stage 3). Consensus meetings improved usability, face and content validity.
Future plans and Implementation: The tool can be adapted according to the learning outcomes being assessed, year of study, and communication scenario. Using it throughout the undergraduate programme has allowed for constructive alignment of teaching and assessment.
References
Abdel-Tawab, R., James, D.H., Fichtinger, A., Clatworthy, J., Horne, R. & Davies, G. (2011). Development and validation of the Medication-Related Consultation Framework (MRCF). Patient Education and Counseling, 83(3), 451–457. doi:10.1016/j.pec. 2011.05.005
Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32, 347-364. doi:10.1007/BF00138871
Boursicot, K. & Roberts, T. (2006). Setting Standards in a Professional Higher Education Course: Defining the Concept of the Minimally Competent Student in Performance-Based Assessment at the. Higher Education Quarterly, 60, 74–90. doi:10.1111/j.1468- 2273.2006.00308.x
Campbell, S.M., Roland, M.O. & Buetow, S.A. (2000). Defining quality of care. Social Science and Medicine, 51, 1611–1625. doi:10.1016/S0277-9536(00)00057-5
Centre for Pharmacy Postgraduate Education. (2014). Consultation skills for pharmacy practice: taking a patient centred approach. Manchester: Outset Publishing Ltd.
Cömert, M., Zill, J.M., Christalle, E., Dirmaier, J., Härter, M. & Scholl, I. (2016). Assessing communication skills of medical students in Objective Structured Clinical Examinations (OSCE) - A systematic review of rating scales. PLoS ONE, 11, 1-15. doi:10.1371/journal.pone. 0152717
Draper, J., Kurtz, S. & Silverman, J. (2005). Teaching and Learning Communication Skills in Medicine (Second Edition.). Oxford: Radcliffe Pub.
Dwamena, F., Holmes-Rovner, M., Gaulden, C.M., Jorgenson, S., Sadigh, G., Sikorskii, A., Lewin, S., Smith, R.C., Coffey, J., Olomu, A. & Beasley, M. (2012). Intervention for providers to promote a patient-centered approach in clinical consultations. Cochrane Database of Systematic Reviews, 12(12), doi:10.1002/ 14651858.CD003267.pub2
Hallgren, K.A. (2012). Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23–34. doi:10.1016/j.biotechadv.2011.08.021.Secreted
Hess, R., Hagemeier, N.E., Blackwelder, R., Rose, D., Ansari, N. & Branham, T. (2016). Teaching communication skills to medical and pharmacy students through a blended learning course. American Journal of Pharmaceutical Education, 80(4). doi:10.5688/ajpe 80464
Hobgood, C. D., Riviello, R.J., Jouriles, N. & Hamilton, G. (2002). Assessment of communication and interpersonal skills competencies. Academic Emergency Medicine, 9, 1257–1269. doi:10.1197/aemj.9.11.1257
Kimberlin, C.L. (2006). Communicating with patients: skills assessment in US colleges of pharmacy. American Journal of Pharmaceutical Education, 70(3), 67. doi:10. 5688/aj700367
Kurtz, S.M. & Silverman, J.D. (1996). The Calgary- Cambridge Referenced Observation Guides: an aid to defining the curriculum and organizing the teaching in communication training programmes. Medical Education, 30(2), 83–89. doi:http://dx.doi.org/10.1111/j. 1365-2923.1996.tb00724.x
NHS Health Education England. (2014). Consultation Skills for Pharmacy Practice: Practice standards for England. March 2014 (online). Available at: http:// www.consultationskillsforpharmacy.com/docs/docc.pdf. Accessed 3rd January, 2019
Streiner, D.L., Norman, G.R. & Cairney, J. (2014). Health Measurement Scales (5th Edition.). Oxford University Press
Svensberg, K., Björnsdottir, I., Wallman, A. & Sporrong, S. K. (2017). Nordic pharmacy schools’ experience in communication skills training. American Journal of Pharmaceutical Education, 81(9), 24–35. doi:10.5688/ ajpe6005
Taylor, K. (2009). Paternalism, participation and partnership-The evolution of patient centeredness in the consultation. Patient Education and Counseling, 74(2009), 150–155. doi:10.1016/j.pec.2008.08.017
Van der Vleuten, C.P.M. & Swanson, D.B. (1990). Assessment of clinical skills with standardized patients: State of the art. Teaching and Learning in Medicine, 2(2), 58–76. doi:10.1080/10401339009539432
Wilkinson, T.J., Frampton, C.M., Thompson-Fawcett, M. & Egan, T. (2003). Objectivity in objective structured clinical examinations: checklists are no substitute for examiner commitment. Academic Medicine: Journal of the Association of American Medical Colleges, 78, 219– 223
