A controlled study of the general level framework: Results of the Southof England competency study
Keywords:
Competence, controlled trial, CPD, competency framework, pharmacyAbstract
Background: In consistency in the practice of clinical pharmacy at a junior level encouraged our group to develop a general level competency framework (GLF) to facilitate practitioner development and assessment. The framework consists of patient-related, personal and problem-solving clusters of competencies assessed on a four-point frequency scale. This study describes a large, controlled study to determine whether the framework could improve the clinical practice of junior hospital pharmacists.
Method: One hundred and two junior grade pharmacists in 22 acute NHS trusts in the south of England were recruited. The hospitals were enrolled as either intervention (n=13; 72 pharmacists) or non-intervention sites (n=9; 30 pharmacists).The pharmacists (“tutees”) and senior supervisors (“tutors”) in the active sites used the competency framework for practice development. Tutees and tutors in the control sites did not have access to the competency framework, and measures were taken to ensure these trusts remained isolated from the assessment outcomes. All pharmacists were assessed at baseline, 3, 6and 12 months. Non-intervention pharmacists were assessed by external evaluators.
Results: A repeat measures analysis (month-6 compared to baseline, month-12 compared to baseline) revealed that the intervention group showed an improvement in 24 of the 25 competencies at month-6, which was sustained at month-12. In contrast, the non-intervention pharmacists demonstrated an improvement in just 7 of the competencies at month-6 increasing to 12 competencies by month-12 (Table I). Using an aggregated competency score for each recruit, intervention and non-intervention pharmacists were compared using an application of Kaplan-Meier analysis. Event status was defined as the achievement of competence, detected by the attainment of a predefined threshold score. A significant difference existed between the groups at all time points (log rank=7.97,p=0.0048).
Discussion: This controlled study demonstrates that tutees in the intervention sites improved significantly in 24 of the 25 patient-related competencies at 6 months and that this was sustained at 12 months. By contrast, non-intervention candidates showed progression in only 12 of the 25 competencies.
References
Davies, J. G., Webb, D. G., McRobbie, D., & Bates, I. (2002).Fitness for practice: A competency-based approach.Pharmaceutical Journal,268, 104–106.
Department of Health. (1998).A First Class Service: Quality in the new NHS. London: Department of Health Publications.
Department of Health. (2000a).The NHS Plan: A plan for investment, a plan for reform. London: HM Stationary Office.
Department of Health. (2000b).Pharmacy in the future-implementing the NHS Plan: A programme for pharmacy in the National Health Service. London: Department of Health Publications.
Department of Health. (2001a).The Report of the Public Inquiry into children’s heart surgery at the Bristol Royal Infirmary 1984–1995,Learning from Bristol. London: Department of Health Publications
Epstein, R. M., & Hundert, E. M. (2002). Defining and assessing professional competence. JAMA,287, 226 –244.
Goldsmith, G. M., Quinn, J., Bates, I., Davies, J. G., McRobbie, D.,& Webb, D. G.(2003). A pilot study to evaluate clinical
competence in junior grade pharmacy practitioners. Pharmacy World and Science,25, A13–A14.
McKinley, R. K., Fraser, R. C., & Baker, R. (2001). Model for directly assessing and improving clinical competence and performance in re validation of clinicians. BMJ, 322,712 –715.
McRobbie, D., Webb, D. G., Bates, I., Wright, J., & Davies, J. G.(2001). Assessment of clinical competence: Designing acompetence grid for junior pharmacists.Pharmacy Education,1, 67–76.
Meadows, N., Webb, D., McRobbie, D., Antoniou, S., Bates, I., &Davies, J. G. (2004). Developing and validating a competencyframework for advanced pharmacy practice.Pharmaceutical Journal,273, 789–792.
Miller, G. E. (1990). The assessment of clinical skills/performance.Acad. Med.,65, 563–567.
National Prescribing Centre/NHS Executive. (2000). Competencies for pharmacists working in primary care. http://www.npc.co.uk/publications/CompPharm/CompetenciesDoc.pdf. Accessed from the internet 08/2004.
Rajah, T., Bates, I., Davies, J. G., Webb, D., & Feleming, G. (2001).An occupational survey of hospital pharmacists in the south of England.Pharm J,264, 866.
Royal Pharmaceutical Society of Great Britain. (2004). Competencies of the future pharmacy workforce: Phase 1 report.
Whiddett, S., & Hollyforde, S. (1999).The Competencies Handbook.London: Institute of Personnel and Development.
