A comparison between student performances on objective structured clinical examination and virtual simulation
DOI:
https://doi.org/10.46542/pe.2021.221.466473Keywords:
MyDispense, Objective Structured Clinical Examination (OSCE), Simulation, Virtual PharmacyAbstract
Objective: To compare the pharmacy students’ performance on an interactive web-based virtual pharmacy tool versus in-person objective structured clinical examination (OSCE).
Methods: The academic performance of fourth-year pharmacy students in patient interview, counseling and medication dispensing were assessed using MyDispense, a virtual pharmacy practice online case scenario, versus physical OSCE. The grades of the same students in both exams were compared, and the students were administered a questionnaire to explore their perception of virtual experience after completion of the exercise. The internal consistency and reliability of the case scenarios and questionnaire were examined by calculating Cronbach’s alpha coefficient.
Results: There was a significant increase (p = 0.01) in the average test scores of the virtual exam than the in-person OSCE. Similarly, female students had higher performance on virtual simulation than OSCE (p = 0.03). However, a comparison of the online MyDispense and OSCE assessment grades did not find a direct correlation (Spearman’s rho = 0.060). The results from the self-administered questionnaire demonstrated high students’ satisfaction and effective application of their knowledge through MyDispense for targeted patient interview, counseling and communication skills.
Conclusion: The MyDispense virtual experience was well-perceived by the students as a useful online learning tool for pharmacy practice. However, there was no direct correlation between online and in-person OSCE assessment grades.
References
Al-Dahir, S., Bryant, K., Kennedy, K.B., & Robinson, D.S. (2014). Online virtual-patient cases versus traditional problem-based learning in advanced pharmacy practice experiences. American journal of pharmaceutical education, 78(4), 76. https://doi.org/10.5688/ajpe78476
Alghamdi, S., & Ali, M. (2021). Pharmacy Students' Perceptions and Attitudes towards Online Education during COVID-19 Lockdown in Saudi Arabia. Pharmacy (Basel, Switzerland), 9(4), 169. https://doi.org/10.3390/pharmacy9040169
Ali, M., Allihyani, M., Abdulaziz, A., Alansari, S., Faqeh, S., Kurdi, A., & Alhajjaji, A. (2021). What just happened? Impact of on-campus activities suspension on pharmacy education during COVID-19 lockdown - A students' perspective. Saudi pharmaceutical journal : SPJ : the official publication of the Saudi Pharmaceutical Society, 29(1), 59–66. https://doi.org/10.1016/j.jsps.2020.12.008
Benedict, N., & Schonder, K. (2011). Patient simulation software to augment an advanced pharmaceutics course. American journal of pharmaceutical education, 75(2), 21. https://doi.org/10.5688/ajpe75221
Benedict, N., Schonder, K., & McGee, J. (2013). Promotion of self-directed learning using virtual patient cases. American journal of pharmaceutical education, 77(7), 151. https://doi.org/10.5688/ajpe777151
Bukoye, O.T., & Shegunshi, A. (2016). Impact of engaging teaching model (ETM) on students’ attendance. Cogent Education, 3(1): 1221191. https://doi.org/0.1080/2331186X.2016.1221191
Coyne, L., Merritt, T.A., Parmentier, B.L., Sharpton, R.A., & Takemoto, J.K. (2019). The Past, Present, and Future of Virtual Reality in Pharmacy Education. American journal of pharmaceutical education, 83(3), 7456. https://doi.org/10.5688/ajpe7456
Cronbach L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/BF02310555
Curley, L.E., McDonald, M., & Aspden, T. (2016). Use of a fictitious community-based virtual teaching platform to aid in the teaching of pharmacy practice skills: Student perspectives after initial implementation. Journal of pharmaceutical policy and practice, 9, 24. https://doi.org/10.1186/s40545-016-0077-3
Douglass, M.A., Casale, J.P., Skirvin, J.A., & DiVall, M.V. (2013). A virtual patient software program to improve pharmacy student learning in a comprehensive disease management course. American journal of pharmaceutical education, 77(8), 172. https://doi.org/10.5688/ajpe778172
Jee, S., Grimes, L., Desborough, J., & Cutts, C. (2016). The national consultation skills for pharmacy practice program in England. Currents in pharmacy teaching & learning, 8(3), 442–446. https://doi.org/10.1016/j.cptl.2016.02.020
Lee Chin, K., Ling Yap, Y., Leng Lee, W., & Chang Soh, Y. (2014). Comparing effectiveness of high-fidelity human patient simulation vs case-based learning in pharmacy education. American journal of pharmaceutical education, 78(8), 153. https://doi.org/10.5688/ajpe788153
Lim, A.S., Lee, S., Karunaratne, N., & Caliph, S. (2020). Pharmacy Students' Perceptions and Performance on the Use of an Online Virtual Experience Tool for Practicing Objective Structured Clinical Examinations. American journal of pharmaceutical education, 84(11), 7920. https://doi.org/10.5688/ajpe7920
Lucas, C., Williams, K., & Bajorek, B. (2019). Virtual Pharmacy Programs to Prepare Pharmacy Students for Community and Hospital Placements. American journal of pharmaceutical education, 83(10), 7011. https://doi.org/10.5688/ajpe7011
Maarek, J.I. (2018). Benefits of Active Learning Embedded in Online Content Material Supporting a Flipped Classroom
Mak, V., Fitzgerald, J., Holle, L., Vordenberg, S. E., & Kebodeaux, C. (2021). Meeting pharmacy educational outcomes through effective use of the virtual simulation MyDispense. Currents in pharmacy teaching & learning, 13(7), 739–742. https://doi.org/10.1016/j.cptl.2021.03.003
McDowell, J., Styles, K., Sewell, K., Trinder, P., Marriott, J., Maher, S., & Naidu, S. (2016). A Simulated Learning Environment for Teaching Medicine Dispensing Skills. American journal of pharmaceutical education, 80(1), 11. https://doi.org/10.5688/ajpe80111
McGaghie, W. C., Issenberg, S. B., Petrusa, E. R., & Scalese, R. J. (2010). A critical review of simulation-based medical education research: 2003-2009. Medical education, 44(1), 50–63. https://doi.org/10.1111/j.1365-2923.2009.03547.x
Nicol, A.A., Owens, S.M., Le Coze, S.S., MacIntyre, A., & Eastwood, C. (2018). Comparison of high-technology active learning and low-technology active learning classrooms. Active Learning in Higher Education, 19(3), 253–265. https://doi.org/10.1177/1469787417731176
Palanisamy, A. (2022). Comprehensive assessment of reliability and validity for the clinical cases in simulated community pharmacy. Pharmacy Education. 22(1), 183 – 190. https://doi.org/10.46542/pe.2022.221.183190
Ray, S. M., Wylie, D.R., Shaun Rowe, A., Heidel, E., & Franks, A.S. (2012). Pharmacy student knowledge retention after completing either a simulated or written patient case. American journal of pharmaceutical education, 76(5), 86. https://doi.org/10.5688/ajpe76586
Seybert, A. L., Smithburger, P. L., Kobulinsky, L. R., & Kane-Gill, S. L. (2012). Simulation-based learning versus problem-based learning in an acute care pharmacotherapy course. Simulation in healthcare : journal of the Society for Simulation in Healthcare, 7(3), 162–165. https://doi.org/10.1097/SIH.0b013e31825159e3
Shatto, B., & Erwin, K. (2017). Teaching Millennials and Generation Z: Bridging the Generational Divide. Creative nursing, 23(1), 24–28. https://doi.org/10.1891/1078-4535.23.1.24
Shin, J., Tabatabai, D., Boscardin, C., Ferrone, M., & Brock, T. (2018). Integration of a Community Pharmacy Simulation Program into a Therapeutics Course. American journal of pharmaceutical education, 82(1), 6189. https://doi.org/10.5688/ajpe6189
Smithburger, P. L., Kane-Gill, S. L., Ruby, C. M., & Seybert, A. L. (2012). Comparing effectiveness of 3 learning strategies: simulation-based learning, problem-based learning, and standardized patients. Simulation in healthcare : journal of the Society for Simulation in Healthcare, 7(3), 141–146. https://doi.org/10.1097/SIH.0b013e31823ee24d
Taglieri, C. A., Crosby, S. J., Zimmerman, K., Schneider, T., & Patel, D. K. (2017). Evaluation of the Use of a Virtual Patient on Student Competence and Confidence in Performing Simulated Clinic Visits. American journal of pharmaceutical education, 81(5), 87. https://doi.org/10.5688/ajpe81587
Thompson, J., White, S., & Chapman, S. (2020). Virtual patients as a tool for training pre-registration pharmacists and increasing their preparedness to practice: A qualitative study. PloS one, 15(8), e0238226. https://doi.org/10.1371/journal.pone.0238226
