Evaluation of self-reported knowledge and understanding towards a blended research course among pharmacy students: Objective Search Literature Evaluation (OSLE) method validation
DOI:
https://doi.org/10.46542/pe.2022.221.672681Keywords:
Assessment, Curriculum design, OSLE design, Pharmacy educationAbstract
Background: The objective of the study was to evaluate the impact of classroom versus online Modular object-oriented dynamic learning environment (MOODLE)-based teaching on objective search literature evaluation (OSLE) score, as well as to validate the OSLE method for the assessment of research skills in pharmacy students.
Methods: The four-station OSLE method was used to assess the performance and self-reflection at the end of each delivery mode. The students were asked to voluntarily vote for the preference of delivery mode in research courses. A hierarchical regression analysis was performed for variables predicting the “preference” for class-based teaching and/or MOODLE-based learning. Internal face and content validation were performed with students and faculty members not involved in the course teaching. External validation was performed with three professors working in different colleges in United Arab Emirates (UAE), Saudi Arabia and Qatar.
Results: Thirty-five students completed the courses and showed significant improvement in self-reported reflection of pre-post knowledge and understanding. Findings suggested that 87.3% (110/126, 95%CI: 75.9 – 89.4, p < 0.001) achieved performance indicators and reported the OSLE method as an effective tool for the assessment of knowledge and understanding of research skills in pharmacy education. The predictive model suggested a strong positive effect associated with article appraisal, article application, self-reporting of knowledge and self-reporting of understating (R2 0.47, F-1.26, p < 0.001).
Conclusion: The findings suggested the OSLE method as an effective tool of assessment in pharmacy education. A negative impact of MOODLE-based learning was found with self-reflection on knowledge.
References
Alammary, A. (2019), Blended learning models for introductory programming courses: A systematic review. PLOS ONE. 14(9): e0221765 https://doi.org/10.1371/journal.pone.0221765
Alkatheri, A.M., Albekairy, A.M., Khalidi, N., et al. (2019), Implementation of an ACPE-Accredited PharmD Curriculum at a Saudi College of Pharmacy. American Journal of Pharmaceutical Education; 83(9):6237
Bajis, D., Chaar, B., Basheti, I.A., Moles, R. (2019), Pharmacy students' medication history taking competency: Simulation and feedback learning intervention. Currents in Pharmacy Teaching and Learning; 11(10):1002‐1015
Bookstaver, P.B., Miller, A.D., Felder, T.M., Tice, D.L., Norris, L.B., Sutton, S.S. (2012), Assessing pharmacy residents' knowledge of biostatistics and research study design. Annals of Pharmacotherapy; 46(7-8):991‐999
Brown, M.C., Kostrzewa, A.B. (2018), Implementation and Evaluation of Near-Peer Facilitated Journal Club Activities in a Required MLE Course Series. American Journal of Pharmaceutical Education; 82(8):6718. http://doi.org/10.5688/ajpe6718
Cook, D.A., Levinson, A.J., Garside, S., Dupras, D.M., Erwin, P.J., Montori, V.M. (2008) Internet-based learning in the health professions: a meta-analysis. Journal of the American Medical Association; 300(10):1181
Cook, D.A., Levinson, A.J., Garside, S., Dupras, D.M., Erwin, P.J., Montori, V.M. (2010), Instructional design variations in Internet-based learning for health professions education: a systematic review and meta-analysis. Academic Medicine; 85(5):909–922
Dziuban, C., Graham, C.R., Moskal, P.D. et al. (2018),Blended learning: the new normal and emerging technologies. International Journal of Educucational Technology in Higher Education 15, 3. https://doi.org/10.1186/s41239-017-0087-5
Elliott, R.A., McDowell, J., Marriott, J.L., Calandra, A., Duncan, G., (2009), A pharmacy preregistration course using online teaching and learning methods. American Journal of Pharmaceutical Education; 73(5):77
Elnaem, M.H., Bin Che Ibrahim, M.Z., Abdul Rahman, N.A.H., Binti Mahyidin, N.H., Binti Sulaiman, N.M., Binti Zulkiflee, F.A., (2018) Knowledge and perceptions toward cardiology pharmacy education and training: Malaysian pharmacy students' perspectives. Currents in Pharmacy Teaching and Learning; 10(4):453‐462
Freeman, M.K., Schrimsher, R.H., Kendrach, M.G. (2006), Student perceptions of online lectures and WebCT in an introductory drug information course. American Journal of Pharmaceutical Education; 70(6):126
Grover, B., Hayes, B.D., Watson, K. (2014), Feedback in clinical pharmacy education. American Journal of Health-System Pharmacy; 71(18):1592‐1596
Hall, M., Hanna, L.A., Quinn, S. (2012), Pharmacy students' views of faculty feedback on academic performance. American Journal of Pharmaceutical Education; 76(1):5
Harirforoosh, S., Stewart, D.W. (2016), A descriptive investigation of the impact of student research projects arising from elective research courses. BMC Research Notes; 9:48
Harvey, S. (2021), Building Effective Blended Learning Programs, Challenges and Opportunities for the Global Implementation of E-Learning Frameworks http://doi.org/10.4018/978-1-7998-7607-6.ch002
King, A.E., Egras, A.M. (2015), A Required Online Course with a Public Health Focus for Third Professional Year Pharmacy Students. American Journal of Pharmaceutical Education; 79(5):68
Ko, S., Rossen, S. (2017), Teaching Online: A Practical Guide.4th ed, Routledge, New York
Kritikos, V.S., Saini, B., Carter, S., Moles, R.J., Krass, I. (2015), Factors influencing pharmacy students' attitudes towards pharmacy practice research and strategies for promoting research interest in pharmacy practice. Pharmacy Practice (Granada); 13(3):587
Lorenzoni, A.A., Manzini, F., Soares, L., Leite, S.N. (2019) E-learning in Pharmacy Education: what do we know about it?. Brazillian Journal of Pharmaceutical Sciences, vol.55, e18100
Lunn, A.M., Urmston, A., Seymour, S., Manfrin, A. (2020), Patient as teacher sessions contextualize learning, enhancing knowledge, communication, and participation of pharmacy students in the United Kingdom. Journal of Educational Evaluation for Health Professions; 17:15
MOE, UAE. (2020), Distance learning system to continue to be applied till end of current academic year [Internet]. United Arab Emirates Ministry of Education. 2020 [cited 22 May 2020]. Available from: https://www.moe.gov.ae/En/MediaCenter/News/Pages/e-learning3.aspx
Muro, M., Maxim, R., Whiton, J. (2020), The places a COVID-19 recession will likely hit hardest [Internet]. Brookings https://www.brookings.edu/blog/the-avenue/2020/03/17/the-places-a-covid-19-recession-will-likely-hit-hardest/amp/
Nesterowicz, K., Librowski, T., Edelbring, S. (2014) Validating e-learning in continuing pharmacy education: user acceptance and knowledge change. BMC Medical Education; 14:33
Ni, A.Y. (2014), Comparing the effectiveness of classroom and online learning: Teaching research methods. Journal of Public Affairs Education; 19(2):199-215
Pate, K.A., Pate, A.N., Sampognaro, L.A., Brady, J.H., Caldwell, D.J. (2017), Design, implementation, and evaluation of an online elective course on current topics in pharmacy. Currents in Pharmacy Teaching and Learning; 9(4):528‐536
Ramsauer, V.P. (2011), An elective course to engage pharmacy students in research activities. American Journal of Pharmaceutical Education; 75(7):138
Rapp-McCall, L.A., Anyikwa, V. (2016), Active learning strategies and instructor presence in an online research methods course: Can we decrease anxiety and enhance knowledge? Advances in Social Work; 17(1):1-4
Robinson, J.D., Bray, B.S., Willson, M.N., Weeks, D.L. (2011), Using human patient simulation to prepare student pharmacists to manage medical emergencies in an ambulatory setting. American Journal of Pharmaceutical Education; 75(1):3. http://doi.org/10.5688/ajpe7513
Sakeena, M.H.F., Bennett, A.A., Jamshed, S., et al. (2018), Investigating knowledge regarding antibiotics and antimicrobial resistance among pharmacy students in Sri Lankan universities. BMC Infectious Diseases; 18(1):209
Salter, S.M., Karia, A., Sanfilippo, F.M., Clifford, R.M. (2014), Effectiveness of E-learning in pharmacy education. American Journal of Pharmaceutical Education; 78(4):83. http://doi.org/10.5688/ajpe78483
Sun, A., Chen, X. (2016), Online education, and its effective practice: A research review. Journal of Information Technology Education: Research 15: 157-190
Tait, L., Lee, K., Rasiah, R., et al. (2018), Simulation and Feedback in Health Education: A Mixed Methods Study Comparing Three Simulation Modalities. Pharmacy (Basel) ;6(2):41
Takeda, M.Y., Smith, M.J., Cone, C.J. (2017), Debriefing to Improve Student Ability to Assess and Plan for the Care of Persons with Disability. Simulation in Healthcare; 12(6):356‐363. http://doi.org/10.1097/SIH.0000000000000272
UNESCO. 2020 (a) COVID-19 Educational Disruption and Response [Internet]. [cited 22 May 2020]. Available from: https://en.unesco.org/covid19/educationresponse
UNESCO. 2020 (b)Reopening schools: When where and how? [Internet]. [cited 22 May 2020].
Wanat, M.A., Tucker, A.M., Coyle, E.A. (2016), A Critical Care Hybrid Online Elective Course for Third-Year Pharmacy Students. American Journal of Pharmaceutical Education; 80(9):154
Wong, G., Greenhalgh, T., Pawson, R. (2010), Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Medical Education; 10:12.
World Health Organization. 2020. Statement on the second meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of novel coronavirus (2019-nCoV) [Internet]. World Health Organization. 2020 [cited 22 May 2020]. Available from: https://www.who.int/news-room/detail/30-01-2020-statement-on-the-second-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the-outbreak-of-novel-coronavirus-(2019-ncov)
World Health Organization. 2020. WHO Director-General's opening remarks at the media briefing on COVID-19 - 11 March 2020 [Internet]. World Health Organization. 2020 [cited 22 May 2020]. Available from: https://www.who.int/dg/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020
Yardley, S.T. (2012), Kirkpatrick's levels and education ‘evidence.’ Medical Education; 46(1):97–106
