Pilot evaluation of an electronic game developed to teach medication history taking to pharmacy students
Keywords:
Computer Game, Gamification, Medication History, Medication Reconciliation, Pharmacy EducationAbstract
Objectives: This pilot study aimed to evaluate a novel electronic medication reconciliation game for teaching medication history taking.
Method: Sixty-six final year Master of Pharmacy students used the eMedRec game during nine weekly tutorials throughout semester two in addition to problem-based learning cases. The authors compared the change in self- perceived confidence and competence surveys in semester two to usual teaching in semester one. Game usability was evaluated using survey the System Usability Scale (SUS) after game exposure.
Results: Difference in student self-perceived confidence after game exposure were comparable to those observed in semester one (difference in mean change -0.31 (-0.72 – 0.08)) while there was a significant increase in self-perceived competence following game exposure compared to usual teaching (difference in mean change 1.2 (0.66 – 1.80)). The game had a SUS score of 48.5/100.
Conclusions: The eMedRec scored moderately on the SUS and increased student self-perceived competence greater than that observed during usual teaching alone.
References
Aburahma, M.H. & Mohamed, H.M. (2015). Educational games as a teaching tool in pharmacy curriculum. American Journal of Pharmaceutical Education, 79(4), 1
Almanasreh, E., Moles, R. & Chen, T.F. (2016). The medication reconciliation process and classification of discrepancies: a systematic review: the medication reconciliation process. British Journal of Clinical Pharmacology, 82(3), 645-658. doi:10.1111/bcp.13017
Australian Commission on Safety and Quality In Healthcare. (2016). Medication reconciliation (online). Available at: https://www.safetyandquality.gov.au/our- work/medication-safety/medication-reconciliation/. Accessed 5th November, 2016
Bangor, A., Kortum, P. & Miller, J. (2009). Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. Journal of Usability Studies, 4(3), 114-123
Bangor, A., Kortum, P.T. & Miller, J.T. (2008). An empirical evaluation of the system usability scale. International Journal of Human-Computer Interaction, 24(6), 574-594. doi:10.1080/10447310802205776
Basey, A. J., Krska, J., Kennedy, T.D. & Mackridge, A.J. (2014). Prescribing errors on admission to hospital and their potential impact: a mixed-methods study. British Medical Journal Quality and Safety, 23(1), 17-25. doi:10.1136/bmjqs-2013-001978
Beers, M.H., Munekata, M. & Storrie, M. (1990). The accuracy of medication histories in the hospital medical records of elderly persons. Journal of the American Geriatrics Society, 38(11), 1183
Brooke, J. (1996). SUS-A quick and dirty usability scale. In Usability Evaluation In Industry (Eds. P.W. Jordan, B. Thomas, B.A. Weerdmeester & I.L. McClelland), London: Taylor & Francis, pp.189-194
Competency Standards Review Steering Committee. (2010). National competency standards framework for pharmacists. Pharmaceutical Society of Australia, Vol. 2016
Duguid, M. (2012). The importance of medication reconciliation for patients and practitioners. Australian Prescriber, 35(1). doi:10.18773/austprescr.2012.007
Henneman, E.A., Tessier, E.G., Nathanson, B.H. & Plotkin, K. (2014). An evaluation of a collaborative, safety focused, nurse-pharmacist intervention for improving the accuracy of the medication history. Journal of Patient Safety, 10(2), 88
Holbrook, A. (2008). Self-Reported Measure. In Encyclopedia of survey research methods, (Ed. P.J. Lavrakas). Los Angeles: Sage Publications,pp.805-807
IBM SPSS Inc. (2015). IBM SPSS Statistics for Windows, Version 23.0 (Version 23.0). Armonk, NY: IBM Corp.
Kaboli, P.J., McClimon, B.J., Hoth, A.B. & Barnett, M.J. (2004). Assessing the accuracy of computerized medication histories. The American Journal of Managed Care, 10(11), 872
Kortum, P.T. & Bangor, A. (2013). Usability ratings for everyday products measured with the system usability scale. International Journal of Human - Computer Interaction, 29(2), 67
Lau, H.S., Florax, C., Porsius, A.J. & de Boer, A. (2000). The completeness of medication histories in hospital medical records of patients admitted to general internal medicine wards. British Journal of Clinical Pharmacology, 49(6), 597-603. doi:10.1046/j. 1365-2125. 2000.00204.x
Lindquist, L.A., Gleason, K.M., McDaniel, M.R., Doeksen, A. & Liss, D. (2008). Teaching medication reconciliation through simulation: A patient safety initiative for second year medical students. Journal of General Internal Medicine, 23(7), 998-1001. doi: 10.1007/s11606-008-0567-3
Microsoft Access. (2016) (Version 16.0.7830.1021)
Miller, G.E. (1990). The assessment of clinical skills/ competence/performance. Academic Medicine, 65(Supp 9), S63-67
Evaluation of electronic game for medication history taking 130
Miller, S.L. (2008). Medication reconciliation in a rural trauma population. Annals of Emergency Medicine, 52(5), 483-491. doi:10.1016/j.annemergmed.2008.03.021
Munshi, F., Lababidi, H. & Alyousef, S. (2015). Low- versus high-fidelity simulations in teaching and assessing clinical skills. Journal of Taibah University Medical Sciences, 10(1), 12-15. doi:10.1016/j.jtumed.2015.01.008
Nester, T.M. & Hale, L.S. (2002). Effectiveness of a pharmacist-acquired medication history in promoting patient safety. American Journal of Health-System Pharmacy, 59(22), 2221
Orfanou, K., Tselios, N. & Katsanos, C. (2015). Perceived usability evaluation of learning management systems: Empirical evaluation of the System Usability Scale. The International Review of Research in Open and Distributed Learning, 16(2). doi:10.19173/irrodl. v16i2.1955
Peres, S. C., Pham, T. & Phillips, R. (2013). Validation of the system usability scale (SUS) SUS in the wild. Paper presented at the Human Factors and Ergonomics Society Annual Meeting, San Diego
QSR International Pty Ltd. (2015). NVivo qualitative data analysis Software; Version 11.
Ramjaun, A., Sudarshan, M., Patakfalvi, L., Tamblyn, R. & Meguerditchian, A.N. (2015). Educating medical trainees on medication reconciliation: a systematic review. BMC Medical Education, 15(1), 33. doi:10.1186/ s12909-015-0306-5
Roberts, K. (2010). Helping to prevent hospital medication errors. British Journal of Hospital Medicine, 71(6), 94-95. doi:10.12968/hmed.2010.71.Sup6.48466
Sando, K.R., Elliott, J., Stanton, M.L. & Doty, R. (2013). An educational tool for teaching medication history taking to pharmacy students. American Journal of Pharmaceutical Education, 77(5), 105
Sauro, J. (2011). Measuring usability with the system usability scale (SUS) (online). Available at: http:// www.measuringu.com/sus.php. Accessed 5th November, 2016
Sauro, J. & Lewis, J.R. (2012). Quantifying the user experience: practical statistics for user research. Burlington: Elsevier Science.
Schneider, C. & Moles, R. (2016). Walking in consumers’ shoes: Reshaping the pharmacy student placement curriculum via mystery shopping with feedback. Final Report 2016, The University of Sydney. Australian Government Office for Learning and Teaching (online). Available at: https://ltr.edu.au/resources/ SD14_4207_Schneider_Report_2016.pdf. Accessed 20th April, 2017
StataCorp. (2015). Stata Statistical Software: Release 14. College Station, TX: StataCorp LP.
Steurbaut, S., Leemans, L., Leysen, T., De Baere, E., Cornu, P., Mets, T. & Dupont, A. G. (2010). Medication history reconciliation by clinical pharmacists in elderly inpatients admitted from home or a nursing home. The Annals of Pharmacotherapy, 44(10), 1596-1603. doi:10. 1345/aph.1P192
