Antibiotic knowledge assessment questionnaire in undergraduate pharmacy students: A Rasch analysis of validity evidence
DOI:
https://doi.org/10.46542/pe.2024.241.5478Keywords:
Antibiotic, Knowledge, Questionnaire, Rasch analysisAbstract
Background: Antibiotic knowledge is crucial for undergraduate pharmacy students who are future healthcare professionals. However, a valid and reliable instrument to assess their knowledge is scarce. This study aimed to develop and validate an Antibiotic Knowledge Assessment Questionnaire (AKAQ).
Methods: The AKAQ had three domains and 29 items, encompassing general antibiotic knowledge, antibiotic resistance, and antibiotic stewardship. Rasch analysis was used to assess psychometric properties, including validity parameters (item and person fit and structural validity), reliability (person and item reliability, Cronbach’s Alpha value), item-person interaction, and item bias, using differential item functioning (DIF) based on tems.
Results: This study included 500 undergraduate pharmacy students from 90 Indonesian universities. The validity of the questionnaire was demonstrated, except for one item. Person means infit and outfit for MNSQ were 1.02 and 0.95, whereas ZSTD were 0.11 and 0.08, respectively. Items means infit and outfit for MNSQ were 1.01 and 0.96, while ZSTD were 0.11 and -0.23. Item and person reliabilities were acceptable at 0.99 and 0.68. Cronbach’s alpha reliability was acceptable at 0.71. Two items were biased by term.
Conclusion: The AKAQ is a valid, reliable, and standard instrument for assessing the antibiotic knowledge levels of undergraduate pharmacy students.
References
Adams, D., Joo, M. T. H., Sumintono, B., & Pei, O. S. (2020). Blended learning engagement in higher education institutions: A differential item functioning analysis of students’ backgrounds. Malaysian Journal of Learning and Instruction, 17(1), 133–158. https://doi.org/10.32890/mjli2020.17.1.6
Azizan, N. H., Mahmud, Z., & Rambli, A. (2020). Rasch rating scale item estimates using maximum likelihood approach: Effects of sample size on the accuracy and bias of the estimates. International Journal of Advanced Science and Technology, 29(4), 2526–2531. https://doi.org/10.1088/1742-6596/2084/1/012006
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best Practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 366616. https://doi.org/10.3389/fpubh.2018.00149
Bond, C. (2005). Chapter 27: Antibiotic policies: theory and practice. In I. M. Gould & J. W. M. Van Der Meer (Eds.), Antibiotic Policies: Theory and practice (pp. 536–541). Kluwer Academic/Plenum Publishers. https://doi.org/10.1007/b99861
Bond, T. G., & Fox, C. M. (2013). Applying the Rasch model, 2nd Edition. Routledge.
Bond, T., Yan, Z., & Heene, M. (2020). Applying the Rasch model: fundamental measurement in the human sciences. Routledge. https://doi.org/10.4324/9780429030499
Boone, W. J. (2016). Rasch analysis for instrument development: Why, when, and how? CBE Life Sciences Education, 15(4). https://doi.org/10.1187/cbe.16-04-0148
Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch analysis in the human sciences. Springer Netherlands. https://doi.org/10.1007/978-94-007-6857-4
Brentani, E., & Silvia, G. (2007). Unidimensionality in the Rasch model how to detect and interpret. STATISTICA, 67(3), 253–261. https://doi.org/10.6092/issn.1973-2201/3508
Burns, K. W., Johnson, K. M., Pham, S. N., Egwuatu, N. E., & Dumkow, L. E. (2020). Implementing outpatient antimicrobial stewardship in a primary care office through ambulatory care pharmacist-led audit and feedback. Journal of the American Pharmacists Association, 60(6), e246–e251. https://pubmed.ncbi.nlm.nih.gov/32861616/
Cantó-Cerdán, M., Cacho-Martínez, P., Lara-Lacárcel, F., & García-Muñoz, Á. (2021). Rasch analysis for development and reduction of Symptom Questionnaire for Visual Dysfunctions (SQVD). Scientific Reports, 11(1), 14855. https://doi.org/10.1038/s41598-021-94166-9
Chou, Y.-T., & Wang, W.-C. (2010). Checking dimensionality in item response models with principal component analysis on standardized residuals. Educational and Psychological Measurement, 70(5), 717–731. https://doi.org/10.1177/0013164410379322
Comrey, A. L., & Lee, H. B. (2013). Chapter 8: Planning the standard design factor analysis. In a first course in factor analysis 2nd Edition (pp. 216–217). Psychology Press, Taylor & Francis Group. https://doi.org/10.4324/9781315827506-14
Duncan, P. W., Bode, R. K., Min Lai, S., & Perera, S. (2003). Rasch analysis of a new stroke-specific outcome scale: The Stroke Impact Scale. Archives of Physical Medicine and Rehabilitation, 84(7), 950–963. https://doi.org/10.1016/s0003-9993(03)00035-2
Fisher, W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transactions, 21, 1095.
Gothwal, V. K., Wright, T. A., Lamoureux, E. L., & Pesudovs, K. (2009). Rasch analysis of the quality of life and vision function questionnaire. Optometry and Vision Science, 86(7), E836–E844. https://doi.org/10.1097/OPX.0b013e3181ae1ec7
Hayat, K., Jamshed, S., Rosenthal, M., Haq, N. U., Chang, J., Rasool, M. F., Malik, U. R., Rehman, A. U., Khan, K. M., & Fang, Y. (2021). Understanding of pharmacy students towards antibiotic use, antibiotic resistance and antibiotic stewardship programs: A cross-sectional study from punjab, pakistan. Antibiotics, 10(1), 1–13. https://doi.org/10.3390/antibiotics10010066
Huang, Y., Gu, J., Zhang, M., Ren, Z., Yang, W., Chen, Y., Fu, Y., Chen, X., Cals, J. W., & Zhang, F. (2013). Knowledge, attitude and practice of antibiotics: A questionnaire study among 2500 Chinese students. BMC Medical Education, 13(1), 163. https://doi.org/10.1186/1472-6920-13-163
IBM Corp. (2019). SPSS Statistics, version 26.0. In IBM Software Business Analytics.
Inácio, J., Barnes, L. M., Jeffs, S., Castanheira, P., Wiseman, M., Inácio, S., Bowler, L., & Lansley, A. (2017). Master of Pharmacy students’ knowledge and awareness of antibiotic use, resistance and stewardship. Currents in Pharmacy Teaching and Learning, 9(4), 551–559. https://doi.org/10.1016/j.cptl.2017.03.021
Iskandar, K., Molinier, L., Hallit, S., Sartelli, M., Hardcastle, T. C., Haque, M., Lugova, H., Dhingra, S., Sharma, P., Islam, S., Mohammed, I., Naina Mohamed, I., Hanna, P. A., Hajj, S. El, Jamaluddin, N. A. H., Salameh, P., & Roques, C. (2021). Surveillance of antimicrobial resistance in low- and middle-income countries: A scattered picture. Antimicrobial Resistance & Infection Control, 10(1), 63. https://doi.org/10.1186/s13756-021-00931-w
Jamshed, S. Q., Elkalmi, R., Rajiah, K., Al-Shami, A. K., Shamsudin, S. H., Siddiqui, M. J. A., Aziz, M. A. B. A., Hanafi, M. B. Bin, Shariff, N. I. B. M., Ramlan, N. H. Bin, Jamil, N. B., Mustapha, N. H. A. B., Hasman Yusri, N. B., Shahri, N. A. B., Ismail, R. B., & Zamri, S. M. B. (2014). Understanding of antibiotic use and resistance among final-year pharmacy and medical students: A pilot study. Journal of Infection in Developing Countries, 8(6), 780–785. https://doi.org/10.3855/jidc.3833
Kandasamy, G., Sivanandy, P., Almaghaslah, D., Khobrani, M., Chinnadhurai, M., Vasudevan, R., & Almeleebia, T. (2020). Knowledge, attitude, perception and practice of antibiotics usage among the pharmacy students. International Journal of Clinical Practice, 74(11), e13599. https://doi.org/10.1111/ijcp.13599
Karuniawati, H., Hassali, M. A. A., Suryawati, S., Ismail, W. I., Taufik, T., & Hossain, M. S. (2021). Assessment of knowledge, attitude, and practice of antibiotic use among the population of Boyolali, Indonesia: A cross-sectional study. International Journal of Environmental Research and Public Health, 18(16), 8258. https://doi.org/10.3390/ijerph18168258
Karuniawati, H., Hassali, M. A. A., Suryawati, S., Ismail, W. I., Taufik, T., & Mutalazimah, M. (2022). Development and validation of knowledge, attitude, and practice towards antibiotics questionnaire (KAPAQ) for general community. Research Journal of Pharmacy and Technology, 15(1), 315–324. https://doi.org/10.52711/0974-360x.2022.00052
Katzung, B. G., & Vanderah, T. W. (2020). Section VIII: Chemotherapeutic drugs. In C. E. Beauduy & L. G. Winston (Eds.), Basic and clinical pharmacology (15th Edition, pp. 1–26). McGraw-Hill Education.
Klein, E. Y., Van Boeckel, T. P., Martinez, E. M., Pant, S., Gandra, S., Levin, S. A., Goossens, H., & Laxminarayan, R. (2018). Global increase and geographic convergence in antibiotic consumption between 2000 and 2015. Proceedings of the National Academy of Sciences of the United States of America, 115(15), E3463–E3470. https://doi.org/10.1073/pnas.1717295115
Laliyo, L. A. R., Sumintono, B., & Panigoro, C. (2022). Measuring changes in hydrolysis concept of students taught by inquiry model: Stacking and racking analysis techniques in Rasch model. Heliyon, 8(3), e09126. https://doi.org/10.1016/j.heliyon.2022.e09126
Linacre, J. M. (1998). Detecting multidimensionality: Which residual data-type works best? Journal of Outcome Measurement, 2(3), 266–283. https://winsteps.com/a/Linacre-multidimensionality-residuals.pdf
Linacre, J. M. (2021). A User’s Guide to FACETS Rasch-Model Computer Programs Program. In www.winsteps.com (Issue July). IEEE. https://doi.org/10.1109/COMPSAC.2011.4
Linacre, J. M. (2022). Winsteps® Version 5.2.1.0 (Version 5.2.1.0).
Liu, C., Liu, C., Wang, D., Deng, Z., Tang, Y., & Zhang, X. (2019). Determinants of antibiotic prescribing behaviors of primary care physicians in Hubei of China: A structural equation model based on the theory of planned behavior. Antimicrobial Resistance & Infection Control, 8, 1–8. https://doi.org/10.1186/s13756-019-0478-6
Lubwama, M., Onyuka, J., Ayazika, K. T., Ssetaba, L. J., Siboko, J., Daniel, O., & Mushi, M. F. (2021). Knowledge, attitudes, and perceptions about antibiotic use and antimicrobial resistance among final year undergraduate medical and pharmacy students at three universities in East Africa. PLoS ONE, 16(5 May), e0251301. https://doi.org/10.1371/journal.pone.0251301
Mallah, N., Rodriguez-Cano, R., Figueiras, A., & Takkouche, B. (2020). Design, reliability and construct validity of a knowledge, attitude and practice questionnaire on personal use of antibiotics in Spain. Scientific Reports, 10(1), 20668. https://doi.org/10.1038/s41598-020-77769-6
Murray, C. J., Ikuta, K. S., Sharara, F., Swetschinski, L., Robles Aguilar, G., Gray, A., Han, C., Bisignano, C., Rao, P., Wool, E., Johnson, S. C., Browne, A. J., Chipeta, M. G., Fell, F., Hackett, S., Haines-Woodhouse, G., Kashef Hamadani, B. H., Kumaran, E. A. P., McManigal, B., … Naghavi, M. (2022). Global burden of bacterial antimicrobial resistance in 2019: A systematic analysis. The Lancet, 399(10325), 629–655. https://doi.org/10.1016/S0140-6736(21)02724-0
National Quality Forum. (2021). Draft acceptable reliability thresholds. https://www.qualityforum.org/WorkArea/linkit.aspx?LinkIdentifier=id&ItemID=95263
Nunnally, J., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
O’Neill, J. (2014). Antimicrobial resistance: Tackling a crisis for the health and wealth of nations. Review on https://rb.gy/cjuudg
Park, S., Geum, M. J., Choi, H. J., Kim, C. J., Kwack, W. G., Chung, E. K., & Rhie, S. J. (2021). Validation of a questionnaire for patient awareness and the need for a community-based outpatient antimicrobial stewardship program (O-asp): A pilot study. Antibiotics, 10(4), 441. https://doi.org/10.3390/antibiotics10040441
Perneger, T. V., Courvoisier, D. S., Hudelson, P. M., & Gayet-Ageron, A. (2015). Sample size for pre-tests of questionnaires. Quality of Life Research, 24(1), 147–151. https://doi.org/10.1007/s11136-014-0752-2
Rajiah, K., Ren, W. S., & Jamshed, S. Q. (2015). Evaluation of the understanding of antibiotic resistance among Malaysian pharmacy students at public universities: An exploratory study. Journal of Infection and Public Health, 8(3), 266–273. https://doi.org/10.1016/j.sapharm.2014.07.064
Sakeena, M. H. F., Bennett, A. A., Jamshed, S., Mohamed, F., Herath, D. R., Gawarammana, I., & McLachlan, A. J. (2018). Investigating knowledge regarding antibiotics and antimicrobial resistance among pharmacy students in Sri Lankan universities. BMC Infectious Diseases, 18(1), 209. https://doi.org/10.1186/s12879-018-3107-8
Shi, J., Mo, X., & Sun, Z. (2012). Content validity index in scale development. Journal of Central South University. Medical sciences, 37(2), 152–155. https://doi.org/10.3969/j.issn.1672-7347.2012.02.007
Sinuraya, R. K., Wulandari, C., Amalia, R., & Puspitasari, I. M. (2023). Understanding public knowledge and behavior regarding antibiotic use in Indonesia. Infection and Drug Resistance, 16, 6833–6842. https://doi.org/10.2147/idr.s427337
Smith, R. E., & Olin, B. R. (2010). Wellness: Pharmacy education’s role and responsibility. American Journal of Pharmaceutical Education, 74(4), 1–5. https://doi.org/10.5688/aj740469
Streiner, D. L., & Norman, G. R. (2008). Health measurement scales: A practical guide to their development and use. Oxford University Press. https://doi.org/10.1093/acprof:oso/9780199231881.001.0001
Sumintono, B., & Widhiarso, W. (2014). Application of Rasch model for social sciences research (revised edition). Trim Komunikata Publishing House.
Sumintono, B., & Widhiarso, W. (2015). Applications of Rasch model on education assessment. Trim Komunikata Publishing House.
Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Tohan, M. M., Ahmed, F., Juie, I. J., Kabir, A., Howlader, M. H., & Rahman, M. A. (2023). Knowledge, attitudes, convenience and practice of self-medication among university students of Bangladesh: Structural equation modeling. (Preprint). https://doi.org/10.21203/rs.3.rs-3327159/v1
Widayati, A., Suryawati, S., de Crespigny, C., & Hiller, J. E. (2012). Knowledge and beliefs about antibiotics among people in Yogyakarta City Indonesia: A cross sectional population-based survey. Antimicrobial Resistance and Infection Control, 1(1), 1–7. https://doi.org/10.1186/2047-2994-1-38
World Health Organization. (2019). Antimicrobial stewardship programmes in health-care facilities in low- and middle-income countries: A WHO practical toolkit. JAC-Antimicrobial Resistance, 1(3), dlz072. https://doi.org/10.1093/jacamr/dlz072
World Health Organization. (2021). Antimicrobial stewardship interventions: A practical guide. https://www.who.int/europe/publications/i/item/9789289056267
Wright, B. D. D. B., & Stone, M. M. H. H. (1988). Reliability in Rasch measurement. In Research memorandum. MESA Press.
Wright, B. D., & Masters, G. N. (1982). Rating Scale Analyis. In Measurement and statistics. MESA Press.
Yunita, S. L., Yang, H.-W., Chen, Y.-C., Kao, L.-T., Lu, Y.-Z., Wen, Y.-L., To, S.-Y., & Huang, Y.-L. (2022). Knowledge and practices related to antibiotic use among women in Malang, Indonesia. Frontiers in Pharmacology, 13, 1019303. https://doi.org/10.3389/fphar.2022.1019303
Zawahir, S., Hettiarachchi, C., & Morrissey, H. (2017). Assessing knowledge, perception and attitudes about antibiotics among final year pharmacy undergraduates in Sri Lanka. International Journal of Pharmacy and Pharmaceutical Sciences, 9(10), 234. https://doi.org/10.22159/ijpps.2017v9i11.21891
Zwick, R., Thayer, D. T., & Lewis, C. (1999). An empirical Bayes approach to Mantel-Haenszel DIF analysis. Journal of Educational Measurement, 36(1), 1–28. https://doi.org/10.1111/j.1745-3984.1999.tb00543.x
