Development and evaluation of the pharmacy alumni employment experience questionnaire
DOI:
https://doi.org/10.46542/pe.2022.221.913935Keywords:
Job satisfaction, Pharmacy alumnus, Preparedness to practice, Questionnaire development and evaluation, Validity and reliability, Workplace achievementAbstract
Objectives: This study aimed to develop and evaluate the ‘Pharmacy Alumni Employment Experience Questionnaire’ (PAEEQ).
Methods: Literature review and Herzberg’s ‘motivation-hygiene’ theory were used to derive PAEEQ domains: satisfaction with the profession, achievements in the workplace, and preparedness to practice. Content and face validities were assessed by 11 experts and five pharmacy alumni. To evaluate the construct validity and reliability, PAEEQ was tested on 136 Qatar University College of Pharmacy alumni and the principal component analysis (PCA) and internal consistency reliability were performed.
Results: Content and face validities suggested a questionnaire with 12-item, 14-item, and 13-item domains measured on 5-point Likert scales, and open-ended questions. PCA resulted in four-factor, two-factor, and two-factor structures for the three domains, respectively. Strong factor loadings and high Cronbach’s alpha scores were revealed. The final version of PAEEQ consists of 27 items.
Conclusion: This initial assessment suggests PAEEQ appropriateness for use. However, the findings are sample-dependent and further external validation is warranted.
References
AFPC. (2017). AFPC Educational Outcomes for First Professional Degree Programs in Pharmacy in Canada. Available at: https://www.afpc.info/system/files/public/AFPC-Educational%20Outcomes%202017_final%20Jun2017.pdf
Ahmad, A., Khan, M.U., Elkalmi, R.M., Jamshed, S.Q., Nagappa, A.N., Patel, I., & Balkrishnan, R. (2016). Job satisfaction among Indian pharmacists: An exploration of affecting variables and suggestions for improvement in pharmacist role. Indian Journal of Pharmaceutical Education and Research, 50(1), 9-16. https://doi.org/10.5530/ijper.50.1.2
Al-Muallem, N., & Al-Surimi, K.M. (2019). Job satisfaction, work commitment and intention to leave among pharmacists: a cross-sectional study. BMJ open, 9(9), e024448. https://doi.org/10.1136/bmjopen-2018-024448
Al Khalidi, D., & Wazaify, M. (2013). Assessment of pharmacists’ job satisfaction and job related stress in Amman. International journal of clinical pharmacy, 35(5), 821-828. https://doi.org/10.1007/s11096-013-9815-7
Alrawahi, S., Sellgren, S.F., Altouby, S., Alwahaibi, N., & Brommels, M. (2020). The application of Herzberg's two-factor theory of motivation to job satisfaction in clinical laboratories in Omani hospitals. Heliyon, 6(9), e04829. https://doi.org/10.1016%2Fj.heliyon.2020.e04829
Alshmemri, M., Shahwan-Akl, L., & Maude, P. (2016). Job satisfaction of Saudi nurses working in Makkah region public hospitals, Saudi Arabia. Life Science Journal, 13(12), 22-33. https://doi.org/10.7537/marslsj131216.05
Alshmemri, M., Shahwan-Akl, L., & Maude, P. (2017). Herzberg’s two-factor theory. Life Science Journal, 14(5), 12-16. https://doi.org/10.7537/marslsj140517.03
Ameer, L., Maclure, K., Tonna, A., & Stewart, D. (2018). An initial exploration of the perceptions of preparedness to practise among Saudi Arabian trained hospital pharmacists. Pharmacy Practice (Granada), 16(2). https://doi.org/10.18549%2FPharmPract.2018.02.1192
aus Bruchsal, D.-S.A.M., Fuchs, M., & Couper, M.P. The effect of assigning sample members to their preferred device on nonresponse and measurement in Web surveys. Available at: https://tuprints.ulb.tu-darmstadt.de/8788/1/Dissertation_Metzler_Nov_2018_Ver%C3%B6ffentlichung.pdf
Awalom, M.T., Tesfa, A.F., Kidane, M.E., Ghebremedhin, M.R., & Teklesenbet, A.H. (2015). Eritrean pharmacists’ job satisfaction and their attitude to re-professionalize pharmacy in to pharmaceutical care. International journal of clinical pharmacy, 37(2), 335-341. https://doi.org/10.1007/s11096-015-0064-9
Ayele, Y., Hawulte, B., Feto, T., Basker, G.V., & Bacha, Y.D. (2020). Job satisfaction among pharmacy professionals working in public hospitals and its associated factors, eastern Ethiopia. Journal of Pharmaceutical Policy and Practice, 13, 1-9. https://doi.org/10.1186/s40545-020-00209-3
Bhatnagar, K., & Srivastava, K. (2012). Job satisfaction in health-care organizations. Industrial psychiatry journal, 21(1), 75. https://doi.org/10.4103/0972-6748.110959
Borkowski, N., & Meese, K. A. (2020). Organizational behavior in health care: Jones & Bartlett Publishers. Fourth Edition. Available at: http://samples.jblearning.com/9781284183245/9781284065961_FMxx_Print.pdf
Carvajal, M.J., & Popovici, I. (2018). Gender, age, and pharmacists' job satisfaction. Pharmacy Practice (Granada), 16(4). https://doi.org/10.18549%2FPharmPract.2018.04.1396
Carvajal, M.J., Popovici, I., & Hardigan, P.C. (2018). Gender differences in the measurement of pharmacists’ job satisfaction. Human resources for health, 16(1), 1-8. https://doi.org/10.1186/s12960-018-0297-5
Cavaco, A., Ayorinde, M., Pentiah, E., Dias, J. S., & Bates, I. (2001). Development and validation of an instrument to measure professional self‐perception and job satisfaction of Portuguese community pharmacists. International Journal of Pharmacy Practice, 9(S1), 70-70. https://doi.org/10.1111/j.2042-7174.2001.tb01130.x
Chen, L.-H. (2008). Job satisfaction among information system (IS) personnel. Computers in Human Behavior, 24(1), 105-118. https://psycnet.apa.org/doi/10.1016/j.chb.2007.01.012
Chikanda, A. (2006). Skilled health professionals’ migration and its impact on health delivery in Zimbabwe. Journal of ethnic and migration studies, 32(04), 667-680. https://doi.org/10.1080/13691830600610064
Chua, G.N., Yee, L.J., Sim, B.A., Tan, K.H., Sin, N.K., Hassali, M. A., Shafie, A.A., Ooi, G.S. (2014). Job satisfaction, organisation commitment and retention in the public workforce: a survey among pharmacists in M alaysia. International Journal of Pharmacy Practice, 22(4), 265-274. https://doi.org/10.1111/ijpp.12077
Comrey, A.L., & Lee, H.B. (2013). A first course in factor analysis. Psychology press. https://doi.org/10.4324/9781315827506
Cook, J.V., Dickinson, H.O., & Eccles, M.P. (2009). Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. BMC health services research, 9(1), 1-8. https://doi.org/10.1186/1472-6963-9-160
Cortina, J.M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98. https://psycnet.apa.org/doi/10.1037/0021-9010.78.1.98
Costello, A. B., & Osborne, J. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(1), 7. https://scholarworks.umass.edu/pare/vol10/iss1/7?utm_source=scholarworks.umass.edu%2Fpare%2Fvol10%2Fiss1%2F7&utm_medium=PDF&utm_campaign=PDFCoverPages
Cox, E.R., & Fitzpatrick, V. (1999). Pharmacists’ job satisfaction and perceived utilization of skills. American journal of health-system pharmacy, 56(17), 1733-1737. https://doi.org/10.1093/ajhp/56.17.1733
Desselle, S.P., & Peirce, G.L. (2011). The intersection of job satisfaction and preceptor development: opportunities for academic pharmacy programs. American journal of pharmaceutical education, 75(9). https://doi.org/10.5688/ajpe759171
Gregory, P., & Austin, Z. (2014). Postgraduation employment experiences of new pharmacists in Ontario in 2012–2013. Canadian Pharmacists Journal/Revue des Pharmaciens du Canada, 147(5), 290-299. https://doi.org/10.1177%2F1715163514543766
Gustafsson, M., Mattsson, S., Wallman, A., & Gallego, G. (2018). Pharmacists' satisfaction with their work: Analysis of an alumni survey. Research in Social and Administrative Pharmacy, 14(7), 700-704. https://doi.org/10.1016/j.sapharm.2017.08.006
Harmania, H., & Nessa, H. (2016). Exploring the effect of staff achievement on job satisfaction in Hong Kong residential clubhouse. Journal of Tourism and Hospitality, 5(6). https://www.cabdirect.org/cabdirect/abstract/20173117455
Hassell, K. (2007). From pharmacy education into pre-registration training. Available at: https://pharmacyresearchuk.org/wp-content/uploads/2012/11/From_pharmacy_education_into_preregistration_training.pdf
Haynes, S.N., Richard, D., & Kubany, E.S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological assessment, 7(3), 238. https://psycnet.apa.org/doi/10.1037/1040-3590.7.3.238
Herzberg, F. (1968). One more time: How do you motivate employees (Vol. 65): Harvard Business Review Boston, MA. Available at: https://www.insidemarketing.it/wp-content/uploads/2020/08/one_more_time_-_how_do_you_motivate_employees.pdf
Herzberg, F., Mausner, B., & Snyderman, B. (1959). The motivation to work New York Wiley. Studies of Accountants and Engineers. https://www.scirp.org/(S(lz5mqp453edsnp55rrgjct55))/reference/referencespapers.aspx?referenceid=2526057
Herzberg, F.I. (1966). Work and the Nature of Man.
Hinkin, T.R (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational research methods, 1(1), 104-121. https://www.scirp.org/(S(i43dyn45teexjx455qlt3d2q))/reference/ReferencesPapers.aspx?ReferenceID=1775482
Hodgetts, S., Hollis, V., Triska, O., Dennis, S., Madill, H., & Taylor, E. (2007). Occupational therapy students' and graduates' satisfaction with professional education and preparedness for practice. Canadian Journal of Occupational Therapy, 74(3), 148-160. https://doi.org/10.1177/000841740707400303
Howard, M.C. (2016). A review of exploratory factor analysis decisions and overview of current practices: What we are doing and how can we improve? International Journal of Human-Computer Interaction, 32(1), 51-62. https://doi.org/10.1080/10447318.2015.1087664
Jolliffe, I.T., & Cadima, J. (2016). Principal component analysis: a review and recent developments. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2065), 20150202. https://doi.org/10.1098/rsta.2015.0202
Kaiser, H.F. (1958). The varimax criterion for analytic rotation in factor analysis. Psychometrika, 23(3), 187-200. https://doi.org/10.1007/BF02289233
Kettis, Å., Ring, L., Gustavsson, M., & Wallman, A. (2013). Placements: an underused vehicle for quality enhancement in higher education? Quality in Higher Education, 19(1), 28-40. https://doi.org/10.1080/13538322.2013.772697
Khan, L.J., & Morrow, P.C. (1991). Objective and subjective underemployment relationships to job satisfaction. Journal of business research, 22(3), 211-218. https://psycnet.apa.org/doi/10.1016/0148-2963(91)90002-F
Korsakienė, R., Tvaronavičius, V., & Tvaronavičienė, M. (2006). Incorporating innovations into organizations functioning: virtual versus traditional firm. Verslas: teorija ir praktika, 7(1), 27-31. http://dx.doi.org/10.3846/btp.2006.04
Lau, W.M., Pang, J., & Chui, W. (2011). Job satisfaction and the association with involvement in clinical activities among hospital pharmacists in Hong Kong. International Journal of Pharmacy Practice, 19(4), 253-263. https://doi.org/10.1111/j.2042-7174.2010.00085.x
Lavrakas, P. J. (2008). Encyclopedia of survey research methods: Sage publications. Available at: https://methods.sagepub.com/reference/encyclopedia-of-survey-research-methods
Lea, V.M., Corlett, S.A., & Rodgers, R.M. (2016). Delegation: a solution to the workload problem? Observations and interviews with community pharmacists in England. International Journal of Pharmacy Practice, 24(3), 170-179. https://doi.org/10.1111/ijpp.12230
Leeuw, E. D. d., & Hox, J. (2008). Missing data. Encyclopedia of Survey Research Methods, 468-472. https://wisconsin-uwlax.primo.exlibrisgroup.com/permalink/01UWI_LC/1i5kv17/alma991016794130802125
Lin, P. S., Viscardi, M. K., & McHugh, M. D. (2014). Factors influencing job satisfaction of new graduate nurses participating in nurse residency programs: A systematic review. The Journal of Continuing Education in Nursing, 45(10), 439-450. https://doi.org/10.3928/00220124-20140925-15
MacCallum, R.C., Widaman, K.F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological methods, 4(1), 84. https://psycnet.apa.org/doi/10.1037/1082-989X.4.1.84
Mackenzie, A. (2008). Job satisfaction of South African registered dietitians. Stellenbosch: Stellenbosch University. Available at: https://www.ajol.info/index.php/sajcn/article/view/81514/71684
Maissiat, G d. S., Lautert, L., Pai, D.D., & Tavares, J.P. (2015). Work context, job satisfaction and suffering in primary health care. Revista gaucha de enfermagem, 36, 42-49. https://doi.org/10.1590/1983-1447.2015.02.51128
Manan, M.M., Azmi, Y., Lim, Z., Neoh, C.F., Khan, T.M., & Ming, L.C. (2015). Predictors of job satisfaction amongst pharmacists in Malaysian public hospitals and healthcare clinics. Journal of Pharmacy Practice and Research, 45(4), 404-411. https://doi.org/10.1002/jppr.1094
NAPRA. (2014). Professional competencies for Canadian at Entry to Practice. Retrieved from https://napra.ca/sites/default/files/2017-08/Comp_for_Cdn_PHARMACISTS_at_EntrytoPractice_March2014_b.pdf
Nyame-Mireku, M.N. (2012). Determinants of job satisfaction among hospital pharmacists and their intent to leave using Herzberg's two-factor theory. Available at: https://www.semanticscholar.org/paper/DETERMINANTS-OF-JOB-SATISFACTION-AMONG-HOSPITAL-AND-Nyame-Mireku/77fbcc06807a296abc11ac77ed4e64a7e1a9e2ae
Odukoya, O.K., & Chui, M.A. (2013). e-Prescribing: characterisation of patient safety hazards in community pharmacies using a sociotechnical systems approach. BMJ Quality & Safety, 22(10), 816-825. https://doi.org/10.1136/bmjqs-2013-001834
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Sage. Available at: https://us.sagepub.com/en-us/nam/making-sense-of-factor-analysis/book225843
Rajah, T., Bates, I., Davies, J., Webb, D., & Fleming, G. (2001). An occupational survey of hospital pharmacists in the South of England. Pharmaceutical journal, 266(7149), 723-726. Available at: https://www.semanticscholar.org/paper/An-occupational-survey-of-hospital-pharmacists-in-Rajah-Bates/48418d44dbbc9ac98401e894c323ed3615749bdf
Richardson, P.K., MacRae, A., Schwartz, K., Bankston, L., & Kosten, C. (2008). Student outcomes in a postprofessional online master’s–degree program. American Journal of Occupational Therapy, 62(5), 600-610. https://doi.org/10.5014/ajot.62.5.600
Sansgiry, S.S., & Ngo, C. (2003). Factors affecting job satisfaction among hospital pharmacists. Hospital Pharmacy, 38(11), 1037-1046. https://doi.org/10.1177/001857870303801114
Savery, L.K. (1996). The congruence between the importance of job satisfaction and the perceived level of achievement. Journal of Management Development. Available at: https://go.gale.com/ps/i.do?p=AONE&u=googlescholar&id=GALE|A18598684&v=2.1&it=r&sid=googleScholar&asid=dd2139ff
Seston, E., Hassell, K., Ferguson, J., & Hann, M. (2009). Exploring the relationship between pharmacists' job satisfaction, intention to quit the profession, and actual quitting. Research in Social and Administrative Pharmacy, 5(2), 121-132. https://doi.org/10.1016/j.sapharm.2008.08.002
Singh, T., Kaur, M., Verma, M., & Kumar, R. (2019). Job satisfaction among health care providers: A cross-sectional study in public health facilities of Punjab, India. Journal of Family Medicine and Primary Care, 8(10), 3268. https://doi.org/10.4103%2Fjfmpc.jfmpc_600_19
Sinopoulou, V., Summerfield, P., & Rutter, P. (2017). A qualitative study on community pharmacists' decision‐making process when making a diagnosis. Journal of Evaluation in Clinical Practice, 23(6), 1482-1488. https://pubmed.ncbi.nlm.nih.gov/28990319/
Streiner, D.L. (2003). Starting at the beginning: an introduction to coefficient alpha and internal consistency. Journal of personality assessment, 80(1), 99-103. https://doi.org/10.1207/S15327752JPA8001_18
Suleiman, A. K. (2015). Stress and job satisfaction among pharmacists in Riyadh, Saudi Arabia. Saudi Journal of Medicine and Medical Sciences, 3(3), 213. https://doi.org/10.4103/1658-631X.16202
Tabachnick, B.G., Fidell, L.S., & Ullman, J.B. (2007). Using multivariate statistics (Vol. 5): Allyn and Bacon. Scientific Research. Available at: https://www.scirp.org/(S(czeh2tfqyw2orz553k1w0r45))/reference/ReferencesPapers.aspx?ReferenceID=1887285
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53. https://doi.org/10.5116%2Fijme.4dfb.8dfd
Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Structural Equation Modeling-a Multidisciplinary Journal, 15. http://dx.doi.org/10.1037/10694-000
Thompson, B., & Daniel, L.G. (1996). Factor analytic evidence for the construct validity of scores: A historical overview and some guidelines. Sage Publications, 56(2). https://doi.org/10.1177/0013164496056002001
Tsang, S., Royse, C. F., & Terkawi, A. S. (2017). Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi journal of anaesthesia, 11(Suppl 1), S80. https://doi.org/10.4103/sja.sja_203_17
Wang, P., Yang, S., Sun, N., Sun, Y., Shi, H., Wu, X., & Pan, R. (2022). College students’ perceived overqualification and adaptation: A double-edged sword model. Current Psychology, 1(19). https://doi.org/10.1007/s12144-022-03174-z
Willett, V., & Cooper, C. (1996). Stress and job satisfaction in community pharmacy: a pilot study. Pharmaceutical journal, 256(6875), 94-98. https://www.taylorfrancis.com/chapters/edit/10.4324/9781315196244-27/stress-job-satisfaction-community-pharmacy-pilot-valerie-willett-cary-cooper
Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian journal of paramedicine, 8(3). https://doi.org/10.33151/ajp.8.3.93
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The counseling psychologist, 34(6), 806-838. https://doi.org/10.1177/0011000006288127
Yami, A., Hamza, L., Hassen, A., Jira, C., & Sudhakar, M. (2011). Job satisfaction and its determinants among health workers in jimma university specialized hospital, southwest ethiopia. Ethiopian journal of health sciences. 1(19-27) http://www.ncbi.nlm.nih.gov/pmc/articles/pmc3275875/
