Associating student learning and metacognition with performance in a first-year calculations course
DOI:
https://doi.org/10.46542/pe.2025.251.161171Keywords:
Assessment, Calculation, Exam-wrapper, Metacognition, PharmacyAbstract
Background: To assess the nature and strength of associations between learning activities that enhance metacognition and performance in a calculations course.
Methods: All eighty-six first-year students enrolled in a Pharmaceutical Calculations course were invited to participate in the cross-sectional study. The learning management system (LMS), ExamSoft® testing software, and survey collection platform Qualtrics™ were used to build learning resources, formative assessments, and exam wrappers. Students were given chances to adjust their learning habits. In the following semester, they completed a calculations practicum that compared their perceived performance to their actual performance.
Results: A positive correlation that is statistically significant was observed between summative quiz scores and the final examination score, with average quiz and final exam scores of 87 and 89 points out of 100, respectively. Early weekly formative quizzes showed positive correlations with summative quiz scores, especially at moderate to strong levels. Both types of quizzes were strong predictors of final exam performance. Students' perceptions of their understanding of Milliequivalence and the Henderson-Hasselbalch equation aligned with their actual performance, revealing a significant difference between perceived and actual scores.
Conclusion: Formative resources utilised by students correlated with improved summative assessment scores, emphasising the importance of evidence-based strategies to improve learning pharmacy calculations. Integrating resources with assessments enhanced student awareness, retention, and academic performance.
References
American Association of Colleges of Pharmacy. (2023). AACP curriculum outcomes and entrustable professional activities (COEPA) 2022. https://www.aacp.org/sites/default/files/2022-11/coepa-document-final.pdf
Ariel, R., & Karpicke, J. D. (2018). Improving self-regulated learning with a retrieval practice intervention. Journal of Experimental Psychology: Applied, 24(1), 43–56. https://doi.org/10.1037/xap0000133
Bartoszewski, B. L., & Gurung, R. A. R. (2015). Comparing the relationship of learning techniques and exam score. Scholarship of Teaching and Learning in Psychology, 1(3), 219–228. https://doi.org/10.1037/stl0000036
Bowen, J. A., & Watson, C. E. (2017). Teaching naked techniques: A practical guide to designing better classes. Wiley.
Chemers, M. M., Hu, L., & Garcia, B. F. (2001). Academic self-efficacy and first year college student performance and adjustment. Journal of Educational Psychology, 93(1), 55–64. https://doi.org/10.1037/0022-0663.93.1.55
Cotta, K. I., Shah, S., Almgren, M. M., Macías-Moriarity, L. Z., & Mody, V. (2016). Effectiveness of flipped classroom instructional model in teaching pharmaceutical calculations. Currents in Pharmacy Teaching and Learning, 8(5), 646–653. https://doi.org/10.1016/j.cptl.2016.06.011
Davies, M., Pon, D., & Garavalia, L. S. (2018). Improving pharmacy calculations using an instructional design model. American Journal of Pharmaceutical Education, 82(2), 6200. https://doi.org/10.5688/ajpe6200
Dunlosky, J., & Rawson, K. A. (2015). Practice tests, spaced practice, and successive relearning: Tips for classroom use and for guiding students’ learning. Scholarship of Teaching and Learning in Psychology, 1(1), 72–78. https://doi.org/10.1037/stl0000024
Ebbinghaus, H. (2013). Memory: A contribution to experimental psychology. Annals of Neurosciences, 20(4), 155. https://doi.org/10.5214/ans.0972.7531.200408
Flood, M., Hayden, J. C., Bourke, B., Gallagher, P. J., & Maher, S. (2017). Design and evaluation of video podcasts for providing online feedback on formative pharmaceutical calculations assessments. American Journal of Pharmaceutical Education, 81(10), 6400. https://doi.org/10.5688/ajpe6400
Gall, M. D., Gall, J. P., Jacobsen, D. R., & Bullock, T. L. (1990). Tools for learning: A guide to teaching study skills. Association for Supervision & Curriculum Development.
Gillette, C., Rudolph, M., Kimble, C., Rockich-Winston, N., Smith, L., & Broedel-Zaugg, K. (2018). A meta-analysis of outcomes comparing flipped classroom and lecture. American Journal of Pharmaceutical Education, 82(5), 6898. https://doi.org/10.5688/ajpe6898
Harlen, W., & Deakin Crick, R. (2002). A systematic review of the impact of summative assessment and tests on students' motivation for learning. In: Research evidence in education library. London: EPPI Centre, Social Science Research Unit, Institute of Education, University of London.
Hartman, H. J. (2001). Metacognition in science teaching and learning. In H. J. Hartman (Ed.), Metacognition in learning and instruction: Theory, research and practice (pp. 173–201). Springer Netherlands. https://doi.org/10.1007/978-94-017-2243-8_9
Hartwig, M. K., & Dunlosky, J. (2012). Study strategies of college students: Are self-testing and scheduling related to achievement? Psychonomic Bulletin & Review, 19(1), 126–134. https://doi.org/10.3758/s13423-011-0181-y
Hegener, M. A., Buring, S. M., & Papas, E. (2013). Impact of a required pharmaceutical calculations course on mathematics ability and knowledge retention. American Journal of Pharmaceutical Education, 77(6), 124. https://doi.org/10.5688/ajpe776124
Hennig, S., Staatz, C. E., Bond, J. A., Leung, D., & Singleton, J. (2019). Quizzing for success: Evaluation of the impact of feedback quizzes on the experiences and academic performance of undergraduate students in two clinical pharmacokinetics courses. Currents in Pharmacy Teaching and Learning, 11(7), 742–749. https://doi.org/10.1016/j.cptl.2019.03.014
Joshi, M. D., & Klausner, E. A. (2022). Course design, delivery, and assessment strategies for pharmaceutical calculations course in a doctor of pharmacy program: A review. Currents in Pharmacy Teaching and Learning, 14(4), 526–535. https://doi.org/10.1016/j.cptl.2022.03.003
Karpicke, J. D., Butler, A. C., & Roediger Iii, H. L. (2009). Metacognitive strategies in student learning: Do students practise retrieval when they study on their own? Memory, 17(4), 471–479. https://doi.org/10.1080/09658210802647009
Linden, J. van der, Schilt-Mol, T. van, Nieuwenhuis, L., & Vleuten, C. van der. (2021). Learning for a summative assessment: The relationship between students’ academic achievement and self-regulated learning. Open Journal of Social Sciences, 9(10), Article 10. https://doi.org/10.4236/jss.2021.910025
Lovett, M. C. (2013). Make exams worth more than the grade: Using exam wrappers to promote metacognition. In Using reflection and metacognition to improve student learning. Routledge.
Maher, S., Hayden, J. C., Strawbridge, J. D., Gallagher, P. J., & Flood, M. (2020). ‘Both useful in their own way’: Video podcasts and typed solutions as feedback on undergraduate pharmaceutical calculations skills assessment. Currents in Pharmacy Teaching and Learning, 12(4), 367–377. https://doi.org/10.1016/j.cptl.2019.12.021
Mahdavi, M. (2014). An overview: Metacognition in education. International Journal of Multidisciplinary and Current Research, 2, 529–535. http://ijmcr.com/wp-content/uploads/2014/05/Paper5529-535.pdf
National Association of Boards of Pharmacy. (2021). NAPLEX Competency Statement. https://nabp.pharmacy/programs/examinations/naplex/competency-statements/
Nutan, M. T. H., & Demps, E. L. (2014). Online assessments in pharmaceutical calculations for enhancing feedback and practice opportunities. Currents in Pharmacy Teaching and Learning, 6(6), 807–814. https://doi.org/10.1016/j.cptl.2014.07.010
Pate, A., Lafitte, E. M., Ramachandran, S., & Caldwell, D. J. (2019). The use of exam wrappers to promote metacognition. Currents in Pharmacy Teaching and Learning, 11(5), 492–498. https://doi.org/10.1016/j.cptl.2019.02.008
Persky, A. M., & Hudson, S. L. (2016). A snapshot of student study strategies across a professional pharmacy curriculum: Are students using evidence-based practice? Currents in Pharmacy Teaching and Learning, 8(2), 141–147. https://doi.org/10.1016/j.cptl.2015.12.010
Persky, A. M., & Dinsmore, D. L. (2019). Metacognitive changes and sources of confidence judgements in health professions classroom learning. Currents in Pharmacy Teaching and Learning, 11(4), 338–345. https://doi.org/10.1016/j.cptl.2019.01.005
Raupach, T., Brown, J., Anders, S., Hasenfuss, G., & Harendza, S. (2013). Summative assessments are more powerful drivers of student learning than resource intensive teaching formats. BMC Medicine, 11(1), 61. https://doi.org/10.1186/1741-7015-11-61
Ray, M. E., Daugherty, K. K., Lebovitz, L., Rudolph, M. J., Shuford, V. P., & DiVall, M. V. (2018). Best practices on examination construction, administration, and feedback. American Journal of Pharmaceutical Education, 82(10). https://doi.org/10.5688/ajpe7066
Rivers, M. L., Dunlosky, J., & Persky, A. M. (2020). Measuring metacognitive knowledge, monitoring, and control in the pharmacy classroom and experiential settings. American Journal of Pharmaceutical Education, 84(5). https://doi.org/10.5688/ajpe7730
Roediger, H. L., & Karpicke, J. D. (2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1(3), 181–210. https://doi.org/10.1111/j.1745-6916.2006.00012.x
Soicher, R. N., & Gurung, R. A. R. (2017). Do exam wrappers increase metacognition and performance? A single course intervention. Psychology Learning & Teaching, 16(1), 64–73. https://doi.org/10.1177/1475725716661872
Stanton, J. D., Neider, X. N., Gallegos, I. J., & Clark, N. C. (2015). Differences in metacognitive regulation in introductory biology students: When prompts are not enough. CBE Life Sciences Education, 14(2), ar15. https://doi.org/10.1187/cbe.14-08-0135
Stewart, D., Panus, P., Hagemeier, N., Thigpen, J., & Brooks, L. (2014). Pharmacy student self-testing as a predictor of examination performance. American Journal of Pharmaceutical Education, 78(2), 32. https://doi.org/10.5688/ajpe78232
Szpunar, K. K., McDermott, K. B., & Roediger, H. L. (2007). Expectation of a final cumulative test enhances long-term retention. Memory & Cognition, 35(5), 1007–1013. https://doi.org/10.3758/BF03193473
Verdone, M., Joshi, M. D., Bodenstine, T. M., Green, J. M., Lynch, S. M., Gettig, J. P., & Fjortoft, N. (2020). An online, self-directed pharmacy bridging course for incoming first-year students. American Journal of Pharmaceutical Education, 84(7), ajpe7684. https://doi.org/10.5688/ajpe7684
Winne, P. H. (2018). Cognition and metacognition within self-regulated learning. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed., pp. 36–48). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9781315697048-3
