Research Article

Learning assessment challenges from students and faculty perception in times of COVID-19: A case study

Katherina Gallardo 1 , Leonardo Glasserman 1 * , Nohemi Rivera 1 2 , Lizette Martínez-Cardiel 1 3
More Detail
1 Tecnologico de Monterrey, Monterrey, Nuevo León, MEXICO2 Universidad Autónoma de Yucatán, Mérida, Yucatán, MEXICO3 Universidad Autonoma de Barcelona, Barcelona, SPAIN* Corresponding Author
Contemporary Educational Technology, 15(2), April 2023, ep415, https://doi.org/10.30935/cedtech/12985
Published Online: 24 February 2023, Published: 01 April 2023
OPEN ACCESS   1344 Views   1723 Downloads
Download Full Text (PDF)

ABSTRACT

A mixed-method study about the perception of students and faculty around learning assessment practices was conducted in a multicampus competency-based approached Mexican private university. The objective was getting new knowledge about higher education community perception around learning assessment practices, learning outcomes production and how authentic assessment was driven while working on different modalities during the pandemic: remote learning, synchronous hybrid learning, alternate hybrid learning, and on-site modality. A questionnaire, and an interview for faculty and focus groups for students were designed, validated, and conducted. A total of 281 faculty and 908 students participated in this study. The main quantitative results indicate that students who took on-site classes evaluate the variables better than those who took hybrid classes. In addition, students who took remote classes evaluate the authenticity variable better than those who took it in alternate hybrid modality. In the case of the faculty, only the equality variable showed significant differences between the reported modalities. Besides, the main qualitative results indicate that perceptions are quite different between faculty and students while getting their perceptions from an evaluation standards scope. Thus, their perspectives around equality, authenticity, feasibility, reliability and ethics were obtained and discussed against literature. The main conclusions of the study remarked that students and faculty were positive towards most of the execution of learning assessment and learning outcomes practices during the pandemic. Nevertheless, students’ preference of on-site modality was determined as the way they have more opportunities for interacting and learning more from assessment and feedback.
Keywords: innovation in education, competency-based education, higher education, learning outcomes, performance assessment

CITATION (APA)

Gallardo, K., Glasserman, L., Rivera, N., & Martínez-Cardiel, L. (2023). Learning assessment challenges from students and faculty perception in times of COVID-19: A case study. Contemporary Educational Technology, 15(2), ep415. https://doi.org/10.30935/cedtech/12985

REFERENCES

  1. Al-Azawei, A., Baiee, W. R., & Mohammed, M. A. (2019). Learners’ experience towards e-assessment tools: A comparative study on virtual reality and Moodle quiz. International Journal of Emerging Technologies in Learning, 14(5), 34-50. https://doi.org/10.3991/ijet.v14i05.9998
  2. Alonzo, D., Mirriahi, N., & Davison, C. (2019). The standards for academics’ standards-based assessment practices. Assessment and Evaluation in Higher Education, 44(4), 636-652. https://doi.org/10.1080/02602938.2018.1521373
  3. Al-Sudani, S. (2021). The impact of flexible assessment on students’ engagement and learning during COVID-19 pandemic. European Journal of Teaching and Education, 3(4), 29-41. https://doi.org/10.33422/ejte.v3i4.545
  4. Ashour, S., El-Refae, G. A., & Zaitoun, E. A. (2021). Post-pandemic higher education: Perspectives from university leaders and educational experts in the United Arab Emirates. Higher Education for the Future, 8(2), 219-238. https://doi.org/10.1177/23476311211007261
  5. Badowski, D., Rossler, K. L., & Reiland, N. (2021). Exploring student perceptions of virtual simulation versus traditional clinical and manikin-based simulation. Journal of Professional Nursing, 37(4), 683-689. https://doi.org/10.1016/j.profnurs.2021.05.005
  6. Balderas, A., & Caballero-Hernández, J. A. (2020). Analysis of learning records to detect student cheating on online exams: Case study during COVID-19 pandemic. ACM International Conference Proceeding Series, 752-757. https://doi.org/10.1145/3434780.3436662
  7. Bijsterbosch, E., Béneker, T., Kuiper, W., & van der Schee, J. (2019). Teacher professional growth on assessment literacy: A case study of prevocational geography education in the Netherlands. Teacher Educator, 54(4), 420-445. https://doi.org/10.1080/08878730.2019.1606373
  8. Burrack, F., & Thompson, D. J. M. (2021). Canvas (LMS) as a means for effective students learning assessment across an institution of higher education. The Journal of Assessment in Higher Education, 2(1), 1-19. https://doi.org/10.32473/jahe.v2i1.125129
  9. Cáceres, M., & Suárez, N. (2021). ICT-based learning assessment: understanding its educational dimension in the context of the Bachelor of Science in education degree program of the Universidad Autónoma del Estado de Hidalgo. Revista Universidad y Sociedad [University and Society Magazine], 13(2). http://scielo.sld.cu/pdf/rus/v13n2/2218-3620-rus-13-02-75.pdf
  10. Chan, C. K. Y., & Luo, J. (2020). An exploratory study on teacher assessment literacy: Do novice university teachers know how to assess students’ written reflection? Teachers and Teaching: Theory and Practice, 00(00), 214-228. https://doi.org/10.1080/13540602.2020.1787375
  11. Clark, J. A., Liu, Y., & Isaias, P. (2020). Critical success factors for implementing learning analytics in higher education: A mixed-method inquiry. Australasian Journal of Educational Technology, 36(6), 89-106. https://doi.org/10.14742/AJET.6164
  12. Escudero, T. (2013). Utilidad y uso de las evaluaciones. Un asunto relevante [Utility and use of evaluations. A relevant matter]. Revista de Evaluación Educativa [Educational Assessment Magazine], 2(1), 185–205.
  13. Frey, B. B., Schmitt, V. L., & Allen, J. P. (2012). Defining authentic classroom assessment. Practical Assessment, Research and Evaluation, 17(2), 2. https://doi.org/10.1002/tl.7401
  14. Gallardo, K., Ramos, A., Camacho, D., & Gil, M. (2015). Evaluación de los estudiantes: las prácticas institucionales y docentes vistas desde el marco de estándares internacionales [Student evaluation: institutional and teaching practices seen from the framework of international standards]. Apertura 7(2), 73-85. https://www.scielo.org.mx/pdf/apertura/v7n2/2007-1094-apertura-7-02-00073.pdf
  15. Gallardo, K. E. (2020). The importance of assessment literacy: Formative and summative assessment instruments and techniques. In R. Babo, N. Dey, & A. S. Ashour (Eds.), Workgroups eAssessment: Planning, implementing and analyzing frameworks (pp. 3-25). Springer. https://doi.org/10.1007/978-981-15-9908-8_1
  16. Goff, L., Potter, M., Pierre, E., Carey, T., & Gullage, A., Kustra, E., Lee, R., Lopes, V., Marshall, L., Martin, L., Raffoul, J., Siddiqui, A., & Van Gaste, G. (2015). Learning outcomes assessment. A practitioner’s handbook. Center for Teaching and Learning Reports. https://scholar.uwindsor.ca/ctlreports/6
  17. Gullickson, A. R. (2005). Student evaluation standards: A paradigm shift for the evaluation of students. Prospects, 35(2), 213-227. https://doi.org/10.1007/BF00892762
  18. Halabi, A. K. (2021). Pivoting authentic assessment to an accounting podcast during COVID-19. Accounting Research Journal, 34(2), 156-168. https://doi.org/10.1108/ARJ-08-2020-0219
  19. Hikmah, N., Putri, N. A., Nisa’, K., & Jauhariyah, M. N. R. (2021). Using quizizz to develop an assessment of physics learning: An alternative way for physics learning assessment in the COVID-19 pandemic era. Journal of Physics: Conference Series, 1805, 012021. https://doi.org/10.1088/1742-6596/1805/1/012021
  20. Ibrahim, M. M., Malik, M., & Avianti, R. A. (2022). Lecturers’ perceptions of authentic assessment in times of COVID-19 pandemic: A case of Indonesian universities. Journal of Applied Research in Higher Education. https://doi.org/10.1108/JARHE-02-2022-0041
  21. Johnson, N. (2021). Evolving definitions in digital learning: A national framework for categorizing commonly used terms. http://www.cdlra-acrfl.ca/wp-content/uploads/2021/07/2021-CDLRA-definitions-report-5.pdf
  22. Judge, M. (2021). COVID-19, school closures and the uptake of a digital assessment for learning pilot project during Ireland’s national lockdown. Irish Educational Studies, 40(2), 419-429. https://doi.org/10.1080/03323315.2021.1917443
  23. Lu, Y., Xu, Y., & Zhu, X. (2021). Designing and implementing VR2E2C, a virtual reality remote education for experimental chemistry system. Journal of Chemical Education, 98(8), 2720-2725. https://doi.org/10.1021/acs.jchemed.1c00439
  24. Madurai Elavarasan, R., & Pugazhendhi, R. (2020). Restructured society and environment: A review on potential technological strategies to control the COVID-19 pandemic. Science of the Total Environment, 725. https://doi.org/10.1016/j.scitotenv.2020.138858
  25. Middleton, K. V. (2020). The longer‐term impact of COVID‐19 on K-12 student learning and assessment. Educational Measurement: Issues and Practice, 39(3), 41-44. https://doi.org/10.1111/emip.12368
  26. Nguyen, J. G., Keuseman, K. J., & Humston, J. J. (2020). Minimize online cheating for online assessments during COVID-19 pandemic. Journal of Chemical Education, 97(9), 3429-3435. https://doi.org/10.1021/acs.jchemed.0c00790
  27. Nicola, M., Alsafi, Z., Sohrabi, C., Kerwan, A., Al-Jabir, A., Iosifidis, C., Agha, M., & Agha, R. (2020). The socio-economic implications of the coronavirus pandemic (COVID-19): A review. International Journal of Surgery, 78(April), 185-193. https://doi.org/10.1016/j.ijsu.2020.04.018
  28. Onwuegbuzie, A. J., & Leech, N. L. (2010). Generalization practices in qualitative research: A mixed methods case study. Quality and Quantity, 44(5), 881-892. https://doi.org/10.1007/s11135-009-9241-z
  29. Palm, T. (2008). Performance assessment and authentic assessment. Practical Assessment, Research & Evaluation, 13, 4. https://doi.org/10.7275/0qpc-ws45
  30. Pastore, S., & Andrade, H. L. (2019). Teacher assessment literacy: A three-dimensional model. Teaching and Teacher Education, 84, 128-138. https://doi.org/10.1016/j.tate.2019.05.003
  31. Pokhrel, S., & Chhetri, R. (2021). A literature review on impact of COVID-19 pandemic on teaching and learning. Higher Education for the Future, 8(1), 133-141. https://doi.org/10.1177/2347631120983481
  32. Schoonenboom, J., & Johnson, R. B. (2017). How to construct a mixed methods research design. KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie [KZfSS Cologne Journal for Sociology and Social Psychology], 69, 107-131. https://doi.org/10.1007/s11577-017-0454-1
  33. Senel, S., & Senel, H. C. (2021). Remote assessment in higher education during COVID-19 pandemic. International Journal of Assessment Tools in Education, 8(2), 181-199. https://doi.org/10.21449/ijate.820140
  34. Sutadji, E., Susilo, H., Wibawa, A. P., Jabari, N. A. M., & Rohmad, S. N. (2021). Adaptation strategy of authentic assessment in online learning during the COVID-19 pandemic. Journal of Physics: Conference Series, 1810, 012059. https://doi.org/10.1088/1742-6596/1810/1/012059
  35. Tadesse, S., & Muluye, W. (2020). The impact of COVID-19 pandemic on education system in developing countries: A review. Open Journal of Social Sciences, 8(10), 159-170. https://doi.org/10.4236/jss.2020.810011
  36. Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: Enabling students to make decisions about the quality of work. Higher Education, 76(3), 467-481. https://doi.org/10.1007/s10734-017-0220-3
  37. Therisa Beena, K. K., & Sony, M. (2022). Student workload assessment for online learning: An empirical analysis during COVID-19. Cogent Engineering, 9(1), 2010509. https://doi.org/10.1080/23311916.2021.2010509
  38. Tian, W., Louw, S., & Khan, M. K. (2021). COVID-19 as a critical incident: Reflection on language assessment literacy and the need for radical changes. System, 103(October), 1-10. https://doi.org/10.1016/j.system.2021.102682
  39. UNICEF. (2020). ¿Qué hemos aprendido? Hechos salientes de una encuesta a ministerios de educación sobre las respuestas nacionales a la COVID-19 [What have we learned? Highlights from a survey of education ministries on national responses to COVID-19]. UNICEF. https://doi.org/10.2307/j.ctvm7bc81.11
  40. Vanka, S., Vanka, A., & Wali, O. (2020). Challenges in medical education on student learning, teaching and assessments. Asian Journal of Pharmaceutical Research and Health Care, 12(2), 31-33. https://doi.org/10.18311/ajprhc/2020/25235
  41. Wang, X., & Sun, X. (2022). Higher education during the COVID-19 pandemic: Responses and challenges. Education as Change, 26, 1-21. https://doi.org/10.25159/1947-9417/10024
  42. Yadav, P., & Rana, R. (2021). Challenges faced by school education system in online assessment in the phase of sudden switch to ICT based teaching-learning. Towards Excellence: An Indexed Refereed & Peer-Reviewed Journal of Higher Education, 13(2), 1016-1026. https://hrdc.gujaratuniversity.ac.in/Uploads/EJournalDetail/30/1046/86.pdf
  43. Yerly, G., & Issaieva, E. (2021). (Re)penser l’évaluation des appren-tissages au postsecondaire en temps de crise: Défis à relever et occasions à saisir en période de COVID-19 [(Re)thinking the evaluation of post-secondary learning in times of crisis: Challenges to be met and opportunities to be seized in times of COVID-19]. Revue Internationale des Technologies en Pédagogie Universitaire [International Journal of Technologies in University Pedagogy], 18(1), 89-101. https://doi.org/10.18162/ritpu-2021-v18n1-09
  44. Yen, S. C., Lo, Y., Lee, A., & Enriquez, J. M. (2018). Learning online, offline, and in-between: Comparing student academic outcomes and course satisfaction in face-to-face, online, and blended teaching modalities. Education and Information Technologies, 23(5), 2141-2153. https://doi.org/10.1007/s10639-018-9707-5