Review Article

Systematic literature review on the holistic integration of e-learning in universities: Policy, human, financial, and technical perspectives

Kai Hu 1 2 , Arumugam Raman 2 *
More Detail
1 School of Foreign Languages, Hubei Polytechnic University, Huangshi, CHINA2 School of Education Universiti, Utara Malaysia, MALAYSIA* Corresponding Author
Contemporary Educational Technology, 16(2), April 2024, ep497, https://doi.org/10.30935/cedtech/14287
Published Online: 26 February 2024, Published: 01 April 2024
OPEN ACCESS   1850 Views   1522 Downloads
Download Full Text (PDF)

ABSTRACT

This systematic literature review (SLR) explores the integration of e-learning in universities, emphasizing a comprehensive approach that intertwines various mainstream perspectives. Despite numerous studies on e-learning implementation evaluation, few have holistically considered financial, human, technical, and policy factors. This review used PRISMA guidelines and sources from Scopus, Google Scholar, ERIC, SAGE, and ProQuest. Of 26 analyzed studies, seven core themes emerged: Policy, financial, technical, human, institutional factors, others, and an integrated perspective, further distilled into 13 sub-themes. Findings highlight the importance of an integrative framework for evaluating e-learning, underscoring the interplay between macro and institutional policies. Additionally, the authors recommend cross-national comparisons and data synthesis from stakeholders, including students, educators and directors, to fully grasp e-learning implementation dynamics. Distinctively, it adopts an integrated perspective, filling the research gap by emphasizing overlooked financial considerations and presenting a comprehensive view through an SLR. By drawing insights from human, finance, technical, and policy perspective, the study provides a multidimensional lens on e-learning. This forward-looking approach not only captures the current state of e-learning integration but also charts future research directions, establishing its originality and significance in higher education.
Keywords: an integrated perspective, holistic integration of e-learning, systematic literature review, universities

CITATION (APA)

Hu, K., & Raman, A. (2024). Systematic literature review on the holistic integration of e-learning in universities: Policy, human, financial, and technical perspectives. Contemporary Educational Technology, 16(2), ep497. https://doi.org/10.30935/cedtech/14287

REFERENCES

  1. Abdelfattah, F., Al Mashaikhya, N. Y., Dahleez, K. A., & El Saleh, A. (2022). A systematic review of e-learning systems adoption before and during the COVID-19. Global Knowledge, Memory and Communication, 73(3), 292-311. https://doi.org/10.1108/GKMC-02-2022-0033
  2. Abdelwahab, A. G. (2008). Modeling students’ intention to adopt e-learning: A case from Egypt. Electronic Journal of Information Systems in Developing Countries, 34(1), 1-13. https://doi.org/10.1002/j.1681-4835.2008.tb00232.x
  3. Aboderin, O. S. (2015). Challenges and prospects of e-learning at the National Open University of Nigeria. Journal of Education and Learning, 9(3), 207-216. https://doi.org/10.11591/edulearn.v9i3.1728
  4. Al-Adwan, A. S., Nofal, M., Akram, H., Albelbisi, N. A., & Al-Okaily, M. (2022). Towards a sustainable adoption of e-learning systems: The role of self-directed learning. Journal of Information Technology Education: Research, 21, 245-267. https://doi.org/10.28945/4980
  5. Al-Araibi, A. A. M., Naz’ri Bin Mahrin, M., Yusoff, R. C. M., & Chuprat, S. B. (2019). A model for technological aspect of e-learning readiness in higher education. Education and Information Technologies, 24, 1395-1431. https://doi.org/10.1007/s10639-018-9837-9
  6. Al-Azawei, A. (2019). What drives successful social media in education and e-learning? A comparative study on Facebook and Moodle. Journal of Information Technology Education, 18(1), 253-274. https://doi.org/10.28945/4360
  7. Alfelaij, B. (2016). Why integrating technology has been unsuccessful in Kuwait? An exploratory study. E-Learning and Digital Media, 13(3-4), 126-139. https://doi.org/10.1177/2042753016672901
  8. Ally, M., & Samaka, M. (2013). Open education resources and mobile technology to narrow the learning divide. Athabasca University Press. https://doi.org/10.19173/irrodl.v14i2.1530
  9. Al-Maroof, R., Al-Qaysi, N., Salloum, S. A., & Al-Emran, M. (2021). Blended learning acceptance: A systematic review of information systems models. Technology, Knowledge and Learning, 27, 891-926. https://doi.org/10.1007/s10758-021-09519-0
  10. Alnabhan, M., & Aljaraideh, Y. (2014). Collaborative m-learning adoption model: A case study for Jordan. International Journal of Emerging Technologies in Learning, 9(8), 4. https://doi.org/10.3991/ijet.v9i8.3639
  11. Al-Nuaimi, M. N., & Al-Emran, M. (2021). Learning management systems and technology acceptance models: A systematic review. Education and Information Technologies, 26(5), 5499-5533. https://doi.org/10.1007/s10639-021-10513-3
  12. Alsswey, A., & Al-Samarraie, H. (2019). M-learning adoption in the Arab gulf countries: A systematic review of factors and challenges. Education and Information Technologies, 24(5), 3163-3176. https://doi.org/10.1007/s10639-019-09923-1
  13. Anthony Jnr, B. (2021). Institutional factors for faculty members’ implementation of blended learning in higher education. Education + Training, 63(5), 701-719. https://doi.org/10.1108/ET-06-2020-0179
  14. Anthony Jnr, B. A., Kamaludin, A., Romli, A., Raffei, A. F. M., Phon, D. N. A. L. E., Abdullah, A., Ming, G. L., Shukor, N. A., Nordin, M. S., & Baba, S. (2021). An integrative framework to investigate the impact of blended learning adoption in higher education: A theoretical perspective. International Journal of Technology Enhanced Learning, 13(2), 182-207. https://doi.org/10.1504/IJTEL.2021.114074
  15. Aparicio, M., Bacao, F., & Oliveira, T. (2016). Cultural impacts on e-learning systems’ success. The Internet and Higher Education, 31, 58-70. https://doi.org/10.1016/j.iheduc.2016.06.003
  16. Archambault, L., & Barnett, J. H. (2010). Revisiting technological pedagogical content knowledge: Exploring the TPACK framework. Computers & Education, 55(4), 1656-1662. https://doi.org/10.1016/j.compedu.2010.07.009
  17. Arkorful, V., & Abaidoo, N. (2015). The role of e-learning, advantages and disadvantages of its adoption in higher education. International Journal of Instructional Technology and Distance Learning, 12(1), 29-42.
  18. Aung, T. N., & Khaing, S. S. (2016). Challenges of implementing e-learning in developing countries: A review. In Proceedings of the 9th International Conference on Genetic and Evolutionary Computing (pp. 405-411). Springer. https://doi.org/10.1007/978-3-319-23207-2_41
  19. Bacow, L. S., Bowen, W. G., Guthrie, K. M., Lack, K. A., & Long, M. P. (2012). Barriers to adoption of online learning systems in U.S. higher education. ITHAKA SR. https://doi.org/10.18665/sr.22432
  20. Basak, S. K., Wotto, M., & Bélanger, P. (2016). A framework on the critical success factors of e-learning implementation in higher education: A review of the literature. International Journal of Educational and Pedagogical Sciences, 10(7), 2409-2414.
  21. Bates, T. (2015). Teaching in a digital age. Tony Bates Associates Ltd. https://doi.org/10.1093/acprof:oso/9780190215736.001.0001
  22. Bell, B. S., & Federman, J. E. (2013). E-learning in postsecondary education. The Future of Children, 23(1), 165-185. https://doi.org/10.1353/foc.2013.0007
  23. Bell, M., & Farrier, S. (2008). Measuring success in e‑learning: A multi‑dimensional approach. Electronic Journal of E-Learning, 6(2), 99-110.
  24. Bernard, R. M., Abrami, P. C., Borokhovski, E., Wade, C. A., Tamim, R. M., Surkes, M. A., & Bethel, E. C. (2009). A meta-analysis of three types of interaction treatments in distance education. Journal of Online Learning and Teaching, 79(3), 1243-1289. https://doi.org/10.3102/0034654309333844
  25. Bettayeb, H., Alshurideh, M. T., & Al Kurdi, B. (2020). The effectiveness of mobile learning in UAE universities: A systematic review of motivation, self-efficacy, usability and usefulness. International Journal of Control and Automation, 13(2), 1558-1579.
  26. Bidarra, J., Rothschild, M., Squire, K., & Figueiredo, M. (2013). The AIDLET model: A framework for selecting games, simulations and augmented reality environments in mobile learning. International Journal of Web-Based Learning and Teaching Technologies, 8(4), 50-71. https://doi.org/10.4018/ijwltt.2013100104
  27. Bizzo, E. (2021). Acceptance and resistance to e-learning adoption in developing countries: A literature review. Ensaio: Avaliação e Políticas Públicas em Educação [Essay: Assessment and Public Policies in Education], 30, 458-483. https://doi.org/10.1590/S0104-403620220003003342
  28. Cader, M. N. A. (2022). Selection of external factors for enhanced technological acceptance model for e-learning. TIERS Information Technology Journal, 3(1), 11-16. https://doi.org/10.38043/tiers.v3i1.3517
  29. Cepeda-Moya, V. E., & Argudo-Serrano, J. C. (2022). Teachers’ and students’ perceptions on introducing the SAMR model into their classroom. Revista Arbitrada Interdisciplinaria Koinonía [Koinonia Interdisciplinary Arbitrated Journal], 7(1), 65-94. https://doi.org/10.35381/r.k.v7i1.1679
  30. Chipere, N. (2017). A framework for developing sustainable e-learning programs. Open Learning: The Journal of Open, Distance and E-Learning, 32(1), 36-55. https://doi.org/10.1080/02680513.2016.1270198
  31. Cigdem, H., & Ozturk, M. (2016). Factors affecting students’ behavioral intention to use LMS at a Turkish post-secondary vocational school. International Review of Research in Open and Distributed Learning, 17(3), 276-295. https://doi.org/10.19173/irrodl.v17i3.2253
  32. Cook, J., Holley, D., & Andrew, D. (2007). A stakeholder approach to implementing e-learning in a university. British Journal of Educational Technology, 38(5), 784-794. https://doi.org/10.1111/j.1467-8535.2007.00755.x
  33. Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research. SAGE.
  34. Czerniewicz, L., & Brown, C. (2009). A study of the relationship between institutional policy, organizational culture and e-learning use in four South African universities. Computers and Education, 53(1), 121-131. http://doi.org/10.1016/j.compedu.2009.01.006
  35. Dabbagh, N., & Kitsantas, A. (2012). Personal learning environments, social media, and self-regulated learning: A natural formula for connecting formal and informal learning. The Internet and Higher Education, 15(1), 3-8. https://doi.org/10.1016/j.iheduc.2011.06.002
  36. Daniel, J. (2016). Making sense of blended learning: Treasuring an older tradition or finding a better future. TechOnline. https://teachonline.ca/tools-trends/blended-learning-successful-design-delivery-and-student-engagement/making-sense-blended-learning-treasuring-older-tradition-or-finding-better-future
  37. Dima, A., Bugheanu, A. M., Boghian, R., & Madsen, D. Ø. (2022). Mapping knowledge area analysis in e-learning systems based on cloud computing. Electronics, 12(1), 62. https://doi.org/10.3390/electronics12010062
  38. Duan, Y., He, Q., Feng, W., Li, D., & Fu, Z. (2010). A study on e-learning take-up intention from an innovation adoption perspective: A case in China. Computers & Education, 55(1), 237-246. https://doi.org/10.1016/j.compedu.2010.01.009
  39. Ejdys, J. (2021). Factors affecting the adoption of e-learning at university level. WSEAS Transactions on Business and Economics, 18(3), 313-323. https://doi.org/10.37394/23207.2021.18.32
  40. Fauzi, M. A. (2022). E-learning in higher education institutions during COVID-19 pandemic: Current and future trends through bibliometric analysis. Heliyon, 8(5), e09433. https://doi.org/10.1016/j.heliyon.2022.e09433
  41. Garrison, D. R., & Kanuka, H. (2004). Blended learning: Uncovering its transformative potential in higher education. The Internet and Higher Education, 7(2), 95-105. https://doi.org/10.1016/j.iheduc.2004.02.001
  42. Gera, R., & Chadha, P. (2021). Systematic review of artificial intelligence in higher education (2000-2020) and future research directions. University of South Florida M3 Center Publishing, 3(2021), 12.
  43. Hamilton, E. R., Rosenberg, J. M., & Akcaoglu, M. (2016). The substitution augmentation modification redefinition (SAMR) model: A critical review and suggestions for its use. TechTrends, 60(5), 433-441. https://doi.org/10.1007/s11528-016-0091-y
  44. Harasim, L. (2006). A history of e-learning: Shift happened. In J. Weiss, J. Nolan, J. Hunsinger, & P. Trifonas (Eds.), The international handbook of virtual learning environments (pp. 59-94). Springer. https://doi.org/10.1007/978-1-4020-3803-7_2
  45. Holt, D., & Challis, D. (2007). From policy to practice. One universities’ experience of implementing strategic change through wholly online teaching and learning. Australasian Journal of Educational Technology, 23(1), 110-131. https://doi.org/10.14742/ajet.1276
  46. Iskander, G. M. (2014). Developing scale for assimilate the integration between learning theories and e-learning. International Journal of Emerging Technologies in Learning, 9(2), 4. https://doi.org/10.3991/ijet.v9i2.3206
  47. James, P. C. (2021). What determines student satisfaction in an e-learning environment? A comprehensive literature review of key success factors. Higher Education Studies, 11(3), 1-9. https://doi.org/10.5539/hes.v11n3p1
  48. Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26. https://doi.org/10.3102/0013189X033007014
  49. Jonassen, D. H., & Reeves, T. C. (1996). Learning with technology: Using computers as cognitive tools. Journal of Computer Assisted Learning, 6, 40-73. https://doi.org/10.1007/BF02941038
  50. Karkar, A. J., Fatlawi, H. K., & Al-Jobouri, A. A. (2020). Highlighting e‑learning adoption challenges using data analysis techniques: University of Kufa as a case study. Electronic Journal of E-Learning, 18(2), 136-149. https://doi.org/10.34190/EJEL.20.18.2.003
  51. Kattoua, T., Al-Lozi, M., & Alrowwad, A. A. (2016). A review of literature on e-learning systems in higher education. International Journal of Business Management and Economic Research, 7(5), 754-762.
  52. Kaushik, M. K., & Verma, D. (2020). Determinants of digital learning acceptance behavior: A systematic review of applied theories and implications for higher education. Journal of Applied Research in Higher Education, 12(4), 659-672. https://doi.org/10.1108/JARHE-06-2018-0105
  53. Kelland, J. H., & Kanuka, H. (2007). “ We just disagree:” Using deliberative inquiry to seek consensus about the effects of e-learning on higher education. Canadian Journal of Learning and Technology, 33(3), 3. https://doi.org/10.21432/T26W2K
  54. Khan, B. H., Affouneh, S., Hussein Salha, S., & Najee Khlaif, Z. (2021). Challenges and opportunities for the global implementation of e-learning frameworks. IGI Global. https://doi.org/10.4018/978-1-7998-7607-6
  55. King, E., & Boyatt, R. (2015). Exploring factors that influence adoption of e-learning within higher education. British Journal of Educational Technology, 46(6), 1272-1280. https://doi.org/10.1111/bjet.12195
  56. Klein, D., & Ware, M., (2003). E-learning: New opportunities in continuing professional development. Learned Publishing, 16, 34-46. https://doi.org/10.1087/095315103320995078
  57. Knobloch, K., Yoon, U., & Vogt, P. M. (2011). Preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement and publication bias. Journal of Cranio-Maxillofacial Surgery, 39(2), 91-92. https://doi.org/10.1016/j.jcms.2010.11.001
  58. Kristy, M. A., Santosa, P. I., & Ferdiana, R. (2022). A model for understanding mandatory system implementation: A literature review. Jurnal Teknik Informatika dan Sistem Informasi [Journal of Informatics Engineering and Information Systems], 9(2), 1024-1037. https://doi.org/10.35957/jatisi.v9i2.1874
  59. Lidolf, S., & Pasco, D. (2020). Educational technology professional development in higher education: A systematic literature review of empirical research. Frontiers in Education, 5, 35. https://doi.org/10.3389/feduc.2020.00035
  60. Marshall, S. J., & Mitchell, G. (2007). Benchmarking international e-learning capability with the e-learning maturity model. In Proceedings of EDUCAUSE in Australasia.
  61. McNaught, C., Lam, P., Cheng, K. F., Kennedy, D. M., & Mohan, J. B. (2009). Challenges in employing complex e-learning strategies in campus-based universities. International Journal of Technology Enhanced Learning, 1(4), 266-285. https://doi.org/10.1504/IJTEL.2009.030778
  62. Mihai, A., Questier, F., & Zhu, C. (2021). The institutionalization of online and blended learning initiatives in politics and international relations at European universities. European Political Science, 20, 359-377. https://doi.org/10.1057/s41304-020-00307-5
  63. Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. Teachers College Record, 108(6), 1017-1054.
  64. Modise, M. P. (2022). Academics’ readiness for online teaching in higher education institutions in developing countries: A systematic review. UnisaRxiv. https://doi.org/10.25159/UnisaRxiv/000036.v1
  65. Mohamed, B., Noorashid, N. A., & Abd Razak, F. Z. (2021). The determine factors of student satisfaction with e-learning in Malaysia higher education institutions: A scoping review. Journal of Physics: Conference Series 1874, 012051. https://doi.org/10.1088/1742-6596/1874/1/012051
  66. Mohammadyari, S., & Singh, H. (2015). Understanding the effect of e-learning on individual performance: The role of digital literacy. Computers & Education, 82, 11-25. https://doi.org/10.1016/j.compedu.2014.10.025
  67. Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & PRISMA Group, T. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Annals of Internal Medicine, 151(4), 264-269. https://doi.org/10.1016/j.ijsu.2010.02.007
  68. Moore, J. C. (2005). The Sloan Consortium quality framework and the five pillars. The Sloan Consortium. http://www.mit.jyu.fi/OPE/kurssit/TIES462/Materiaalit/Sloan.pdf
  69. Morse, J. M. (2003). Principles of mixed methods and multimethod research design. In A. Tashakkori, & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 189-208). SAGE.
  70. Mosa, A. A., Mohd. Naz’ri bin Mahrin, & Ibrrahim, R. (2016). Technological aspects of e-learning readiness in higher education: A review of the literature. Computer and Information Science, 9(1), 113-127. https://doi.org/10.5539/cis.v9n1p113
  71. Mousa, A. H., Aljshamee, M., Mohammed, A. H., Mousa, S. H., Mousa, S. H., & Obaid, H. A. (2020). A systematic literature review: Measuring user acceptance models in e-learning adopted in higher education institutes. AIP Conference Proceedings, 2290(1), 040021. https://doi.org/10.1063/5.0027409
  72. Mustafa, A. S., & Ali, N. (2023). The adoption and use of Moodle in online learning: A systematic review. Information Sciences Letters, 12, 341-351. https://doi.org/10.18576/isl/120129
  73. Naresh, B., & Reddy, B. S. (2015). Challenges and opportunity of e-learning in developed and developing countries-a review. International Journal of Emerging Research in Management &Technology, 4(6), 259-262.
  74. Nejkovic, V., & Tosic, M. (2018). Exploring factors for effective use of online information in SPOC within the engineering education. Computer Applications in Engineering Education, 26(5), 1457-1469. https://doi.org/10.1002/cae.21991
  75. Ntorukiri, T. B., Kirugua, J. M., & Kirimi, F. (2022). Policy and infrastructure challenges influencing ICT implementation in universities: A literature review. Discover Education, 1(1), 19. https://doi.org/10.1007/s44217-022-00019-6
  76. Oyetade, K. E., Zuva, T., & Harmse, A. (2020). Technology adoption in education: A systematic literature review. Advances in Science, Technology and Engineering Systems, 5(6), 108-112. https://doi.org/10.25046/aj050611
  77. Ozdamli, F., & Karagozlu, D. (2022). Online education during the pandemic: A systematic literature review. International Journal of Emerging Technologies in Learning, 17(16), 167-193. https://doi.org/10.3991/ijet.v17i16.32287
  78. Piccoli, G., Ahmad, R., & Ives, B. (2001). Web-based virtual learning environments: A research framework and a preliminary assessment of effectiveness in basic IT skills training. Computers & Education, 25(4), 401-426. https://doi.org/10.2307/3250989
  79. Price, L., & Kirkwood, A. (2014). Using technology for teaching and learning in higher education: A critical review of the role of evidence in informing practice. Higher Education Research & Development, 33(3), 549-564. https://doi.org/10.1080/07294360.2013.841643
  80. Puentedura, R. (2006). Transformation, technology, and education. http://www.hippasus.com/rrpweblog/
  81. Raman, A., Don, Y., & Kasim, A. L. (2014). The relationship between principals’ technology leadership and teachers’ technology use in Malaysian secondary schools. Asian Social Science, 10(18), 30-35. https://doi.org/10.5539/ass.v10n18p30
  82. Qasem, Y. A., Abdullah, R., Jusoh, Y. Y., Atan, R., & Asadi, S. (2019). Cloud computing adoption in higher education institutions: A systematic review. IEEE Access, 7, 63722-63744. https://doi.org/10.1109/ACCESS.2019.2916234
  83. Renes, S. L., & Strange, A. T. (2011). Using technology to enhance higher education. Innovative Higher Education, 36, 203-213. https://doi.org/10.1007/s10755-010-9167-3
  84. Rooney, J., E. (2003). Blending learning opportunities to enhance educational programming and meetings. Association Management, 55(5), 26-32.
  85. Rovai, A. P., & Downey, J. R. (2010). Why some distance education programs fail while others succeed in a global environment. The Internet and Higher Education, 13(3), 141-147. https://doi.org/10.1016/j.iheduc.2009.07.001
  86. Selim, H. M. (2005). Critical success factors for e-learning acceptance: Confirmatory factor models. Computers and Education. 49(2), 396-413. https://doi.org/10.1016/j.compedu.2005.09.004
  87. Selwyn, N. (2007). The use of computer technology in university teaching and learning: A critical perspective. British Journal of Educational Technology, 23(2), 83-94. https://doi.org/10.1111/j.1365-2729.2006.00204.x
  88. Selwyn, N. (2011). Schools and schooling in the digital age: A critical analysis. Routledge. https://doi.org/10.4324/9780203840795
  89. Seraji, F., Abbasi Kasani, H., Aghazadeh, S., Sharifi Rahnamoo, S., & Bakhtiari, R. (2021). Online-only learning challenges in higher education in COVID-19 era: A research synthesis. Quarterly of Iranian Distance Education Journal, 3(2), 16-31.
  90. Shahzad, K., Khan, S. A., Javed, Y., & Iqbal, A. (2023). E-learning for continuing professional development of university librarians: A systematic review. Sustainability, 15(1), 849. https://doi.org/10.3390/su15010849
  91. Sharifov, M., & Mustafa, A. S. (2020). Review of prevailing trends, barriers and future perspectives of learning management systems (LMSs) in higher institutions. The Online Journal of New Horizons in Education, 10(3), 166.
  92. Shelton, K. (2011). A review of paradigms for evaluating the quality of online education programs. Online Journal of Distance Learning Administration, 4(1).
  93. Siddiquei, N. L., & Khalid, R. (2020). Journey towards e-learning in Pakistan: A systematic review. International Journal of Distance Education and E-Learning, 5(2), 20-44. https://doi.org/10.36261/ijdeel.v5i2.1040
  94. Sidhu, R., & Gage, W. H. (2021). Enhancing the odds of adopting e-learning or community-focused experiential learning as a teaching practice amongst university faculty. Heliyon, 7(4), e06704. https://doi.org/10.1016/j.heliyon.2021.e06704
  95. Soong, B. M. H., Chan, H. C., Chua, B. C., & Loh, K. F (2001). Critical success factors for online course resources. Computers and Education, 36(2), 101-120. https://doi.org/10.1016/S0360-1315(00)00044-0
  96. Stansfield, M., Connolly, T., Cartelli, A., Jimoyiannis, A., Magalhães, H., & Maillet, K. (2009). The identification of key issues in the development of sustainable e-learning and virtual campus initiatives. Electronic Journal of E-Learning, 7(2), 155-164.
  97. Stefanovic, D., Drapsin, M., Nikolic, J., Scepanovic, D., Radjo, I., & Drid, P. (2011). Empirical study of student satisfaction in e-learning system environment. Technics Technologies Education Management, 6(4), 1152-1164.
  98. Teddlie, C., & Tashakkori, A. (2009). Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioral sciences. SAGE.
  99. Toktarova, V. I., & Ivanova, A. V. (2015). Implementation of pedagogical innovations in the electronic educational environment of the university. Mediterranean Journal of Social Sciences, 6(3 S7), 179. https://doi.org/10.5901/mjss.2015.v6n3s7p179
  100. Topal, A. D. (2016). Examination of university students’ level of satisfaction and readiness for e-courses and the relationship between them. European Journal of Contemporary Education, 15(1), 7-23. https://doi.org/10.13187/ejced.2016.15.7
  101. Valverde-Berrocoso, J., Garrido-Arroyo, M. D. C., Burgos-Videla, C., & Morales-Cevallos, M. B. (2020). Trends in educational research about e-learning: A systematic literature review (2009-2018). Sustainability, 12(12), 5153. https://doi.org/10.3390/su12125153
  102. Volery, T. & Lord, D. (2000). Critical success factors in online education. The International Journal of Education Management, 14 (5), 216-223. https://doi.org/10.1108/09513540010344731
  103. Voogt, J., Fisser, P., Pareja Roblin, N., Tondeur, J., & van Braak, J. (2013). Technological pedagogical content knowledge–A review of the literature. Journal of Computer Assisted Learning, 29(2), 109-121. https://doi.org/10.1111/j.1365-2729.2012.00487.x
  104. Waller, R. E., Lemoine, P. A., Mense, E. G., & Richardson, M. D. (2019). Higher education in search of competitive advantage: Globalization, technology and e-learning. International Journal of Advanced Research and Publications, 3(8), 184-190. https://doi.org/10.20849/jed.v3i2.613
  105. Xiao, Y., & Watson, M. (2019). Guidance on conducting a systematic literature review. Journal of Planning Education and Research, 39(1), 93-112. https://doi.org/10.1177/0739456X17723971
  106. Ziraba, A., Akwene, G. C., & Lwanga, S. C. (2020). The adoption and use of Moodle learning management system in higher institutions of learning: A systematic literature review. American Journal of Online and Distance Learning, 2(1), 1-21.