Review Article

Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature

Muhammad Imran 1 2 * , Norah Almusharraf 3
More Detail
1 Education Research Lab, Prince Sultan University, Riyadh, SAUDI ARABIA2 Department of English, University of Sahiwal, Sahiwal, PAKISTAN3 Linguistics and Translation Department, Prince Sultan University, Riyadh, SAUDI ARABIA* Corresponding Author
Contemporary Educational Technology, 15(4), October 2023, ep464, https://doi.org/10.30935/cedtech/13605
Published Online: 22 August 2023, Published: 01 October 2023
OPEN ACCESS   23827 Views   19736 Downloads
Download Full Text (PDF)

ABSTRACT

This study examines the role of ChatGPT as a writing assistant in academia through a systematic literature review of the 30 most relevant articles. Since its release in November 2022, ChatGPT has become the most debated topic among scholars and is also being used by many users from different fields. Many articles, reviews, blogs, and opinion essays have been published in which the potential role of ChatGPT as a writing assistant is discussed. For this systematic review, 550 articles published six months after ChatGPT’s release (December 2022 to May 2023) were collected based on specific keywords, and the final 30 most relevant articles were finalized through PRISMA flowchart. The analyzed literature identifies different opinions and scenarios associated with using ChatGPT as a writing assistant and how to interact with it. Findings show that artificial intelligence (AI) in education is a part of the ongoing development process, and its latest chatbot, ChatGPT is a part of it. Therefore, the education process, particularly academic writing, has both opportunities and challenges in adopting ChatGPT as a writing assistant. The need is to understand its role as an aid and facilitator for both the learners and instructors, as chatbots are relatively beneficial devices to facilitate, create ease and support the academic process. However, academia should revisit and update students’ and teachers’ training, policies, and assessment ways in writing courses for academic integrity and originality, like plagiarism issues, AI-generated assignments, online/home-based exams, and auto-correction challenges.
Keywords: AI in education, chatbots, ChatGPT as writing assistant, scientific writing, academic integrity

CITATION (APA)

Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4), ep464. https://doi.org/10.30935/cedtech/13605

REFERENCES

  1. Afzaal, M., Imran, M., Du, X., & Almusharraf, N. (2022). Automated and human interaction in written discourse: A contrastive parallel corpus-based investigation of meta discourse features in machine-human translations. SAGE Open, 12(4), 1-18. https://doi.org/21582440221142210
  2. Alattar, A. A., & McDowell, M. M. (2023). The rise of AI coauthors: Navigating the future of scientific writing with ChatGPT. Journal of Neurosurgery, 1, 1-2. https://doi.org/10.3171/2023.3.JNS23254
  3. Altmäe, S., Sola-Leyva, A., & Salumets, A. (2023). Artificial intelligence in scientific writing: A friend or a foe? Reproductive BioMedicine Online. https://doi.org/10.1016/j.rbmo.2023.06.011
  4. Ariyaratne, S., Iyengar, K. P., Nischal, N., Chitti Babu, N., & Botchu, R. (2023). A comparison of ChatGPT-generated articles with human-written articles. Skeletal Radiology. https://doi.org/10.1007/s00256-023-04340-5
  5. Barrot, J. S. (2023). Using ChatGPT for second language writing: Pitfalls and potentials. Assessing Writing, 57, 100745. https://doi.org/10.1016/j.asw.2023.100745
  6. Biswas, S. (2023). ChatGPT and the future of medical writing. Radiology, 307(2), e223312. https://doi.org/10.1148/radiol.223312
  7. Cingillioglu, I. (2023). Detecting AI-generated essays: The ChatGPT challenge. The International Journal of Information and Learning Technology, 40(3), 259-268. https://doi.org/10.1108/IJILT-03-2023-0043
  8. Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology. https://doi.org/10.1007/s10956-023-10039-y
  9. Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. https://doi.org/10.1080/14703297.2023.2190148
  10. da Silva, J. A. T. (2023). Is ChatGPT a valid author? Nurse Education in Practice, 68, 103600. https://doi.org/10.1016/j.nepr.2023.103600
  11. Dergaa, I., Chamari, K., Zmijewski, P., & Saad, H. B. (2023). From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615-622. https://doi.org/10.5114/biolsport.2023.125623
  12. Dwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., Albanna, H., Albashrawi, M. A., Al-Busaidi, A. S., Balakrishan, J., Barlette, Y., Basu, S., Bose, I., Brooks, L., Buhalis, D., ... Wright, R. (2023). “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. International Journal of Information Management, 71, 102642. https://doi.org/10.1016/j.ijinfomgt.2023.102642
  13. Firat, M. (2023). What ChatGPT means for universities: Perceptions of scholars and students. Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.22
  14. Gao, C. A., Howard, F. M., Markov, N. S., Dyer, E. C., Ramesh, S., Luo, Y., & Pearson, A. T. (2023). Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digital Medicine, 6(1), 75. https://doi.org/10.1038/s41746-023-00819-6
  15. Ge, J., & Lai, J. C. (2023). Artificial intelligence-based text generators in hepatology: ChatGPT is just the beginning. Hepatology Communications, 7(4). https://doi.org/10.1097/HC9.0000000000000097
  16. Geher, G. (2023). ChatGPT, artificial intelligence, and the future of writing. Psychology Today. https://www.psychologytoday.com/us/blog/darwins-subterranean-world/202301/chatgpt-artificial-intelligence-and-the-future-of-writing
  17. Greller, W., & Drachsler, H. (2012). Translating learning into numbers: A generic framework for learning analytics. Journal of Educational Technology & Society, 15(3), 42-57.
  18. Holmes, W., Persson, J., Chounta, I. A., Wasson, B., & Dimitrova, V. (2022). Artificial intelligence and education: A critical view through the lens of human rights, democracy and the rule of law. Council of Europe. https://rm.coe.int/artificial-intelligence-and-education-a-critical-view-through-the-lens/1680a886bd
  19. Homolak, J. (2023). Opportunities and risks of ChatGPT in medicine, science, and academic publishing: A modern Promethean dilemma. Croatian Medical Journal, 64(1), 1. https://doi.org/10.3325/cmj.2023.64.1
  20. Huang, J., & Tan, M. (2023). The role of ChatGPT in scientific communication: Writing better scientific review articles. American Journal of Cancer Research, 13(4), 1148.
  21. Imran, M., & Almusharraf, N. (2023). Review of teaching innovation in university education: Case studies and main practices. The Social Science Journal. https://doi.org/10.1080/03623319.2023.2201973
  22. Kasneci, E., Seßler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … & Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. EdArXiv. https://doi.org/10.35542/osf.io/5er8f
  23. Kirmani, A. R. (2022). Artificial intelligence enabled science poetry. ACS Energy Letters, 8, 574-576. https://doi.org/10.1021/acsenergylett.2c02758
  24. Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 00336882231162868. https://doi.org/10.1177/00336882231162868
  25. Kung, T. H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepaño, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., Maningo, J., & Tseng, V. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS Digital Health, 2(2). https://doi.org/10.1371/journal.pdig.0000198
  26. Lametti, D. (2022). AI could be great for college essays. slate.com. https://slate.com/technology/2022/12/chatgpt-college-essay-plagiarism.html
  27. Liberati, A., Clark, J., D’Amico, R., Grimshaw, J., Moja, L., Napoli, M., Pham, B., & Tovey, D. (2014). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Revista Espanola de Nutricion Humana y Dietetica [Spanish Journal of Human Nutrition and Dietetics], 18(3), 172-181.
  28. Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
  29. Lund, B. D. (2023). A brief review of ChatGPT: Its value and the underlying GPT technology. https://www.researchgate.net/publication/366809571_A_Brief_Review_of_ChatGPT_Its_Value_and_the_Underlying_GPT_Technology
  30. Lund, B. D., & Wang, T. (2023). Chatting about ChatGPT: How may AI and GPT impact academia and libraries? Library Hi Tech News. https://doi.org/10.2139/ssrn.4333415
  31. Lund, B. D., Wang, T., Mannuru, N. R., Nie, B., Shimray, S., & Wang, Z. (2023). ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing. Journal of the Association for Information Science and Technology, 74(5), 570-581. https://doi.org/10.1002/asi.24750
  32. Manohar, N., & Prasad, S. S. (2023). Use of ChatGPT in academic publishing: A rare case of seronegative systemic lupus erythematosus in a patient with HIV infection. Cureus, 15(2). https://doi.org/10.7759/cureus.34616
  33. McMurtrie, B. (2022). AI and the future of undergraduate writing. The Chronicles of Higher Education. https://www.chronicle.com/article/ai-and-the-future-of-undergraduate-writing?cid=gen_sign_in
  34. O’Connor, S., & ChatGPT.(2023). Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse. Nurse Education In Practice, 66. https://doi.org/10.1016/j.nepr.2022.103537
  35. Rahimi, F., & Abadi, A. T. B. (2023). ChatGPT and publication ethics. Archives of Medical Research, 54(3), 272-274. https://doi.org/10.1016/j.arcmed.2023.03.004
  36. Ramalingam, S., Yunus, M. M., & Hashim, H. (2022). Blended learning strategies for sustainable English as a second language education: A systematic review. Sustainability, 14(13), 8051. https://doi.org/10.3390/su14138051
  37. Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., Sun, M., Day, I., Rather, R. A., & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning and Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.29
  38. Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121-154. https://doi.org/10.1016/j.iotcps.2023.04.003
  39. Roumeliotis, K. I., & Tselikas, N. D. (2023). ChatGPT and open-AI models: A preliminary review. Future Internet, 15(6), 192. https://doi.org/10.3390/fi15060192
  40. Sallam, M. (2023). ChatGPT utility in healthcare education, research, and practice: Systematic review on the promising perspectives and valid concerns. Healthcare, 11(6), 887. https://doi.org/10.3390/healthcare11060887
  41. Salvagno, M., Taccone, F. S., & Gerli, A. G. (2023). Can artificial intelligence help for scientific writing? Critical Care, 27(1), 1-5. https://doi.org/10.1186/s13054-023-04380-2
  42. Stacey, S. (2022). Cheating on your college essay with ChatGPT. Business Insider. https://www.businessinsider.com/professors-say-chatgpt-wont-kill-college-essays-make-education-fairer-2022-12
  43. Steenbergen-Hu, S., & Cooper, H. (2014). A meta-analysis of the effectiveness of intelligent tutoring systems on college students’ academic learning. Journal of Educational Psychology, 106(2), 331. https://doi.org/10.1037/a0034752
  44. Stock, L. (2023). ChatGPT is changing education, AI experts say–but how? DW.com-science-global issues. https://www.dw.com/en/chatgpt-is-changing-education-ai-experts-say-but-how/a-64454752
  45. Stokel-Walker C. (2022). AI bot ChatGPT writes smart essays–should professors worry? Nature. https://doi.org/10.1038/d41586-022-04397-7
  46. Suaverdez, J. B., & Suaverdez, U. V. (2023). Chatbots impact on academic writing. Global Journal of Business and Integral Security.
  47. Taecharungroj, V. (2023). What can ChatGPT do? Analyzing early reactions to the innovative AI chatbot on Twitter. Big Data and Cognitive Computing, 7(1), 35. https://doi.org/10.3390/bdcc7010035
  48. Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379(6630), 313-313. https://doi.org/10.1126/science.adg7879
  49. Transformer, C. G. P. T., & Zhavoronkov, A. (2022). Rapamycin in the context of Pascal’s Wager: Generative pre-trained transformer perspective. Oncoscience, 9, 82. https://doi.org/10.18632/oncoscience.571
  50. Uegaki, W. (2022). The informativeness/complexity trade-off in the domain of Boolean connectives. Linguistic Inquiry, 1-23. https://doi.org/10.1162/ling_a_00461
  51. Van Dis, E. A., Bollen, J., Zuidema, W., van Rooij, R., & Bockting, C. L. (2023). ChatGPT: Five priorities for research. Nature, 614(7947), 224-226. https://doi.org/10.1038/d41586-023-00288-7
  52. Verhoeven, F., Wendling, D., & Prati, C. (2023). ChatGPT: When artificial intelligence replaces the rheumatologist in medical writing. Annals of the Rheumatic Diseases, 82(8), 1015-1017. https://doi.org/10.1136/ard-2023-223936
  53. Wen, J., & Wang, W. (2023). The future of ChatGPT in academic research and publishing: A commentary for clinical and translational medicine. Clinical and Translational Medicine, 13(3). https://doi.org/10.1002/ctm2.1207
  54. Williams, T. (2023). Turnitin announces AI detector with ‘97 per cent accuracy. timeshighereducation.com. https://www.timeshighereducation.com/news/turnitin-announces-ai-detector-97-cent-accuracy
  55. Yan, D. (2023). Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigation. Education and Information Technologies. https://doi.org/10.1007/s10639-023-11742-4
  56. Yeadon, W., Inyang, O. O., Mizouri, A., Peach, A., & Testrow, C. P. (2023). The death of the short-form physics essay in the coming AI revolution. Physics Education, 58(3). https://doi.org/10.1088/1361-6552/acc5cf
  57. Zheng, H., & Zhan, H. (2023). ChatGPT in scientific writing: A cautionary tale. The American Journal of Medicine, 136(8), 725-726.e6. https://doi.org/10.1016/j.amjmed.2023.02.011
  58. Zimmerman, A. (2023). A ghostwriter for the masses: ChatGPT and the future of writing. Annals of Surgical Oncology, 30, 3170-3173. https://doi.org/10.1245/s10434-023-13436-0