Application of the Chatbot in University Education: A Bibliometric Analysis of Indexed Scientific Production in SCOPUS, 2013-2023
Abstract
Universities today are employing tools based on artificial intelligence to improve the educational service in general. The chatbot represents an online communicative interaction tool which contributes to solving daily queries required by students, teachers or graduates. However, there are few bibliometric review studies on the chatbot that show in which areas there is a greater concentration or lack of scientific production at the university level. The objective of this article is to explore and describe the research trends regarding the application of the chatbot in university education through the bibliometric analysis of publications indexed to Scopus. The research is of an exploratory-descriptive level, developed under a quantitative approach. The study covered the scientific production between the years 2013 and 2023, identifying 210 manuscripts. It was identified that there is a growing trend in scientific production, particularly in scientific articles and conference papers. The most cited article was published in 2018 and has 162 citations. Therefore, it is concluded that there is a greater concentration in the scientific production of manuscripts focused on improving the university educational service, applying significantly to the improvement of academic performance, administrative management and university wellbeing. However, there is a gap that needs to be reduced in terms of the lack of scientific studies in which the chatbot is used as a tool to identify the satisfaction of university students. In addition, there is a lack of research on the use of a regulatory framework that regulates the application of the chatbot at the university level.
https://doi.org/10.26803/ijlter.22.7.15
Keywords
Full Text:
PDFReferences
Adamopoulou, E., & Moussiades, L. (2020). Chatbots: History, technology, and applications. Machine Learning with Applications, 2, 1–18. https://doi.org/10.1016/j.mlwa.2020.100006
Al-Ghadhban, D., & Al-Twairesh, N. (2020). Nabiha: An Arabic dialect chatbot. International Journal of Advanced Computer Science and Applications, 11(3), 1-8. https://pdfs.semanticscholar.org/85a7/efbe21c45fdd756f9ae704bbc0c263152ad9.pdf
Alagarsamy, S., & Mehrolia, S. (2023). Exploring chatbot trust: Antecedents and behavioural outcomes. Heliyon, 9(5), e16074. https://doi.org/10.1016/j.heliyon.2023.e16074
Alban, G. P. G., Arguello, A. E. V., & Molina, N. E. C. (2020). Educational research methodologies (descriptive, experimental, participatory, and action research). Recimundo, 4(3), 163–173. https://doi.org/10.6018/eglobal.441711
Alhuay-Quispe, J., & Bautista-Ynofuente, L. (2021). Altimetric impact and type of access in Peruvian social science articles. Library Research, 35(89), 91–110. https://doi.org/10.22201/iibi.24488321xe.2021.89.58369
Almahri, F. A. J., Bell, D., & Merhi, M. (2020, March). Understanding student acceptance and use of chatbots in the United Kingdom universities: a structural equation modelling approach. In 2020 6th International Conference on Information Management (ICIM), pp.27-29 (March), UK. https://doi.org/10.1109/ICIM49319.2020.244712
Artavia-Díaz, K. Y., & Castro-Granados, A. (2021). Artificial intelligence: digital transformation and innovation in distance education. Analysis of the UNED, Costa Rica. Electronic Journal Training and Educational Quality (REFCalE), 9(3), 1–15. https://observatorioturisticobahia.uleam.edu.ec/index.php/refcale/article/view/3483
Auqui, J. A. O. (2021). Chatbot of the university learning process: A systematic review. Scientific and Technological Research Journal, 2(2), 1–16. https://doi.org/10.47422/ac.v2i2.22
Baabdullah, A. M., Alalwan, A. A., Algharabat, R. S., Metri, B., & Rana, N. P. (2022). Virtual agents and flow experience: An empirical examination of AI-powered chatbots. Technological Forecasting and Social Change, 181, 1–15. https://doi.org/10.1016/j.techfore.2022.121772
Balakrishnan, J., Abed, S. S., & Jones, P. (2022). The role of meta-UTAUT factors, perceived anthropomorphism, perceived intelligence, and social self-efficacy in chatbot-based services? Technological Forecasting and Social Change, 180, 1–12. https://doi.org/10.1016/j.techfore.2022.121692
Benke, I., Gnewuch, U., & Maedche, A. (2022). Understanding the impact of control levels over emotion-aware chatbots. Computers in Human Behavior, 129, 1–14. https://doi.org/10.1016/j.chb.2021.107122
Brustenga, G. G., Alpiste, M. F., & Castells, N. M. (2018). Briefing paper: Chatbots in education. Open University of Catalonia (UOC), 1(1), 1–33. https://openaccess.uoc.edu/bitstream/10609/80185/6/BRIEFING_PAPER_CHATBOTS_EN.pdf
Bueno, D. V. (2022). Creation of a chatbot in the educational domain. BS. Thesis, Department of Computer Languages and Systems, University of Alicante, Spain. http://hdl.handle.net/10045/124543
Casate-Fernández, R., & Senso-Ruiz, J. A. (2017). Cuban open access scientific production in Scopus in the period 2010-2014. Cuban Journal of Information on Health Sciences, 28(1), 2–25.
Castillo, C. C. A. (2020). Artificial intelligence in education: use of the chatbot in an undergraduate course on Academic Research at a private university in Lima. MSc. Thesis, Graduate School, Pontifical Catholic University of Perú, Perú. http://hdl.handle.net/20.500.12404/20996
Chang, C. Y., Hwang, G. J., & Gau, M. L. (2022). Promoting students' learning achievement and self?efficacy: A mobile chatbot approach for nursing training. British Journal of Educational Technology, 53(1), 171-188. https://doi.org/10.1111/bjet.13158
Chen, Q., Gong, Y., Lu, Y., & Tang, J. (2022). Classifying and measuring the service quality of AI chatbot in frontline service. Journal of Business Research, 145, 1–17. https://doi.org/10.1016/j.jbusres.2022.02.088
Cheng, X., Zhang, X., Yang, B., & Fu, Y. (2022). An investigation on trust in AI-enabled collaboration: Application of AI-Driven chatbot in accommodation-based sharing economy. Electronic Commerce Research and Applications, 54, 1–12. https://doi.org/10.1016/j.elerap.2022.101164
Colace, F., De Santo, M., Lombardi, M., Pascale, F., Pietrosanto, A., & Lemma, S. (2018). Chatbot for e-learning: A case of study. International Journal of Mechanical Engineering and Robotics Research, 7(5), 528-533. https://doi.org/10.18178/ijmerr.7.5.528-533
Cotrina-Aliaga, J. C., Vera-Flores, M. Á., Ortiz-Cotrina, W. C., & Sosa-Celi, P. (2021). Use of Artificial Intelligence (AI) as a strategy in higher education. Ibero-American Journal of Education, Especial 1, 1–11. https://doi.org/10.31876/ie.vi.81
Dekker, I., De Jong, E. M., Schippers, M. C., De Bruijn-Smolders, M., Alexiou, A., & Giesbers, B. (2020). Optimizing students’ mental health and academic performance: AI-enhanced life crafting. Frontiers in Psychology, 11, 1-15. https://doi.org/10.3389/fpsyg.2020.01063
Deng, X., & Yu, Z. (2023). A Meta-Analysis and Systematic Review of the Effect of Chatbot Technology Use in Sustainable Education. Sustainability (Switzerland), 15(4), 1–19. https://doi.org/10.3390/su15042940
Dibitonto, M., Leszczynska, K., Tazzi, F., & Medaglia, C. M. (2018). Chatbot in a Campus Environment: Design of LiSA, a Virtual Assistant to Help Students in Their University Life.. In M. Kurosu (Ed.), Human-Computer Interaction Technologies, pp. 103–116. Springer.
Dippold, D. (2023). “Can I have the scan on Tuesday?” User repair in interaction with a task-oriented chatbot and the question of communication skills for AI. Journal of Pragmatics, 204, 21–32. https://doi.org/10.1016/j.pragma.2022.12.004
Dokukina, I., & Gumanova, J. (2020). The rise of chatbots-new personal assistants in foreign language learning. Procedia Computer Science, 169, 542–546. https://doi.org/10.1016/j.procs.2020.02.212
Drouin, M., Sprecher, S., Nicola, R., & Perkins, T. (2022). Is chatting with a sophisticated chatbot as good as chatting online or FTF with a stranger? Computers in Human Behavior, 128, 1–10. https://doi.org/10.1016/j.chb.2021.107100
Fan, H., Han, B., & Gao, W. (2022). (Im)Balanced customer-oriented behaviors and AI chatbots’ Efficiency–Flexibility performance: The moderating role of customers’ rational choices. Journal of Retailing and Consumer Services, 66, 1–11. https://doi.org/10.1016/j.jretconser.2022.102937
Flores-Vivar, J. M., & García-Peñalvo, F. J. (2023). The algorithmic life of education: artificial intelligence tools and systems for online learning. In G. Bonales Daimiel & J. Sierra Sánchez (Eds.). Challenges and Challenges of Social Networks in the Communication Ecosystem, 1, pp. 109–120. McGraw Hill. http://repositorio.grial.eu/handle/grial/2871
Fulmer, R., Joerin, A., Gentile, B., Lakerink, L., & Rauws, M. (2018). Using psychological artificial intelligence (tess) to relieve symptoms of depression and anxiety: Randomized controlled trial. JMIR Mental Health, 5(4), 1–15. https://doi.org/10.2196/mental.9782
Gabrielli, S., Rizzi, S., Bassi, G., Carbone, S., Maimone, R., Marchesoni, M., & Forti, S. (2021). Engagement and effectiveness of a healthy-coping intervention via chatbot for university students during the COVID-19 pandemic: mixed methods proof-of-concept study. JMIR mHealth and uHealth, 9(5), e27965. https://doi.org/10.2196/27965
Galarza, C. A. R. (2020). The scope of an investigation. ScienceAmerica, 9(3), 1–6. http://dx.doi.org/10.33210/ca.v9i3.336
Garcés-Giraldo, L. F., Benjumea-Arias, M., Cardona-Acevedo, S., Bermeo-Giraldo, C., Valencia-Arias, A., Patiño-Vanegas, C., Moreno-López, G., & Bao, R. G. (2022). Use of artificial intelligence in information management: a bibliometric review. Iberian Journal of Information Systems and Technologies, E54, 506–518. https://www.proquest.com/openview/cd91b567d2231af1ab3b1838a62b3948/1?pq-origsite=gscholar&cbl=1006393
Ghose, S., & Barua, J. J. (2013, May). Toward the implementation of a topic specific dialogue based natural language chatbot as an undergraduate advisor. In 2013 International Conference on Informatics, Electronics and Vision (ICIEV), Dhaka, Bangladesh, 2013, pp. 1-5. https://doi.org/10.1109/ICIEV.2013.6572650
Go, E., & Sundar, S. S. (2019). Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions. Computers in Human Behavior, 97, 304–316. https://doi.org/10.1016/j.chb.2019.01.020
Hsu, C. L., & Lin, J. C. C. (2023). Understanding the user satisfaction and loyalty of customer service chatbots. Journal of Retailing and Consumer Services, 71, 1–10. https://doi.org/10.1016/j.jretconser.2022.103211
Huang, S. Y. B., & Lee, C. J. (2022). Predicting continuance intention to fintech chatbot. Computers in Human Behavior, 129, 1–8. https://doi.org/10.1016/j.chb.2021.107027
Huang, W., Hew, K. F., & Gonda, D. E. (2019). Designing and evaluating three chatbot-enhanced activities for a flipped graduate course. International Journal of Mechanical Engineering and Robotics Research, 8, 813-818. http://dx.doi.org/10.18178/ijmerr.8.5.813-818
Iku-Silan, A., Hwang, G. J., & Chen, C. H. (2023). Decision-guided chatbots and cognitive styles in interdisciplinary learning. Computers and Education, 201, 1–22. https://doi.org/10.1016/j.compedu.2023.104812
Izhar, N. A., Ishak, N. A., & Baharudín, S. M. (2023). Bibliometric Analysis of 21st Century Learning Using Scopus Database. International Journal of Learning, Teaching and Educational Research, 22(3), 225–240. https://doi.org/10.26803/ijlter.22.3.14
Jiménez, J. V., Gomez, E. E. B., & Álvarez, P. J. R. (2023). ChatGPT and artificial intelligence: Obstacle or advantage to higher medical education?. Higher Medical Education, 37(2), 1–5. https://ems.sld.cu/index.php/ems/article/view/3851
Lee, D., & Yeo, S. (2022). Developing an AI-based chatbot for practicing responsive teaching in mathematics. Computers and Education, 191, 1–17. https://doi.org/10.1016/j.compedu.2022.104646
Lee, L. K., Fung, Y. C., Pun, Y. W., Wong, K. K., Yu, M. T. Y., & Wu, N. I. (2020, August). Using a multiplatform chatbot as an online tutor in a university course. In 2020 international symposium on educational technology (ISET), 24-27(August), Thailand. https://doi.org/10.1109/ISET49818.2020.00021
León-Granizo, O., & León-Granizo, M. (2020). Development of a virtual assistant (chatbot) to improve access to recur- ring information by students of Higher Education Institutions. Ecuadorian Science Journal, 4(2), 111–116. https://doi.org/10.46480/esj.4.2.49
Liu, H., Peng, H., Song, X., Xu, C., & Zhang, M. (2022). Using AI chatbots to provide self-help depression interventions for university students: A randomized trial of effectiveness. Internet Interventions, 27, 1–8. https://doi.org/10.1016/j.invent.2022.100495
Liu, Y., Hu, B., Yan, W., & Lin, Z. (2023). Can chatbots satisfy me? A mixed-method comparative study of satisfaction with task-oriented chatbots in mainland China and Hong Kong. Computers in Human Behavior, 143, 1–14. https://doi.org/10.1016/j.chb.2023.107716
Llugcha, N. F. J. (2023). The chatbot in the academic tutoring of mathematics in the students of higher basic general education of the private educational unit “RICARDO DESCALZI” of the Ambato Canton. B.S., Faculty of Human Sciences and Education, Technical University of Ambato, Ecuador. https://repositorio.uta.edu.ec/jspui/handle/123456789/12640
Manzano, J. L. Z., Rodríguez, S. A. B., González, T. O., & Paciente, M. M. (2020). Artificial intelligence applied to the process of teaching learning in law: Teachbot and adaptive learning. Teachbot and Adaptive Learning, 1(1), 360–362. https://accedacris.ulpgc.es/bitstream/10553/121245/1/Inteligencia_artificial_aplicada.pdf
Martín-Ramallal, P., Merchán-Murillo, A., & Ruiz-Mondaza, M. (2022). Virtual trainers with artificial intelligence: levels of acceptance among university students. Educar, 58(2), 427–442. https://doi.org/10.5565/rev/educar.1482
Mckie, I. A. S., & Narayan, B. (2019). Enhancing the academic library experience with chatbots: An exploration of research and implications for practice. Journal of the Australian Library and Information Association, 68(3), 268-277. https://doi.org/10.1080/24750158.2019.1611694
Miguel, Y. C. B., Porras, J. G. V., & Toledo, H. L. H. (2022). Virtual education and the program I learn at home, in unequal conditions, use of the chatbot for WhatsApp. Ciencia Latina Multidisciplinary Scientific Journal, 6(1), 4774–4795. https://doi.org/10.37811/cl_rcm.v6i1.1831
Nguyen, Q. N., Sidorova, A., & Torres, R. (2022). User interactions with chatbot interfaces vs. Menu-based interfaces: An empirical study. Computers in Human Behavior, 128, 1–13. https://doi.org/10.1016/j.chb.2021.107093
Ocaña-Fernández, Y., Valenzuela-Fernández, L. A., & Garro-Aburto, L. L. (2019). Artificial intelligence and its implications in higher education. Purposes and Representations, 7(2), 536–552. https://doi.org/10.20511/pyr2019.v7n2.274
Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 1–10. https://doi.org/10.1016/j.caeai.2021.100033
Padilla, R. D. M. (2019). The arrival of artificial intelligence to education. Information Technology Research Journal, 7(14), 260–270. https://doi.org/10.36825/riti.07.14.022
Patel, N. P., Parikh, D. R., Patel, D. A., & Patel, R. R. (2019, June). AI and web-based human-like interactive university chatbot (UNIBOT). In 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, 2019, pp. 148-150 https://doi.org/10.1109/ICECA.2019.8822176
Pedraza-Navarro, I., & Sánchez-Serrano, S. (2022). Analysis of publications in WoS and Scopus Search possibilities to avoid fugitive literature in systematic revisions. Interuniversity Journal of Research in Educational Technology, 13, 41–61. https://doi.org/10.6018/riite.548361
Quezada, M. E., Valero, C. Z. V., & Quiroz, C. N. (2020). Bibliometric and content analysis of the scientific production of psychology related to the study of entrepreneurship: towards a new conceptual proposal. Journal of Psychology and Behavioral Sciences of the Legal and Social Sciences Academic Unit, 11(2), 169–195. https://doi.org/10.29059/rpcc.20201215-123
Ralston, K., Chen, Y., Isah, H., & Zulkernine, F. (2019, December). A voice interactive multilingual student support system using IBM Watson. In 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), Boca Raton, FL, USA, 2019, pp. 1924-1929. https://doi.org/10.1109/ICMLA.2019.00309
Ranoliya, B. R., Raghuwanshi, N., & Singh, S. (2017). Chatbot for university related FAQs. 2017 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2017, 04(January), pp. 1525–1530. https://doi.org/10.1109/ICACCI.2017.8126057
Rhim, J., Kwak, M., Gong, Y., & Gweon, G. (2022). Application of humanization to survey chatbots: Change in chatbot perception, interaction experience, and survey data quality. Computers in Human Behavior, 126, 1-12. https://doi.org/10.1016/j.chb.2021.107034
Rodríguez, J. A., Santana, M. G., Perera, V. A., & Pulido, J. R. (2021). Embodied conversational agents: artificial intelligence for autonomous learning. Pixel-Bit, 62, 107–144. https://doi.org/10.12795/pixelbit.86171
Rojas, J. A. H., Noa, L. L. T., & Flores, W. A. M. (2022). Epistemology of quantitative and qualitative research. Science Horizon, 12(33), 27–47. https://doi.org/10.26490/uncp.horizonteciencia.2022.23.1462
Ronda-Pupo, G. A. (2021). Scientific production and impact of the Latin American and Caribbean science system in journals of the region. Library Research, 35(88), 45–62. https://doi.org/10.22201/iibi.24488321xe.2021.88.58358
Sáiz-Manzanares, M. C., Marticorena-Sánchez, R., Martín-Antón, L. J., González Díez, I., & Almeida, L. (2023). Perceived satisfaction of university students with the use of chatbots as a tool for self-regulated learning. Heliyon, 9(1). https://doi.org/10.1016/j.heliyon.2023.e12843
Santoso, H. A., Winarsih, N. A. S., Mulyanto, E., Sukmana, S. E., Rustad, S., Rohman, M. S., ... & Firdausillah, F. (2018, September). Dinus Intelligent Assistance (DINA) chatbot for university admission services. In 2018 International Seminar on Application for Technology of Information and Communication, 21-22(September), Indonesia. https://doi.org/10.1109/ISEMANTIC.2018.8549797
Sastoque, J. A., García-Arango, D. A., Restrepo-Garizabal, S., Vasco-Ospina, A. M., & Arboleda-Posada, G. (2022). Emotions in virtual learning: Systematic review from prism guidelines. Iberian Journal of Information Systems and Technologies, E54, 451–467. https://www.proquest.com/openview/44087bc30783c670c2c389fb2c90d5dd/1?pq-origsite=gscholar&cbl=1006393
Singh, J., Joseph, M. H., & Jabbar, K. B. A. (2019). Rule-based chabot for student enquiries. Journal of Physics: Conference Series, 1228(1), 1–5. https://doi.org/10.1088/1742-6596/1228/1/012060
Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the Facebook Messenger. Computers and Education, 151, 1–11. https://doi.org/10.1016/j.compedu.2020.103862
Song, M., Du, J., Xing, X., & Mou, J. (2022). Should the chatbot “save itself” or “be helped by others”?. The influence of service recovery types on consumer perceptions of recovery satisfaction. Electronic Commerce Research and Applications, 55, 1–17. https://doi.org/10.1016/j.elerap.2022.101199
Suárez, E. M. del V., Martínez-Pinilla, E., Álvarez, E. G.-, Díaz, M. G., & Incio, A. M. N. (2022). Creation of a chatbot to answer frequently asked questions about the running of a subject. Advances and Challenges for Educational Transformation, 1(1), 226–231. https://dialnet.unirioja.es/servlet/articulo?codigo=8582769
Torres, M. T. M., Álvarez, L. M. S., & Osorio, A. S. O. (2022). Initial study of a chatbot for virtual modality students from the inter-American school of librarianship. Library Research, 36(90), 13–30. https://doi.org/10.22201/iibi.24488321xe.2022.90.58452
Tosar, J. P. (2022). The cost of article processing charges (APC) for Uruguay: the price of open access is high. Informatio, 27(1), 221–252. https://doi.org/10.35643/info.27.1.1
Leyva V. M., Escobar J. R., Espín R. C., & Pérez T. K. (2018). Facebook as a tool for collaborative learning of artificial intelligence. Didasc@ Lia: Didactics and Education, 9(1), 27–36. https://revistas.ult.edu.cu/index.php/didascalia/article/view/728
Vázquez-Cano, E., Mengual-Andrés, S., & López-Meneses, E. (2021). Chatbot to improve learning punctuation in Spanish and to enhance open and flexible learning environments. International Journal of Educational Technology in Higher Education, 18(1), 1-20. https://doi.org/10.1186/s41239-021-00269-8
Vera, F. (2023). Integration of artificial intelligence in higher education: Challenges and opportunities. Transform, 4(1), 17–34. https://www.revistatransformar.cl/index.php/transformar/article/view/84
Villarroel, J. J. G. (2021). Implication of artificial intelligence in virtual classrooms for higher education. Orbis Tertius-UPAL, 5(10), 31–52. https://www.biblioteca.upal.edu.bo/htdocs/ojs/index.php/orbis/article/view/98
Villegas-Ch, W., Arias-Navarrete, A., & Palacios-Pacheco, X. (2020). Proposal of an Architecture for the Integration of a Chatbot with Artificial Intelligence in a Smart Campus for the Improvement of Learning. Sustainability (Switzerland), 12(4), 1-20. https://doi.org/10.3390/su12041500
Wang, C., Li, Y., Fu, W., & Jin, J. (2023). Whether to trust chatbots: Applying the event-related approach to understand consumers’ emotional experiences in interactions with chatbots in e-commerce. Journal of Retailing and Consumer Services, 73, 1–11. https://doi.org/10.1016/j.jretconser.2023.103325
Xing, X., Song, M., Duan, Y., & Mou, J. (2022). Effects of different service failure types and recovery strategies on the consumer response mechanism of chatbots. Technology in Society, 70, 1–12. https://doi.org/10.1016/j.techsoc.2022.102049
Yang, T. C., & Chen, J. H. (2023). Pre-service teachers’ perceptions and intentions regarding the use of chatbots through statistical and lag sequential analysis. Computers and Education: Artificial Intelligence, 4, 1–10. https://doi.org/10.1016/j.caeai.2022.100119
Zhou, Q., Li, B., Han, L., & Jou, M. (2023). Talking to a bot or a wall?. How chatbots vs. human agents affect anticipated communication quality. Computers in Human Behavior, 143, 1–11. https://doi.org/10.1016/j.chb.2023.107674
Refbacks
- There are currently no refbacks.
e-ISSN: 1694-2116
p-ISSN: 1694-2493