Evaluation of the Impact of ChatGPT on the Development of Research Skills in Higher Education
Abstract
. In the context of higher education, many students struggle to develop strong research skills due to insufficient methodological training and limited academic support. Advances in artificial intelligence offer new opportunities to foster autonomous learning and improve academic writing. This study evaluates the impact of ChatGPT on the development of research skills among undergraduate nursing students in Trujillo, Peru, during the 2024 academic year. A quasi-experimental design was employed, involving 100 students divided into two groups of 50. Participants were selected through non-probabilistic convenience sampling, and group equivalence was verified through a pre-intervention diagnostic assessment. The experimental group completed a structured 15-session intervention focused on six dimensions: Problem Formulation; Information Analysis; Methodological Design; Data Analysis & Interpretation; Academic Writing; and Ethical Information Management. ChatGPT was integrated as a pedagogical support tool to facilitate idea generation, improve information retrieval, and assist with structuring academic texts. Quantitative data were collected through pretest and posttest evaluations and analyzed using Mann-Whitney U, Friedman, Bonferroni post hoc, ordinal regression, and principal component analysis. Results showed a statistically significant improvement in the experimental group (U = 95.4, p < .05), with notably increased numbers of students reaching the Very High level across all dimensions. The Bonferroni test highlighted differences among skills, and the ordinal regression model demonstrated strong predictive power (Nagelkerke R² = 0.924). These findings support the integration of ChatGPT into higher education as a strategic tool for enhancing research skills, especially in environments with limited access to traditional academic resources.
https://doi.org/10.26803/ijlter.24.4.18
Keywords
Full Text:
PDFReferences
Alnasib, B. N. M. (2023). Factors affecting faculty members’ readiness to integrate artificial intelligence into their teaching practices: A study from the Saudi higher education context. International Journal of Learning, Teaching and Educational Research, 22(8), 465–491. https://doi.org/10.26803/ijlter.22.8.24
Almulla, M., & Ali, S. I. (2024). The changing educational landscape for sustainable online experiences: Implications of ChatGPT in Arab students’ learning experience. International Journal of Learning, Teaching and Educational Research, 23(9), 285–306. https://doi.org/10.26803/ijlter.23.9.15
Anand, M. D. (2024). Research methodology: methods and techniques. SAN Publications. https://doi.org/10.59646/rmmt/171
Atchley, P., Pannell, H., Wofford, K., Hopkins, M., & Atchley, R. A. (2024). Human and AI collaboration in the higher education environment: Opportunities and concerns. Cognitive Research: Principles and Implications, 9(20). https://doi.org/10.1186/s41235-024-00547-9
Banihashem, S. K., Taghizadeh Kerman, N., Noroozi, O., Moon, J., & Drachsler, H. (2024). Feedback sources in essay writing: Peer-generated or AI-generated feedback? International Journal of Educational Technology in Higher Education, 21(23). https://doi.org/10.1186/s41239-024-00455-4
Bukar, U. A., Sayeed, M. S., Abdul Razak, S. F., Yogarayan, S., & Sneesl, R. (2024). Prioritizing ethical conundrums in the utilization of ChatGPT in education through an analytical hierarchical approach. Education Sciences, 14(9), 959. https://doi.org/10.3390/educsci14090959
Castagnola Rossini, G., Urbano Gutiérrez, L. P., & Pérez Azahuanche, M. A. (2025). La inteligencia artificial para desarrollar las habilidades investigativas en docentes universitarios [Artificial intelligence to develop research skills in university professors]. Horizontes. Revista de Investigación en Ciencias de la Educación, 9(37), 1009–1026. https://doi.org/10.33996/revistahorizontes.v9i37.965
Castillo, F. L. V., Paredes Reyna, A. C., Palacios Huaraca, C. R., Alvarado Bravo, N., Aldana Trejo, F. H., Corilla Condor, M. C., Suarez Bazalar, R., Aguirre Pérez, O. P., Torres Quiroz, A. G., & Pfuyo Muñoz, R. (2024). Contribution of artificial intelligence to the development of metaverses: A bibliometric review study on its impact on immersive learning in higher education. International Journal of Learning, Teaching and Educational Research, 23(12), 322–341. https://doi.org/10.26803/ijlter.23.12.17
Collantes Robles, E. M. (2024). Effect of gamification on the development of digital competencies of regular basic education teachers. International Journal of Learning, Teaching and Educational Research, 23(2), 100–118. https://doi.org/10.26803/ijlter.23.2.6
De Jesus, F. S., Ibarra, L. M., Pasion, B. J., Villanueva, W., & Leyesa, M. (2024). ChatGPT as an artificial intelligence learning tool for Business Administration students in Nueva Ecija, Philippines. International Journal of Learning, Teaching and Educational Research, 23(6), 348–372. https://doi.org/10.26803/ijlter.23.6.16
Duong, C. D. (2024). ChatGPT adoption and digital entrepreneurial intentions: An empirical research based on the theory of planned behaviour. Entrepreneurial Business and Economics Review, 12(2), 129–142. https://doi.org/10.15678/EBER.2024.120208
Essien, A., Bukoye, O. T., O'Dea, X., & Kremantzis, M. (2024). The influence of AI text generators on critical thinking skills in UK business schools. Studies in Higher Education, 49(5), 865–882. https://doi.org/10.1080/03075079.2024.2316881
Funda, V., & Mbangeleli, N. B. A. (2024). Artificial Intelligence (AI) as a tool to address academic challenges in South African higher education. International Journal of Learning, Teaching and Educational Research, 23(11), 1–15. http://dx.doi.org/10.26803/ijlter.23.11.27
Fütterer, F., Han, C., & Kumwenda, S. (2025). Higher education students’ perceptions of ChatGPT: A global study of early reactions. PLoS ONE, 20(5). https://doi.org/10.1371/journal.pone.0315011
George-Reyes, C. E., Vilhunen, E., Avello-Martínez, R., & López-Caudana, E. (2024). Developing scientific entrepreneurship and complex thinking skills: Creating narrative scripts using ChatGPT. Frontiers in Education, 9, 1378564. https://doi.org/10.3389/feduc.2024.1378564
Goh, P. S., & Sandars, J. (2024). Application of ChatGPT-assisted problem-based learning teaching method in clinical medical education. BMC Medical Education, 24(1), 1-10. https://doi.org/10.1186/s12909-024-04812-5
Gouia-Zarrad, R., & Gunn, C. (2024). Enhancing students’ learning experience in mathematics class through ChatGPT. International Electronic Journal of Mathematics Education, 19(3), em0781. https://doi.org/10.29333/iejme/14614
Grájeda, A., Córdova, P., Córdova, J. P., Laguna-Tapia, A., Burgos, J., Rodríguez, L., Arandia, M., & Sanjinés, A. (2024). Embracing artificial intelligence in the arts classroom: Understanding student perceptions and emotional reactions to AI tools. Cogent Education, 11(1), 2378271. https://doi.org/10.1080/2331186X.2024.2378271
Guo, Y., & Lee, D. (2023). Leveraging ChatGPT for enhancing critical thinking skills. Journal of Chemical Education, 100(11), 4876–4883. https://doi.org/10.1021/acs.jchemed.3c00505
Han, X., Wang, J., & Liu, Q. (2024). A qualitative analysis of Chinese higher education students’ intentions and influencing factors in using ChatGPT: A grounded theory approach. Scientific Reports, 14(1), 1-12. https://doi.org/10.1038/s41598-024-50748-3
Hidayat, D. N., Pratama, H., & Gunawan, H. (2024). Assessing text comprehension proficiency: Indonesian higher education students vs. ChatGPT. XLinguae, 17(1), 94–109. https://doi.org/10.18355/XL.2024.17.01.08
Iqbal, Z., & Rahman, S. (2024). Adoption and impact of ChatGPT in computer science education: A case study on a database administration course. AI Switzerland, 6(3), 215–231. https://doi.org/10.3390/aiswitzerland6030015
Johnston, H., Wells, R. F., Shanks, E. M., Boey, T., & Parsons, B. N. (2024). Student perspectives on the use of generative artificial intelligence technologies in higher education. International Journal for Educational Integrity, 20(1), 12-28. https://doi.org/10.1007/s40979-024-00045-8
Klimova, B., & Luz de Campos, V. P. (2024). University undergraduates’ perceptions on the use of ChatGPT for academic purposes: Evidence from a university in Czech Republic. Cogent Education, 11(1), 2373512. https://doi.org/10.1080/2331186X.2024.2373512
Luciano, R. G. (2024). The dual impact of ChatGPT on learning and ethics among Bachelor of Science in Information Technology (BSIT) students. International Journal of Learning, Teaching and Educational Research, 23(12), 78–95. https://doi.org/10.26803/ijlter.23.12.5
Liu, X., Chen, J., & Wang, Y. (2024). Artificial intelligence and the transformation of higher education institutions: A systems approach. Sustainability Switzerland, 16(5), 3456–3471. https://doi.org/10.3390/su16053456
Medina, W. A., Flores Velásquez, C. H., Olivares Zegarra, S. del R., Morales Romero, G. P., Quispe Andía, A., Aybar Bellido, I. E., Palacios Huaraca, C. R., Aldana Trejo, F. H., & Bravo, N. A. (2024). Using ChatGPT in university academic writing: A bibliometric review study on the implications for writing reports, papers, essays, and theses. International Journal of Learning, Teaching and Educational Research, 23(12), 360–381. https://doi.org/10.26803/ijlter.23.12.19
Murtiningsih, S., Sujito, A., & Soe, K. K. (2024). Challenges of using ChatGPT in education: A digital pedagogy analysis. International Journal of Evaluation and Research in Education, 13(5), 3466–3473. https://doi.org/10.11591/ijere.v13i5.29467
Mustopa, Nasikhin, Chamami, R., Nihayah, H., Habibullah, M. R., & Manshur, A. (2024). Challenges in artificial intelligence development in higher education in China, India, and Indonesia: International students' perspectives. International Journal of Learning, Teaching and Educational Research, 23(2), 354–373. https://doi.org/10.26803/ijlter.23.2.17
Nabavi, R., & Farajollahi, M. (2024). Challenges and opportunities of generative AI for higher education as explained by ChatGPT. Education Sciences, 14(2), 287–299. https://doi.org/10.3390/educsci14020287
Nazari, M., & Saadi, G. (2024). Developing effective prompts to improve communication with ChatGPT: A formula for higher education stakeholders. Discover Education, 3, 45. https://doi.org/10.1007/s44217-024-00122-w
OECD. (2024). Education at a glance 2020: OECD indicators. OECD Publishing. https://doi.org/10.1787/69096873-en
Palacios Huaraca, W. G., Sánchez Sernaqué, J. R., & Valencia Villar, A. (2024). Aplicación de la inteligencia artificial en la formación de competencias investigativas en estudiantes de educación superior [Application of artificial intelligence in the development of research competencies in higher education students]. Horizontes. Revista de Investigación en Ciencias de la Educación, 8(33), 876–889. https://doi.org/10.33996/revistahorizontes.v8i33.854
Polakova, P., & Ivenz, P. (2024). The impact of ChatGPT feedback on the development of EFL students’ writing skills. Cogent Education, 11(1), 2410101. https://doi.org/10.1080/2331186X.2024.2410101
Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., Sun, M., Day, I., & Rather, R. A. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning & Teaching, 6(1). https://doi.org/10.37074/jalt.2023.6.1.29
Roll, M., & Ifenthaler, D. (2021). Learning Factories 4.0 in technical vocational schools: can they foster competence development? Empirical Research in Vocational Education and Training. https://doi.org/10.1186/s40461-021-00124-0
Saleem, N., Mufti, T., Sohail, S. S., & Madsen, D. Ø. (2024). ChatGPT as an innovative heutagogical tool in medical education. Cogent Education, 11(1), 2332850. https://doi.org/10.1080/2331186X.2024.2332850
Smith, K., & Roberts, L. (2024). Assessing pedagogical strategies integrating ChatGPT in English language teaching: A structural equation modelling-based study. World Journal of English Language, 14(1), 44–59. https://doi.org/10.5430/wjel.v14n1p44
Tomanguilla Reyna, J., Ríos Gonzales, J. D., Villoslada Quevedo, C. V., & Cruzado Paredes, C. E. (2024). Efecto del uso de ChatGPT en el pensamiento creativo de estudiantes universitarios [Effect of ChatGPT use on the creative thinking of university students]. Revista Tribunal, 4(9), 193–207. https://doi.org/10.59659/revistatribunal.v4i9.73
Wang, B., Hu, S. J., Sun, L., & Freiheit, T. (2024). The impact of using ChatGPT on academic writing among medical undergraduates. Annals of Medicine, 56(3), 221–230. https://doi.org/10.1080/07853890.2024.2283921
Zhang, J., & Li, P. (2024). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61(2), 162–176. https://doi.org/10.1080/14703297.2024.2298473
Refbacks
- There are currently no refbacks.
e-ISSN: 1694-2116
p-ISSN: 1694-2493