Generative AI Chatbots - ChatGPT versus YouChat versus Chatsonic: Use Cases of Selected Areas of Applied English Language Studies
Abstract
This paper reports on the comparison of the accuracy and quality of the responses produced by the three artificial intelligence (AI) chatbots, ChatGPT, YouChat, and Chatsonic, based on the prompts (use cases) related to selected areas of applied English language studies (AELS). An exploratory research design was employed and we utilised purposive sampling. The three aforementioned AI chatbots were used to collect data sets. Of the three chatbots, YouChat was technically unstable and unreliable, and had some inconsistency in generating responses. The other two chatbots, ChatGPT and Chatsonic, consistently exhibited a tendency to plagiarise responses from internet information without acknowledging the sources. In certain cases, the three chatbots all generated almost similar responses for different and unrelated prompts. This made their responses look like run-of-the-mill responses that lacked credibility, accuracy, and quality. One chatbot (ChatGPT) could not recognise a scholar mentioned in one of the prompts, while the other one (Chatsonic) misrecognised this scholar, and ended up rambling parts of its response. Additionally, the three chatbots all mechanically and superficially generated phrases and ideas in their responses without detecting the related critical nuances in the original sources in which they were used. This made the knowledge communicated by those responses appearing too fluffy. In this paper the educational and knowledge implications of the generated responses for AELS were educed. Based on the shortcomings the three AI chatbots displayed, I concluded that these three chatbots are not yet credible and reliable generators of knowledge for the aspects of AELS discussed.
https://doi.org/10.26803/ijlter.22.5.1
Keywords
Full Text:
PDFReferences
Ackerman, S. (1992). Discovering the brain. National Academy Press.
Adesso, G. (2023). PT4: Towards the ultimate brain: Exploring scientific discovery with ChatGPT AI. Authorea. https://doi.org/10.22541/au.167052124.41804127/v2
Aleem, Z. (2023). No, ChatGPT isn’t willing to destroy humanity out of ‘wokeness’. https://www.msnbc.com/opinion/msnbc-opinion/chatgpt-slur-conservatives-woke-elon-rcna69724
Alvi, M. (2016). A manual for selecting sampling techniques in research. https://mpra.ub.uni-muenchen.de/70218/
Anders, B.A. (2023). Why ChatGPT is such a big deal for education. https://scalar.usc.edu/works/c2c-digital-magazine-fall-2022---winter-2023/why-chatgpt-is-bigdeal-education
Atallah, H.E., Frank, M.J. & O’Reilly, R.C. (2004). Hippocampus, cortex, and basal ganglia: Insights from computational models of complementary learning systems. Neurobiology of Learning and Memory, 82, 253-267.
Bowman, E. (2023). A college student created an app that can tell whether AI wrote an essay. https://www.npr.org/2023/01/09/1147549845/gptzero-ai-chatgpt-edward-tian-plagiarism
Browne, R. (2023). All you need to know about ChatGPT, the A.I. chatbot that’s got the world talking and tech giants clashing. https://www.cnbc.com/2023/02/08/what-is-chatgpt-viral-ai-chatbot-at-heart-of-microsoft-google-fight.html
Canagarajah, S. (2022). A decolonial crip linguistics. Applied Linguistics, XX(XX), 1-22.
a. https://doi.org/10.1093/applin/amac042
Ceres, P. (2023). ChatGPT is coming for classrooms. Don't panic. https://www.wired.com/story/chatgpt-is-coming-for-classrooms-dont-panic/#intcid=_wired-bottom-recirc_9c0d2ac5-941b-45c7-b9ac-7ac221fc2e33_wired-content-attribution-evergreen
Chaka, C. (2020). Skills, competencies and literacies attributed to 4IR/Industry 4.0: Scoping review. IFLA Journal, 46(4), 369-399. https://doi.org/10.1177/0340035219896376
Chaka, C. (2021). Alan Davies: Ostensive views, other views and native speakerism, and the implications of the latter for English language teaching. Advances in Language and Literary Studies, 12(6), 79-86. http://dx.doi.org/10.7575/aiac.alls.v.12n.6.p.79
Chaka, C. (2022a). Digital marginalization, data marginalization, and algorithmic exclusions: A critical southern decolonial approach to datafication, algorithms, and digital citizenship from the Souths. Journal of e-Learning and Knowledge Society, 18(3), 83-95. https://doi.org/10.20368/1971-8829/1135678
Chaka, C. [Chaka Chaka]. (2022b, August 10). The geopolitics of knowledge production in applied English language studies: Transknowledging and a two-eyed critical southern decoloniality [Video]. YouTube. https://youtu.be/xb9seQEUR3M
Chaka, C. (2023a, May 30). Doing research in the age of AI-powered chatbots: English Studies’ M&D student support at UNISA [PowerPoint slides].
Chaka, C. (2023b). Stylised-facts view of fourth industrial revolution technologies impacting digital learning and workplace environments: ChatGPT and critical reflections. (Unpublished manuscript.)
Conroy, S. (2023). ChatGPT vs YouChat. https://www.wepcgpt.com/tips/chat-gpt-vs-youchat/
Coleman, T. (2023). Is ChatGPT a threat to English class? The Week. https://theweek.com/feature/opinion/1020101/is-chatgpt-a-threat-to-english-class
Cutcliffe, J. (2022). ChatGPT, chatbots and artificial intelligence in education. https://ditchthattextbook.com/ai/
Deacon, T.W. (1997). What makes the human brain different? Annual Review of Anthropology, 26, 337-357.
Dilmegani, C. (2023). ChatGPT education use cases, benefits & challenges in 2023. https://research.aimultiple.com/chatgpt-education/
Derico, B. & Kleinman, Z. (2023). OpenAI announces ChatGPT successor GPT-4. https://www.bbc.com/new/technology-64959346
Eliaç?k, E. (2023a). Google unveils its experimental conversational AI service Bard. https://dataconomy.com/2023/02/how-to-use-google-bard-ai-chatbot-examples/
Eliaç?k, E. (2023b). Best ChatGPT alternatives: What awaits us beyond ChatGPT? https://dataconomy.com/2023/02/beyond-chatgpt-alternatives-best-jasper/
Eliaç?k, E. (2023c). The role of large language models in the AI war. https://dataconomy.com/2023/02/best-large-language-models-meta-llama-ai/
Eliaç?k, E. (2023d). You.com’s AI-powered features are already in use, unlike Bing and Google. https://dataconomy.com/2023/02/you-com-ai-chatbot-ai-image-generator-how/#YouChat_A_rival_to_ChatGPT
Fraser, L. (2023). Banking and legal experts think ChatGPT could be a major disruptor. https://businesstech.co.za/news/business/661863/banking-and-legal-experts-think-chatgpt-could-be-a-major-disruptor/
Harris, M. (2022). ChatGPT: The game-changing app every teacher should know about. https://www.learnersedge.com/blog/chatgpt-the-game-changing-app-every-teacher-should-know-about
Hern, A. (2022). AI bot ChatGPT stuns academics with essay-writing skills and usability. https://www.theguardian.com/technology/2022/dec/04/ai-bot-chatgpt-stuns-academics-with-essay-writing-skills-and-usability.
Hetler, A. (2023). Bard vs. ChatGPT: What’s the difference? https://www.techtarget.com/whatis/feature/Bard-vs-ChatGPT-Whats-the-difference
Hughes, A. (2023). ChatGPT: Everything you need to know about OpenAI's GPT-3 tool. https://www.sciencefocus.com/future-technology/gpt-3/
Kamran, S. (2023). Microsoft Bing vs Google Bard: ChatGPT cloning battle has begun. https://techcommunity.microsoft.com/t5/itops-talk/microsoft-bing-vs-google-bard-chatgpt-cloning-battle-has-begun/m-p/3737979
Knight, W. (2023). Meet Bard, Google’s answer to ChatGPT. https://www.wired.com/story/meet-bard-googles-answer-to-chatgpt/
Kumar, H.S.A. (2023). ChatGPT: How artificial intelligence is changing the way we communicate. https://skill-lync.com/blogs/chatgpt-how-artificial-intelligence-is-changing-the-way-we-communicate
Leavy, P. (2017). Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. The Guilford Press. https://doi.org/10.1111/fcsr.12276
Li, W. (2018a). Translanguaging as a practical theory of language. Applied Linguistics, 39(1), 9-30. https://doi.org/10.1093/applin/amx039
Li, W. (2018b). Translanguaging and code-switching: What’s the difference? https://blog.oup.com/2018/05/translanguaging-code-switching-difference/
Makoni, S. & Severo, C. (2022). Southern perspectives of language and the construction of the common. Language & Communication, 86, 80-86. https://doi.org/10.1016/j.langcom.2022.06.003
Meghmala. (2023). GPTZero: An app to detect whether text is written by ChatGPT. https://www.analyticsinsight.net/gptzero-an-app-to-detect-whether-text-is-written-by-chatgpt/#:~:text=Student%2Dmade%20app%20GPTZero%20-determines,for%20unethical%20usage%20in%20academia.
Metz, K. (2022). Experts warn about the danger of chatbots using ChatGPT and LaMDA to create ‘hallucinations’ without considering what is right. The New York Times. https://www.nytimes.com/2022/12/10/technology/ai-chat-bot-chatgpt.html
Mora, R. A., Tian, Z. & Harman, R. (2022). Translanguaging and multimodality as flow, agency, and a new sense of advocacy in and from the Global South. Pedagogies: An International Journal, 17(4), 271-281. https://doi.org/10.1080/1554480X.2022.2143089
Motha, S. (2020). Is an antiracist and decolonizing applied linguistics possible? Annual Review of Applied Linguistics, 40, 128-133. https://doi.org/10.1017/S0267190520000100
Nawrocki, R. A. (2011). Simulation, application, and resilience of an organic neuromorphic architecture, made with organic bistable devices and organic transistors. (Publication No. 891) [Master’s thesis, University of Denver]. https://core.ac.uk/reader/217241530
Ndlangamandla, S. C. & Chaka, C. (2022). Relocating English Studies and SoTL in the Global South: Towards decolonizing English and critiquing the coloniality of language. Journal of Contemporary Issues in Education, 17(2), 39-56. https://doi.org/10.20355/jcie29495
Nkhobo, T. & Chaka, C. (2021). Exploring instances of Deleuzian rhizomatic patterns in students’ writing and in online student interactions. International Journal of Learning, Teaching and Educational Research, 20(10), 1-22. https://doi.org/10.26803/ijlter.20.10.1
Nkhobo, T. & Chaka, C. (2023). Syntactic pattern density, connectives, text easability, and text readability indices in students’ written essays: A Coh-Metrix analysis. Research Papers in Language Teaching and Learning, 13(1), 121-136.
Ofgang, E. (2023). What is GPTZero? The ChatGPT detection tool explained by its creator. https://www.techlearning.com/news/what-is-gptzero-the-chatgpt-detection-tool-explained
OpenAI. (2022). Introducing ChatGPT. https://openai.com/blog/chatgpt#OpenAI
OpenAI. (2015-2023). OpenAI. https://openai.com/about
Ortiz, S. (2023). The best AI chatbots: ChatGPT and other interesting alternatives to try. https://www.zdnet.com/article/best-ai-chatbot/
Piller, I. (2021). Language social justice. In J. Stanlaw (Ed.). The International Encyclopedia of Linguistic Anthropology (pp.1-7). John Wiley & Sons.
Pittalwala, I. (2023). Is ChatGPT a threat to education? https://news.ucr.edu/articles/2023/01/24/chatgpt-threat-education
Randolph, L. J., Jr. & Johnson, S. M. (2017). Social justice in the language classroom: A call to action. Dimension, 99, 99-121.
Rosa, J. & Flores, N. (2021). Decolonization, language, and race in applied linguistics and social justice. Applied Linguistics, 42(6), 1162-1167. https://doi.org.10.1093/applin/amab062
SGA Knowledge Team. (2023). The new buzz in town: What is ChatGPT and why has it taken the world by storm? https://www.sganalytics.com/blog/what-is-chatgpt-how-to-use-it-its-limitations/
Sharma, S. (2023). Generative AI and large language models: The AI gold rush. https://www.idsa.in/system/files/issuebrief/ib-sanur-sharma-010323.pdf
Solé, E. (2023). Teachers sound off on ChatGPT, the new AI tool that can write students’ essays for them. https://www.today.com/parents/teens/chatgpt-ai-teachers-students-cheat-essays-rcna63352
Stiennon, N., Ouyang, L., Wu, J., Ziegler, M.D., Lowe, R., Voss, C. & Christiano, P. (2020). Learning to summarize from human feedback. https://proceedings.neurips.cc/paper/2020/file/1f89885d556929e98d3ef9b86448f951-Paper.pdf
Tech Desk (2023). GPTZero to help teachers deal with ChatGPT-generated student essays. https://indianexpress.com/article/technology/gptzero-app-helps-teachers-catch-chatgpt-8378062/
Tyrrell, J. (2023). ChatGPT screening: OpenAI text classifier versus GPTZero app. https://techhq.com/2023/02/chatgpt-screening-openai-text-classifier-versus-gptzero-app/
ul Haq, F. (2023). Bing, Bard, and ChatGPT: Why AI advances are great news for devs. https://www.educative.io/blog/bing-bard-chatgpt-ai-software-developers
Wiggers, K. (2023). Most sites claiming to catch AI-written text fail spectacularly. https://techcrunch.com/2023/02/16/most-sites-claiming-to-catch-ai-written-text-fail-spectacularly/
YouChat. (2023). Who are you. https://you.com/search?q=who+are+you&tbm=youchat&cfr=chat
Refbacks
- There are currently no refbacks.
e-ISSN: 1694-2116
p-ISSN: 1694-2493