AI Chatbot to Improve Students' Vocabulary Mastery
DOI:
https://doi.org/10.24256/ideas.v13i1.6855Keywords:
AI Chatbot, Artificial Intelligence, Vocabulary MasteryAbstract
Artificial Intelligence (AI) Chatbots are computer programs designed to simulate human conversation and offer interactive, personalized learning experiences. This quantitative study investigated the effectiveness of an AI Chatbot (implemented using the website platform https://www.aichatting.net) in improving students' vocabulary mastery at SMP Negeri 01 Dapurang Pasangkayu, Indonesia. The study employed a quasi-experimental design, comparing an experimental class (8B, n = 25) that utilized the AI Chatbot with a control class (8B, n = 25) that employed a conventional teaching method. The intervention was conducted over six sessions across three weeks, from April 26 to May 19, 2025. Students completed pre-tests and post-tests to assess vocabulary mastery. The experimental class mean score increased from 31.60 to 76.00 (gain = 44.40; Cohen’s d = 4.71), while the control class improved from 32.00 to 46.00 (gain = 14.00; Cohen’s d = 1.43). An independent samples t-test on post-test scores revealed a statistically significant difference between the classes, t (48) = 12.42, p < .0001, with a 95% confidence interval of \ [25.27, 34.73]. These results confirm that the AI chatbot had a substantial impact on vocabulary mastery in practice. While the study supports the potential of AI chatbots as effective vocabulary-learning tools in junior high school settings, it also acknowledges the limitations of the quasi-experimental design and recommends further research using randomized controlled trials.
References
Apriani, E., Cardoso, L., & Obaid, A. J. (2024). Impact of AI-Powered ChatBots on EFL Students ’ Writing Skills , Self-Efficacy , and Self-Regulation : A Mixed-Methods Study. 1(2), 57–72.
Batia Laufer, I. S. P. N. (2012). The Routledge Handbook of Second Language Acquisition (1st ed.). https://www.taylorfrancis.com/chapters/edit/10.4324/9780203808184-13/vocabulary-batia-laufer-nation
Bani, M., & Masruddin, M. (2021). Development of Android-based harmonic oscillation pocket book for senior high school students. JOTSE: Journal of Technology and Science Education, 11(1), 93-103.
Cohen, L., Manion, L., & Morrison, K. (2007). Book Reviews Research Methods in Education. The Austr Alian Educational Researcher, 2, 147–156.
Fu, G.-J. H. &Qing-K. (2019). Trends in the research design and application of mobile learning: a review of 2007-2016 publications in selected SSCI journals. Interactive Learning Environments, 27(4), 567–581. https://doi.org/10.1080/10494820.2018.1486861
Hawanti, S., & Zubaydulloevna, K. M. (2023). AI chatbot-based learning: alleviating students’ anxiety in english writing classroom. Bulletin of Social Informatics Theory and Application, 7(2), 182–192. https://doi.org/10.31763/businta.v7i2.659
Hutauruk, B. S., Purba, R., & Sihombing, S. (2017). THE EFFECTIVENESS OF ARTIFICIAL INTELLIGENCE BY CHATBOT IN ENHANCING THE STUDENTS ’ VOCABULARY. 6.
John Creswell et al. (2017). John W, Creswell, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. In Journal of Social and Administrative Sciences (Vol. 4, Issue June, pp. 3–5).
Kingdom, U., & Qammar, M. Z. (2024). Chatbots as Conversational Partners : Their Effectiveness in Facilitating Language Acquisition and Reducing Foreign Language Anxiety Journal of Applied Linguistics and TESOL ( JALT ) Chatbots as Conversational Partners : Their Effectiveness in Facilitatin. October.
Kukulska-Hulme, A., & Lee, H. (2020). Intelligent assistants in language learning: an analysis of features and limitations. CALL for Widening Participation: Short Papers from EUROCALL 2020, 2020(2020), 172–176. https://doi.org/10.14705/rpnet.2020.48.1184
Lee, Jang Ho and Yang, Hyejin and Shin, Dongkwang and Kim, H. (2020). Chatbots. ELT Journal, 74, 338–344. https://doi.org/10.1093/elt/ccaa035
Masruddin, Hartina, S., Arifin, M. A., & Langaji, A. (2024). Flipped learning: facilitating student engagement through repeated instruction and direct feedback. Cogent Education, 11(1), 2412500.
Olugbade, D., Edwards, B. I., & Ojo, O. A. (2024). Facilitating Cognitive Load Management and Improved Learning Outcomes and Attitudes in Middle School Technology and Vocational Education Through AI Chatbot. Journal of Technical Education and Training, 16(3), 114–131. https://doi.org/10.30880/jtet.2024.16.03.009
Pallant, J. (2011). This is what readers from around the world say about the SPSS Survival Manual: ‘Whenever. Routledge.
Rizal Bagus Syaifulloh, S. N. Y. (2025). AI CHATBOTS IN EFL: SYNTHESIZING COGNITIVE, PSYCHOLOGICAL, AND ETHICAL IMPLICATIONS. Urnal Inovasi Pendidikan Berbantuan Teknologi, 5 no. https://jurnalp4i.com/index.php/edutech
Santoso, S. (2014). SPSS 22 From Essensial to Ekpert Skills, Jakarta: PT. Elex Media Komputindo.
Waziana, W., Andewi, W., & Hastomo, T. (2024). Students ’ Perceptions of the Impact of AI Chatbots on Vocabulary and Grammar in EFL Writing. 17(02), 352–382. https://doi.org/10.18326/rgt.v17i2.352-382
Wijaya, S. M., El, M., Az, Q., & Prawita, F. N. (2025). MicroLingo : Chatbot WhatsApp Berbasis AI untuk Pelatihan Bahasa Inggris dengan Pendekatan Microlearning untuk Pelaku UMKM Generasi Z di Indonesia. 11(1), 72–76.
Downloads
Published
Issue
Section
Citation Check
License
Copyright (c) 2025 Irmawati, Dzakiah, Fatima
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under an Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See the Effect of Open Access)
