Examining the Effectiveness of ChatGPT as a Conversational Partner for Indonesian EFL Learners
Keywords:
ChatGPT, EFL Learners, Conversational AIAbstract
Purpose: This study evaluates the efficiency of ChatGPT as a conversational partner in enhancing English proficiency among Indonesian learners within the English as a Foreign Language (EFL) context. It examines ChatGPT’s potential as both a learning tool and a scalable alternative for institutions with limited instructional resources.
Subjects and Methods: A quantitative pre-experimental design was adopted, employing a one-group pretest–posttest method with 40 intermediate-level university students. Over a period of four weeks, participants engaged in structured conversations with ChatGPT. Speaking performance was videotaped and assessed using a standard rubric measuring fluency, vocabulary, and grammatical accuracy. In addition, learner perceptions were gathered through a structured questionnaire.
Results: Findings revealed statistically significant improvements across all assessed components, with the greatest gains in fluency and vocabulary. Questionnaire data indicated high levels of satisfaction, motivation, and perceived benefit, with a positive correlation between learner satisfaction and performance growth. These results suggest that ChatGPT enhances communicative competence while also increasing learner engagement.
Conclusions: ChatGPT demonstrates strong potential as an instructional aid in EFL learning and as a cost-effective solution for large programs. Effective integration, however, requires careful planning, ethical oversight, and teacher preparedness to ensure sustainable adoption.
Downloads
References
Abu-Taieh, E. M., Alhadid, I., Abu-Tayeh, S., Masa’deh, R. E., Alkhawaldeh, R. S., Khwaldeh, S., & Alrowwad, A. A. (2022). Continued intention to use of M-Banking in Jordan by integrating UTAUT, TPB, TAM and service quality with ML. Journal of Open Innovation: Technology, Market, and Complexity, 8(3), 120. https://doi.org/10.3390/joitmc8030120
AlShareef, S. N. A. (2024). Applying the Communicative Approach in Assessing EFL Young Learners. Eurasian Journal of Applied Linguistics, 10(1), 14-27.
Bekou, A., Mhamed, M. B., & Assissou, K. (2024). Exploring opportunities and challenges of using ChatGPT in English language teaching (ELT) in Morocco. Focus on ELT Journal, 6(1), 87-106. https://doi.org/10.14744/felt.6.1.7
Camilleri, M. A. (2024). Metaverse applications in education: a systematic review and a cost-benefit analysis. Interactive Technology and Smart Education, 21(2), 245-269. https://doi.org/10.1108/ITSE-01-2023-0017
Dewan, M. S., & Sharma, B. D. (2025). Enhancing Oral Communication in English as a Second Language. Journal of Tikapur Multiple Campus, 8, 18-41. https://doi.org/10.3126/jotmc.v8i8.75949
Du, Q. (2025). How artificially intelligent conversational agents influence EFL learners' self-regulated learning and retention. Education and Information Technologies, 1-67. https://doi.org/10.1007/s10639-025-13602-9
Gayatri, P., Sit, H., Chen, S., & Li, H. (2023). Sustainable EFL blended education in Indonesia: Practical recommendations. Sustainability, 15(3), 2254. https://doi.org/10.3390/su15032254
Giannakos, M. N., Mikalef, P., & Pappas, I. O. (2022). Systematic literature review of e-learning capabilities to enhance organizational learning. Information Systems Frontiers, 24(2), 619-635. https://doi.org/10.1007/s10796-020-10097-2
Haugeland, I. K. F., Følstad, A., Taylor, C., & Bjørkli, C. A. (2022). Understanding the user experience of customer service chatbots: An experimental study of chatbot interaction design. International Journal of Human-Computer Studies, 161, 102788. https://doi.org/10.1016/j.ijhcs.2022.102788
Hsu, M. H., Chen, P. S., & Yu, C. S. (2023). Proposing a task-oriented chatbot system for EFL learners speaking practice. Interactive Learning Environments, 31(7), 4297-4308. https://doi.org/10.1080/10494820.2021.1960864
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot‐supported language learning. Journal of computer assisted learning, 38(1), 237-257. https://doi.org/10.1111/jcal.12610
Li, Y. (2024). Usability of ChatGPT in Second Language Acquisition: Capabilities, Effectiveness, Applications, Challenges, and Solutions. Studies in Applied Linguistics & TESOL, 24(1), 24-37.
Madhakomala, R., Hakim, M. A., & Syifauzzuhrah, N. (2022). Problems of education in Indonesia and alternative solutions. International Journal of Business, Law, and Education, 3(2), 135-144. https://doi.org/10.56442/ijble.v3i3.64
Makhachashvili, R., & Semenist, I. V. (2022). Dynamic assessment of e-learning in foreign languages programs in sustainable and emergency digitization formats. Education, REsearch and Innovation, 15, 4589-4594.
Maki, P. L. (2023). Assessing for learning: Building a sustainable commitment across the institution. Routledge.
Morgado, E., Leonido, L., Pereira, A., & Gouveia, L. B. (2025). Technology-Mediated Education: impact of AI on the main distance learning modalities. https://doi.org/10.22521/edupij.2025.16.211
Negrila, A. M. C. (2023). The new revolution in language learning: The power of artificial intelligence and education 4.0. Bulletin of" Carol I" National Defence University (EN), 12(02), 16-27.
Prather, J., Denny, P., Leinonen, J., Becker, B. A., Albluwi, I., Craig, M., ... & Savelka, J. (2023). The robots are here: Navigating the generative ai revolution in computing education. In Proceedings of the 2023 working group reports on innovation and technology in computer science education (pp. 108-159). https://doi.org/10.1145/3623762.3633499
Praveena, T., & Anupama, K. (2025). Machine Learning Meets Language Learning: The Transformative Potential of Artificial Intelligence in English Language Instruction. Human Research in Rehabilitation, 15(1). https://doi.org/10.21554/hrr.042511
Salsabil, A. D., & Rakhmawati, L. A. (2025). From Silent Learners to Confident Speakers: The Effect of AI Voice Chat with ChatGPT on EFL Speaking Skills. Journal of English Education, 3(1), 38-50. https://doi.org/10.61994/jee.v3i1.1137
Taufik, M. (2024). English Language Proficiency and Career Opportunities:: Perceptions of Indonesian University Graduates. Language Value, 17(1), 85-107.
Vadivel, B., Shaban, A. A., Ahmed, Z. A., & Saravanan, B. (2023). Unlocking English proficiency: Assessing the influence of AI-powered language learning apps on young learners' language acquisition. International Journal of English Language, Education and Literature Studies, 5(2), 123-139. https://dx.doi.org/10.22161/ijeel
Werdiningsih, I., Marzuki, Indrawati, I., Rusdin, D., Ivone, F. M., Basthomi, Y., & Zulfahreza. (2024). Revolutionizing EFL writing: unveiling the strategic use of ChatGPT by Indonesian master’s students. Cogent Education, 11(1), 2399431. https://doi.org/10.1080/2331186X.2024.2399431
Yang, H., & Kyun, S. (2022). The current research trend of artificial intelligence in language learning: A systematic empirical literature review from an activity theory perspective. Australasian Journal of Educational Technology, 38(5), 180-210. https://doi.org/10.14742/ajet.7492
Yawan, H. (2024). Challenging Native Speakerism: TEFL in Indonesia Beyond Native Speaker Fallacy. JLE: Journal of Literate of English Education Study Program, 5(1), 62-72. https://doi.org/10.47435/jle.v5i1.2692
