Replika AI Chatbot as a Tool for Enhancing ESP Business Vocabulary Acquisition: A Study on Polytechnic Students

Romadhon Romadhon

doi:10.35961/salee.v6i1.1671

Authors

Romadhon Romadhon Politeknik Piksi Input Serang

DOI:

https://doi.org/10.35961/salee.v6i1.1671

Keywords:

vocabulary learning, business English, Chatbot

Abstract

This study is investigating the efficacy of using a Chatbot to enhance vocabulary acquisition in ESP, particularly in Business English. A total of 44 undergraduate students from a Polytechnic University in Indonesia participated in an experimental design. Later, they were divided into two groups: an experimental group that was engaged in continuous interaction with the chatbot for 14 weeks and the control group, following traditional instruction. Data collection was done through pre-tests, post-tests, and interviews. The experimental group significantly exceeded the control group in the post-test scores, according to the results; hence, the Chatbot is useful to support students in vocabulary learning. Such a fact was again asserted in the interview results, which showed the Chatbot's practicality and simplicity of usage for the participants in working with ESP vocabulary. Although positive, it has its limitation of a small sample size and focused on vocabulary alone. These limitations themselves suggest the need for further research. The future directions of such studies need to look into the larger vista of chatbot usage relating to other language skills also and the potential of this tool across educational settings and disciplines.

References

Abbasi, S., & Kazi, H. (2014). Measuring effectiveness of learning chatbot systems on student’s learning outcome and memory retention. Asian Journal of Applied Science and Engineering, 3(7), 57. https://doi.org/10.15590/ajase/2014/v3i7/53576

Ali, M., Ranjhani, I., Shahbaz, Q., Rashid, M., & Shahzad, A. (2024). Significance of Mobile Assisted Language Learning (MALL) for English language learning in digital age: A review. Jahan-e-Tahqeeq, 7(3), 382–396. https://doi.org/10.61866/jt.v7i3.1660

Ali, Z. (2020). artificial intelligence (AI): A review of its uses in language teaching and learning. IOP Conference Series: Materials Science and Engineering, 769(1), 12043. https://doi.org/10.1088/1757-899X/769/1/012043

Alsadoon, R. (2021). Chatting with AI bot: Vocabulary learning assistant for Saudi EFL learners. English Language Teaching, 14(6), 135. https://doi.org/10.5539/elt.v14n6p135

Asmal?, M. (2018). Integrating technology into ESP classes: use of student response system in English for specific purposes instruction. Teaching English with Technology, 18(3), 86–104. https://files.eric.ed.gov/fulltext/EJ1186385.pdf

Belda-Medina, J., & Calvo-Ferrer, J. R. (2022). Using chatbots as AI conversational partners in language learning. Applied Sciences (Switzerland), 12(17), 8427. https://doi.org/10.3390/app12178427

Bie?kowska, I., Klimczok, A., Polok, K., & Modrzejewska, J. (2021). Use of mobile assisted language learning (MALL) in teaching vocabulary to ESP students. Educational Research Association The International Journal of Research in Teacher Education, 12(3), 81–95. http://www.eab.org.trhttp//ijrte.eab.org.tr

Borucinsky, M., & Jel?i? ?olakovac, J. (2020). Promoting authenticity in the ESP classroom: The impact of ICT and use of authentic materials on student motivation. 5th International E-Conference on Studies in Humanities and Social Sciences: Conference Proceedings. Belgrade: Center for Open Access in Science, 31–44. https://doi.org/10.32591/coas.e-conf.05.03031b

Bygstad, B., Øvrelid, E., Ludvigsen, S., & Dæhlen, M. (2022). From dual digitalization to digital learning space: Exploring the digital transformation of higher education. Computers and Education, 182, 104463. https://doi.org/10.1016/j.compedu.2022.104463

Çakmak, F., Namaziandost, E., & Kumar, T. (2021). CALL-Enhanced L2 Vocabulary Learning: Using Spaced Exposure through CALL to Enhance L2 Vocabulary Retention. Education Research International, 2021(1), 5848525. https://doi.org/10.1155/2021/5848525

Chaikovska, O., Semenyshyna, I., Muliarchuk, O., & Koval, I. (2022). Impact of Technology on Speaking and Writing Skills of Masters in Engineering Esp Learning. Engineering for Rural Development, 21, 878–883. https://doi.org/10.22616/ERDev.2022.21.TF274

Crittenden, W. F., Biel, I. K., & Lovely, W. A. (2019). Embracing Digitalization: Student Learning and New Technologies. Journal of Marketing Education, 41(1), 5–14. https://doi.org/10.1177/0273475318820895

Dashtestani, R. (2013). Implementing mobile-assisted language learning (MALL) in an EFL context: Iranian EFL teachers’ perspectives on challenges and affordances. The JALT CALL Journal, 9(2), 149–168. https://doi.org/10.29140/jaltcall.v9n2.j153

Dolzhich, E., Dmitrichenkova, S., & Ibrahim, M. K. (2021). Using M-Learning Technology in Teaching Foreign Languages: A Panacea during COVID-19 Pandemic Era. International Journal of Interactive Mobile Technologies, 15(15), 20–34. https://doi.org/10.3991/ijim.v15i15.22895

El-Said, M. A. (2023). Using AI Chatbot Doulingo-based activities to develop the Egyptian preparatory school students’ English oral skills. CDELT Occasional Papers in the Development of English Education, 84(1), 369–387. https://doi.org/10.21608/opde.2023.337481

Fryer, L. K., Nakao, K., & Thompson, A. (2019). Chatbot learning partners: Connecting learning experiences, interest and competence. Computers in Human Behavior, 93, 279–289. https://doi.org/10.1016/j.chb.2018.12.023

Galina Ple?ca. (2010). The role of needs analysis in esp curriculum design. The Role of Needs Analysis in ESP Curriculum Design, 1978, 174–179.

Gomathi, R., Maheswaran, S., Mythili, M., Nandita, S., Sathesh, S., Murugesan, G., & Duraisamy, P. (2023). The Exploitation of Artificial Intelligence in Developing English Language Learner’s Communication Skills. 2023 14th International Conference on Computing Communication and Networking Technologies, ICCCNT 2023, 6(1), 750–757. https://doi.org/10.1109/ICCCNT56998.2023.10307203

Hafner, C. A., & Miller, L. (2018). English in the Disciplines: A multidimensional model for ESP course design. Routledge. https://doi.org/10.4324/9780429452437

Haristiani, N., & Rifa’i, M. M. (2020). Combining chatbot and social media: Enhancing personal learning environment (PLE) in language learning. Indonesian Journal of Science and Technology, 5(3), 487–506. https://doi.org/10.17509/ijost.v5i3.2868

Haristiani, N., & Rifai, M. M. (2021). Chatbot-based application development and implementation as an autonomous language learning medium. Indonesian Journal of Science and Technology, 6(3), 561–576. https://doi.org/10.17509/ijost.v6i3.39150

Heilporn, G., Lakhal, S., & Bélisle, M. (2021). An examination of teachers’ strategies to foster student engagement in blended learning in higher education. International Journal of Educational Technology in Higher Education, 18(1), 25. https://doi.org/10.1186/s41239-021-00260-3

Herawati, A. F., Siregar, A., Yusrizal, Y., Rahma, A. A., Sari, A. L., & Irwandi, I. (2022). Utilization of E-Learning as Media in Indonesian Language Courses in Higher Education Post COVID-19 Pandemic. AL-ISHLAH: Jurnal Pendidikan, 13(3), 2757–2766. https://doi.org/10.35445/alishlah.v13i3.1455

Huang, J.-X., Lee, K.-S., Kwon, O.-W., & Kim, Y.-K. (2017). A chatbot for a dialogue-based second language learning system. CALL in a Climate of Change: Adapting to Turbulent Global Conditions – Short Papers from EUROCALL 2017, 151–156. https://doi.org/10.14705/rpnet.2017.eurocall2017.705

Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. https://doi.org/10.1111/jcal.12610

Jeon, J. (2023). Chatbot-assisted dynamic assessment (CA-DA) for L2 vocabulary learning and diagnosis. Computer Assisted Language Learning, 36(7), 1338–1364. https://doi.org/10.1080/09588221.2021.1987272

Jia, J., Chen, Y., Ding, Z., & Ruan, M. (2012). Effects of a vocabulary acquisition and assessment system on students’ performance in a blended learning class for English subject. Computers and Education, 58(1), 63–76. https://doi.org/10.1016/j.compedu.2011.08.002

Johnson, W. L., Vilhjalmsson, H., & Marsella, S. (2005). Serious Games for Language Learning: How Much Game, How Much AI? Frontiers in Artificial Intelligence and Applications, 125(1), 306–313.

Kakoulli Constantinou, E., & Papadima-Sophocleous, S. (2020). The use of digital technology in ESP: Current practices and suggestions for ESP teacher education. Journal of Teaching English for Specific and Academic Purposes, 8(1), 017. https://doi.org/10.22190/JTESAP2001017K

Kim, H., Yang, H., & Ho Lee, J. (2022). Design principles and architecture of a second language learning chatbot. Language Learning & Technology, 2022(1), 1–18. https://doi.org/10125/73463

Kohnke, L. (2023). A Pedagogical Chatbot: A Supplemental Language Learning Tool. RELC Journal, 54(3), 828–838. https://doi.org/10.1177/00336882211067054

Kova?evi?, D. (2023). Use of ChatGPT in ESP Teaching Process. 2023 22nd International Symposium INFOTEH-JAHORINA, INFOTEH 2023, 1–5. https://doi.org/10.1109/INFOTEH57020.2023.10094133

Kuzmina, N. N., Kochkina, D. V., & Kuzmin, M. G. (2022). Digital distance learning tools in academics’ ESP training. Bulletin of the South Ural State University Series “Education. Educational Sciences,” 14(2), 81–94. https://doi.org/10.14529/ped220208

Lin, C. C., Huang, A. Y. Q., & Yang, S. J. H. (2023). A Review of AI-Driven Conversational Chatbots Implementation Methodologies and Challenges (1999–2022). Sustainability (Switzerland), 15(5), 4012. https://doi.org/10.3390/su15054012

Mageira, K., Pittou, D., Papasalouros, A., Kotis, K., Zangogianni, P., & Daradoumis, A. (2022). Educational AI Chatbots for Content and Language Integrated Learning. Applied Sciences (Switzerland), 12(7), 3239. https://doi.org/10.3390/app12073239

Marculescu, C. (2015). Teaching Esp in the Digital Era: the Use of Technology in Project-Based Learning and Assessment. 11th International Conference ELearning and Software for Education, 2(02), 228–235. https://doi.org/10.12753/2066-026x-15-124

Mascull, B. (2017). Business Vocabulary in Use Intermediate with Answers. Cambridge University Press. https://books.google.co.id/books?id=EoB1_zI1xKUC

Melo, G., & Santos, D. (2023). Adaptive Human-Chatbot Interactions: Contextual Factors, Variability Design and Levels of Automation. https://doi.org/10012/20139

Mohammed Alsanousi Alssayah Ahmed, S., Riheel Alnaas Taha, A., Hussain, S., & Hayat, A. (2023). Enhancing The Teaching And Learning Of English For Specific Purposes (Esp) With Chatgpt. International Journal of Technology and Education Research, 1(3), 40–49. https://doi.org/10.99075/ijeter/issue/view/19.v1i01.458

Mweshi, G. K., & Sakyi, K. (2020). Application of sampling methods for the research design. Archives of Business Research, 8(11), 180–193. https://doi.org/10.14738/abr.811.9042

Na-Young, K. (2018). Chatbots and Korean EFL Students’ English Vocabulary Learning. Journal of Digital Convergence, 16(2), 1–7. https://doi.org/10.14400/JDC.2018.16.2.001

Nagata, R., Hashiguchi, T., & Sadoun, D. (2020). Is the Simplest Chatbot Effective in English Writing Learning Assistance? Communications in Computer and Information Science, 1215 CCIS, 245–256. https://doi.org/10.1007/978-981-15-6168-9_21

Osaat, S. D., Ogbonna, M. O., & Nwodim, O. O. (2021). Remote Learning for Optimizing Teaching and Learning During and in Post Covid-19 Era: A philosophical perspective. Contemporary Journal of Education and Development, 1(2), 1–9.

Panagiotidis, P. (2018). Technology as a Motivational Factor in Foreign Language Learning. European Journal of Education, 1(3), 43. https://doi.org/10.26417/ejed.v1i3.p43-52

Petrovi?, J., & Jovanovi?, M. (2021). The role of chatbots in foreign language learning: The present situation and the future outlook. Studies in Computational Intelligence, 973, 313–330. https://doi.org/10.1007/978-3-030-72711-6_17

Pettersson, L. E. (2018). Mobile-assisted learning and higher-education ESP: English for physiotherapy. Lingua Posnaniensis, 60(1), 81–94. https://doi.org/10.2478/linpo-2018-0006

PH. and Chang, Y. C. (2009). Qualitative, quantitative, and mixed methods approaches. Research Design Qualitative Quantitative and Mixed Methods Approaches. In Research Design (Vol. 4, Issue June). SAGE Publications. https://books.google.co.id/books?id=Pr2VEAAAQBAJ

Pokrivcakova, S. (2019). Preparing teachers for the application of AI-powered technologies in foreign language education. Journal of Language and Cultural Education, 7(3), 135–153. https://doi.org/10.2478/jolace-2019-0025

Polyzi, P., & Moussiades, L. (2023). An artificial vocabulary learning assistant. Education and Information Technologies, 28(12), 16431–16455. https://doi.org/10.1007/s10639-023-11810-9

Qasem, F., Ghaleb, M., Mahdi, H. S., Al Khateeb, A., & Al Fadda, H. (2023a). Dialog chatbot as an interactive online tool in enhancing ESP vocabulary learning. Saudi Journal of Language Studies, 3(2), 76–86. https://doi.org/10.1108/SJLS-10-2022-0072

Qasem, F., Ghaleb, M., Mahdi, H. S., Al Khateeb, A., & Al Fadda, H. (2023b). Dialog chatbot as an interactive online tool in enhancing ESP vocabulary learning. Saudi Journal of Language Studies, 3(2), 76–86. https://doi.org/10.1108/sjls-10-2022-0072

Rawas, S., & AlSaeed, D. (2024). ChatGPT: Innovating Lifelong Learning in Higher Education Through Artificial Intelligence and Digital Transformation. In Digital Transformation in Higher Education, Part B (pp. 13–28). Emerald Publishing Limited. https://doi.org/10.1108/978-1-83608-424-220241002

Rezai, A., Namaziandost, E., & Hwang, G. J. (2024). How can ChatGPT open promising avenues for L2 development? A phenomenological study involving EFL university students in Iran. Computers in Human Behavior Reports, 16, 100510. https://doi.org/10.1016/j.chbr.2024.100510

Ruan, S., Jiang, L., Xu, Q., Liu, Z., Davis, G. M., Brunskill, E., & Landay, J. A. (2021). EnglishBot: An AI-Powered Conversational System for Second Language Learning. 26th International Conference on Intelligent User Interfaces, 434–444. https://doi.org/10.1145/3397481.3450648

Saienko, N., Semyda, O., & Akhmad, I. (2020). Using social networks in teaching ESP to engineering students. Advanced Education, 7(14), 38–45. https://doi.org/10.20535/2410-8286.198083

Singh, A. (2022). Digital transformation in education: Customary to digital education. In Evolution of Digitized Societies Through Advanced … (pp. 19–32). Springer. https://doi.org/10.1007/978-981-19-2984-7_3

Strinyuk, S. A., & Lanin, V. V. (2022). Approaches to chatbot design for teaching english to maritime students: Needs analysis and content planning. AIP Conference Proceedings, 2647, 1445–1453. https://doi.org/10.1063/5.0124316

Stroo, S., Muñoz-Luna, R., & Jurado-Navas, A. (2018). Using Technology in the Teaching of ESP: Some Reflections Based on Practice. In Integrating information and communication technologies in English for specific purposes (pp. 27–36). Springer. https://doi.org/10.1007/978-3-319-68926-5_3

Sweidan, S. Z., Abu Laban, S. S., Alnaimat, N. A., & Darabkh, K. A. (2021). SIAAA-C: A student interactive assistant android application with chatbot during COVID-19 pandemic. Computer Applications in Engineering Education, 29(6), 1718–1742. https://doi.org/10.1002/cae.22419

Synekop, O. (2020). Webquest as technology of differentiated esp instruction at university level. Journal of Teaching English for Specific and Academic Purposes, 8(1 Special Issue), 43–52. https://doi.org/10.22190/JTESAP2001043S

Terrance Lopez. (2022). The Benefits and Drawbacks of Implementing Chatbots in Higher Education A case study for international students at Jönköping University Master Thesis in Business Administration. In Master Thesis (Issue March).

Turnbull, D., Chugh, R., & Luck, J. (2021). Transitioning to E-Learning during the COVID-19 pandemic: How have Higher Education Institutions responded to the challenge? Education and Information Technologies, 26(5), 6401–6419. https://doi.org/10.1007/s10639-021-10633-w

Wang, X., Pang, H., Wallace, M. P., Wang, Q., & Chen, W. (2024). Learners’ perceived AI presences in AI-supported language learning: a study of AI as a humanized agent from community of inquiry. Computer Assisted Language Learning, 37(4), 814–840. https://doi.org/10.1080/09588221.2022.2056203

Wang, Y., Liu, M., & Zhou, Z. (2024). Enhancing ESP Vocabulary Learning through ChatGPT: A Case Study. … & Teacher Education International …, 907–913. https://www.learntechlib.org/p/224061/

Wardak, M. (2020). Mobile assisted language learning (mall): teacher uses of smartphone applications (apps) to support undergraduate students’ English as a foreign language (EFL) vocabulary development. Lancaster University (United Kingdom).

Woo, J. H., & Choi, H. (2021). Systematic review for AI-based language learning tools. Journal of Digital Contents Society, 22(11), 1783–1792. https://doi.org/10.9728/dcs.2021.22.11.1783

Yang, H., & Kim, H. (2021). Development and application of AI Chatbot for cabin crews. Korean Journal of English Language and Linguistics, 21(October), 1085–1104. https://doi.org/10.15738/kjell.21..202110.1085

Yin, J., Goh, T. T., Yang, B., & Xiaobin, Y. (2021). Conversation technology with micro-learning: The impact of chatbot-based learning on students’ learning motivation and Performance. Journal of Educational Computing Research, 59(1), 154–177. https://doi.org/10.1177/0735633120952067

Zhang, R., & Zou, D. (2022). Types, purposes, and effectiveness of state-of-the-art technologies for second and foreign language learning. Computer Assisted Language Learning, 35(4), 696–742. https://doi.org/10.1080/09588221.2020.1744666

Zhang, Z., & Huang, X. (2024). The impact of chatbots based on large language models on second language vocabulary acquisition. Heliyon, 10(3). https://doi.org/10.1016/j.heliyon.2024.e25370

Zohoorian, Z. (2015). A needs analysis approach: An investigation of needs in an eap context. Theory and Practice in Language Studies, 5(1), 58. https://doi.org/10.17507/tpls.0501.07