Multimodal Approach to Language Learning: Integration of Technology to Improve Understanding and Effective Communication in the Digital Era
DOI:
https://doi.org/10.24256/ideas.v14i1.9901Keywords:
communication, comprehension, language learning, multimodality, technologyAbstract
This study aims to analyze the effectiveness of a multimodal approach in improving students' language learning comprehension and communication skills. The multimodal approach integrates various modalities, such as text, images, sound, video, and digital technology, compared to the monomodal method which only uses one modality. This study used a quasi-experimental design with two groups, namely the control group and the experimental group, with a total of 60 students. The instruments used included pre-test and post-test, student perception questionnaires, classroom observations, and semi-structured interviews. The results showed that the experimental group taught with a multimodal approach experienced a significant increase in language comprehension, averaging 25%, while the control group increased by only 10%. In addition, students who used the multimodal approach reported higher levels of motivation and engagement in the learning process. Observations showed that technology plays an important role in creating an interactive and dynamic learning environment. However, there are challenges related to equitable access to technology among students. In conclusion, the multimodal approach proved more effective at improving students' language comprehension and communication skills than the monomodal method. This study recommends developing technological infrastructure, providing teacher training, and integrating multimodality into the curriculum to maximize the benefits of this method.
References
Amumpuni, R. S., Sagita, M., & Zaiturrahmi, Z. (2023). Effects of augmented reality on perceived motivation for struggling readers: Mix-method analysis. Journal of English Language Teaching Innovations and Materials (Jeltim), 5(2), 144. https://doi.org/10.26418/jeltim.v5i2.60720
Choi, J., & Yi, Y. (2016). Teachers’ Integration of Multimodality into Classroom Practices for English Language Learners. TESOL Journal, 7(2), 304–327. https://doi.org/10.1002/tesj.204
Creswell, J. W. (2016). Research Design: Qualitative, Quantitative, Mixed Methods Approaches (Fourth Edition). SAGE.
Firdaus, S., Komarudin, & Gloriani, Y. (2024). The Effectiveness of Use of Multimodal Text Teaching Materials on Learning the Indonesian Language in High School. International Journal of Educational Research Excellence (IJERE), 3(2), 657–667. https://doi.org/10.55299/ijere.v3i2.970
Grapin, S. (2019). Multimodality in the New Content Standards Era: Implications for English Learners. TESOL Quarterly, 53(1), 30–55. https://doi.org/10.1002/tesq.443
Holler, J., & Levinson, S. C. (2019). Multimodal Language Processing in Human Communication. Trends in Cognitive Sciences, 23(8), 639–652. https://doi.org/10.1016/j.tics.2019.05.006
Kasturi, R. (2021). Penerapan Pembelajaran Multimodal Pada Masa Pandemi Covid-19. https://doi.org/10.31219/osf.io/cvdq6
Kennedy, V. (2015). Kritički, kulturni i višemodalni pristupi pjesmi kao književnome tekstu u učenju jezika. Libri et Liberi, 3(2), 295–310. https://doi.org/10.21066/carcl.libri.2014-03(02).0021
Lazaridou, A., Pham, N. T., & Baroni, M. (2016). Towards Multi-Agent Communication-Based Language Learning (arXiv:1605.07133). arXiv. http://arxiv.org/abs/1605.07133
Lee, Y. J. (2019). Integrating multimodal technologies with VARK strategies for learning and teaching EFL presentation: An investigation into learners’ achievements and perceptions of the learning process. Australian Journal of Applied Linguistics, 2(1), 17–31. https://doi.org/10.29140/ajal.v2n1.118
Mustakim Sagita, Issy Yuliasri, Abdurrahman Faridi, & Hendi Pratama. (2024). Digital Cartography of Thought: Enhancing EFL Reading Comprehension Through Mind Mapping. EVOLUTIONARY STUDIES IN IMAGINATIVE CULTURE, 1078–1094. https://doi.org/10.70082/esiculture.vi.1169
Olaniyi Muraina, I., Adegboye, A., Abejide Adegoke, M., & Bankole Olojido, J. (2019). Multimodal Instructional Approach: The Use of Videos, Games, Practical and Online Classroom to Enhance Students’ Performance in Programming Languages. American Journal of Software Engineering and Applications, 8(2), 44. https://doi.org/10.11648/j.ajsea.20190802.12
Özyürek, A. (2021). Considering the Nature of Multimodal Language from a Crosslinguistic Perspective. Journal of Cognition, 4(1), 42. https://doi.org/10.5334/joc.165
Sagita, M., Jamaliah, J., & Nurul Balqis. (2021). STUDENTS’ PERCEPTION ABOUT GOOGLE TRANSLATION TOOL IN LEARNING ENGLISH: (A Descriptive Study at Jabal Ghafur University). Getsempena English Education Journal, 8(1), 26–40. https://doi.org/10.46244/geej.v8i1.1209
Setyaningsih, Y. (2023). Multimodalitas linguistis-visual dalam morfologi bahasa Indonesia: Persepsi pemaduan dalam pengembangan desain pembelajaran. Diglosia: Jurnal Kajian Bahasa, Sastra, Dan Pengajarannya, 6(4), 971–990. https://doi.org/10.30872/diglosia.v6i4.725
Subagjo, A. (2023). Kemampuan Literasi Digital dalam Pembelajaran Bahasa Indonesia pada Siswa MTsN 4 Bojonegoro. JURNAL JENDELA PENDIDIKAN, 3(04), 464–468. https://doi.org/10.57008/jjp.v3i04.632
Suryanti, E., Tri Widayati, R., Nugrahani, F., & Veronika, U. P. (2024). Pentingnya Pengembangan Media Berbasis Digital Pada Pembelajaran Bahasa Indonesia. Jurnal Pendidikan, 33(1), 505–514. https://doi.org/10.32585/jp.v33i1.4944
Zhang, C., Yang, Z., He, X., & Deng, L. (2020). Multimodal Intelligence: Representation Learning, Information Fusion, and Applications. IEEE Journal of Selected Topics in Signal Processing, 14(3), 478–493. https://doi.org/10.1109/JSTSP.2020.2987728
Downloads
Published
Issue
Section
Citation Check
License
Copyright (c) 2026 Mustakim Sagita, Novita Diana
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under an Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See the Effect of Open Access)
