Multimodal Semiotic Resources in Online Learning Environments: Meaning-Making from an Applied Linguistics Perspective
DOI:
https://doi.org/10.71435/Keywords:
Multimodal Semiotic Resources, Online Learning, Applied Linguistics, Meaning-Making, Collaborative LearningAbstract
Purpose: This study examines the use of multimodal semiotic resources in online applied linguistics courses and their role in supporting meaning-making, comprehension, and collaborative learning.
Subjects and Methods: The study involved 120 undergraduate applied linguistics students who engaged with text-based slides, video lectures, infographics, podcasts, and discussion forums. A convergent parallel mixed-methods design was employed. Quantitative data were collected through surveys, usage logs, and comprehension tests, while qualitative data were gathered via semi-structured interviews and observation of forum interactions. Descriptive statistics, Pearson correlation, and thematic analysis were used to analyze the data, and findings were integrated through triangulation.
Results: Slides and video lectures were the most frequently used and highly rated resources, showing strong positive correlations with comprehension scores. Infographics and discussion forums facilitated summarization, reflection, and collaborative knowledge construction, whereas podcasts were less effective when used in isolation. Students who integrated three or more modalities achieved higher comprehension, highlighting the benefits of multimodal learning. Forum participation promoted peer-to-peer negotiation of meaning, metacognitive awareness, and self-directed learning.
Conclusions: The integration of multiple multimodal resources significantly enhances comprehension and meaning-making in online learning. Effective online courses should balance structured guidance, interactive engagement, and diverse resources, positioning multimodal approaches as essential for fostering collaborative, reflective, and self-directed learning in applied linguistics education.
Downloads
References
Al-Muttairi, F. Z. S., & Al-Alusi, A. H. S. H. (2025). Multimodal communication in ESL learning: Examining the integration of visual, auditory, and textual elements in digital media with a focus on quality Education (SDG 4). Journal of Lifestyle and SDGs Review, 5(3), e04773-e04773. https://doi.org/10.47172/2965-730X.SDGsReview.v5.n03.pe04773
Chisunum, J. I., & Nwadiokwu, C. (2024). Enhancing student engagement through practical production and utilization of instructional materials in an educational technology class: A multifaceted approach. NIU Journal of Educational Research, 10(2), 81-89. https://doi.org/10.58709/niujed.v10i2.2002
Erfanian Mohammadi, J., Elahi Shirvan, M., & Akbari, O. (2019). Systemic functional multimodal discourse analysis of teaching students developing classroom materials. Teaching in higher Education, 24(8), 964-986. https://doi.org/10.1080/13562517.2018.1527763
Flowerdew, L. (2012). Corpora in the classroom: An applied linguistic perspective. Corpus applications in applied linguistics, 208-224.
García-Morales, V. J., Garrido-Moreno, A., & Martín-Rojas, R. (2021). The transformation of higher education after the COVID disruption: Emerging challenges in an online learning scenario. Frontiers in psychology, 12, 616059. https://doi.org/10.3389/fpsyg.2021.616059
Grant, M. M. (2021). Asynchronous Online Course Designs: Articulating Theory, Best Practices, and Techniques for Everyday Doctoral Education. Impacting Education: Journal on Transforming Professional Practice, 6(3), 35-46.
Huda, M. (2024). Between accessibility and adaptability of digital platform: investigating learners' perspectives on digital learning infrastructure. Higher education, skills and work-based learning, 14(1), 1-21. https://doi.org/10.1108/HESWBL-03-2022-0069
Hung, I. C., & Chen, N. S. (2018). Embodied interactive video lectures for improving learning comprehension and retention. Computers & Education, 117, 116-131. https://doi.org/10.1016/j.compedu.2017.10.005
Jones, P., Turney, A., Georgiou, H., & Nielsen, W. (2020). Assessing multimodal literacies in science: semiotic and practical insights from pre-service teacher education. Language and Education, 34(2), 153-172. https://doi.org/10.1080/09500782.2020.1720227
Kovtoniuk, M. M., Kosovets, O. P., Soia, O. M., & Tyutyun, L. L. (2022). Virtual learning environments: major trends in the use of modern digital technologies in higher education institutions. Educational Technology Quarterly, 2022(3), 183-202. https://doi.org/10.55056/etq.35
Kress, G., & Van Leeuwen, T. (2002). Colour as a semiotic mode: Notes for a grammar of colour. Visual communication, 1(3), 343-368. https://doi.org/10.1177/147035720200100306
Lumsden, S., Djonov, E., & Slatyer, H. (2024). The multimodal community of inquiry: A framework for evaluating online learning environments in higher education. In Designing Learning with Digital Technologies (pp. 33-55). London: Routledge. https://doi.org/10.4324/9781003359272
Makda, F. (2025). Digital education: Mapping the landscape of virtual teaching in higher education–a bibliometric review. Education and Information Technologies, 30(2), 2547-2575. https://doi.org/10.1007/s10639-024-12899-2
Martin, J., Xu, L., & Seah, L. H. (2021). Discourse analysis and multimodal meaning making in a science classroom: Meta-methodological insights from three theoretical perspectives. Research in Science Education, 51(1), 187-207. https://doi.org/10.1007/s11165-020-09961-7
Meng, L., & Hong, C. K. (2024). The Impact of Audiovisual Elements on Learning Outcomes-Focusing on MOOC. International Journal of Internet, Broadcasting and Communication, 16(3), 98-112. https://doi.org/10.7236/IJIBC.2024.16.3.98
Meyer, O., Coyle, D., Halbach, A., Schuck, K., & Ting, T. (2015). A pluriliteracies approach to content and language integrated learning–mapping learner progressions in knowledge construction and meaning-making. Language, Culture and Curriculum, 28(1), 41-57. https://doi.org/10.1080/07908318.2014.1000924
Moorhouse, B. L., & Wong, K. M. (2022). Blending asynchronous and synchronous digital technologies and instructional approaches to facilitate remote learning. Journal of Computers in Education, 9(1), 51-70. https://doi.org/10.1007/s40692-021-00195-8
Nielsen, W., Turney, A., Georgiou, H., & Jones, P. (2022). Meaning making with multiple representations: a case study of a preservice teacher creating a digital explanation. Research in Science Education, 52(3), 871-890. https://doi.org/10.1007/s11165-021-10038-2
Pacheco, M. B., Smith, B. E., Deig, A., & Amgott, N. A. (2021). Scaffolding multimodal composition with emergent bilingual students. Journal of Literacy Research, 53(2), 149-173. https://doi.org/10.1177/1086296X211010888
Pedrazzini, A., Gualberto, C., Karatza, S., Ghiasian, M., & Adami, E. (2023). PanMeMic. Changes in Communication and Interaction during the COVID-19 Pandemic and Beyond: Insights from a Collective, Multimodal Research Method 1. In Multimodality Studies in International Contexts (pp. 68-89). New York: Routledge. https://doi.org/10.4324/9781003367550
Roa González, J., Sánchez Sánchez, N., Seoane Pujol, I., & Díaz Palencia, J. L. (2025). Challenges and perspectives in the evolution of distance and online education towards higher technological environments. Cogent Education, 12(1), 2447168. https://doi.org/10.1080/2331186X.2024.2447168
Satar, M., Hauck, M., & Bilki, Z. (2023). Multimodal representation in virtual exchange: A social semiotic approach to critical digital literacy. Language Learning & Technology, 27(2), 72-96.
Sato, S. N., Condes Moreno, E., Rubio-Zarapuz, A., Dalamitros, A. A., Yañez-Sepulveda, R., Tornero-Aguilera, J. F., & Clemente-Suárez, V. J. (2023). Navigating the new normal: Adapting online and distance learning in the post-pandemic era. Education Sciences, 14(1), 19. https://doi.org/10.3390/educsci14010019
Selander, S. (2024). Meaning-making and transformative engagement–notes on Gunther Kress’s social semiotic and multimodal approach to learning. Text & Talk, 44(4), 511-525. https://doi.org/10.1515/text-2022-0099
Sofkova Hashemi, S. (2017). Socio-semiotic patterns in digital meaning-making: semiotic choice as indicator of communicative experience. Language and Education, 31(5), 432-448. https://doi.org/10.1080/09500782.2017.1305396
Twiner, A., Littleton, K., Whitelock, D., & Coffin, C. (2021). Combining sociocultural discourse analysis and multimodal analysis to explore teachers' and pupils' meaning making. Learning, Culture and Social Interaction, 30, 100520. https://doi.org/10.1016/j.lcsi.2021.100520
Ulanday, M. L., Centeno, Z. J., Bayla, M. C., & Callanta, J. (2021). Flexible learning adaptabilities in the new normal: E-learning resources, digital meeting platforms, online learning systems and learning engagement. Asian Journal of Distance Education, 16(2).
Zitha, I., Mokganya, G., & Sinthumule, O. (2023). Innovative strategies for fostering student engagement and collaborative learning among extended curriculum programme students. Education Sciences, 13(12), 1196. https://doi.org/10.3390/educsci13121196
