Research Article

Digital Discourses and Multimodal Expressions: New Frontiers in Linguistic Development

Stella Bolanle Apata 1 *
More Detail
1 School of Educational Studies, College of Education, University of South Africa, Pretoria 0003, South Afric* Corresponding Author
International Journal of Social Sciences and Artistic Innovations, 6(1), 2026, 45-54, https://doi.org/10.35745/ijssai2026v06.01.0005
Submitted: 07 October 2025, Published Online: 30 March 2026, Published: 19 March 2026
OPEN ACCESS   37 Views   22 Downloads
Download Full Text (PDF)

ABSTRACT

This study examines the relationship between digital discourse and multimodal meaning-making, both of which are pivotal for twenty-first-century language learning. This study synthesizes interdisciplinary frameworks to bridge theory and classroom practice, offering grounded strategies for integrating multimodal and equitable literacies in the digital era. It argues that the digital domain recasts meaning-making and opportunities for meaning-making across text types via composites of graphics, sound and materiality as complex semiotic ensembles. Developments are framed via multimodal discourse analysis, social semiotics, cognitive load theory and multiliteracies pedagogy. In the history of discourse in print and the digital domain, a new reality emerges, marked by features of hypertextuality, instability, convergence, algorithmically mediated interaction, and transience, which suggest a definitive shift in what it means to communicate intentionally. From emojis, GIFs, memes, to podcasts, video interactions, and virtual realities, the shifting features of multimodal meaning-making expand the flexibility of language skills beyond alphabetic intersections. Digital discourse and modalities impact literacy development, as well as pragmatic awareness and multilingual expression, thereby enabling learners, to develop an extensive repertoire of language abilities. This study assesses the significance of these findings for pedagogical applications, encompassing the prevalence of multimodal meaning-making in the classroom and the subsequent evaluation of such works, as well as ethical considerations related to digital citizenship, nuance, misinformation, and bias. It concludes with a future-oriented perspective shaped by artificial intelligence, augmented/virtual realities, and multimodal learning analytics, yet existing in a perpetual state of limbo regarding equity and access.
Keywords: Artificial intelligence, Digital discourse, Linguistic development, Multimodality, Pedagogy

CITATION (APA)

Apata, S. B. (2026). Digital Discourses and Multimodal Expressions: New Frontiers in Linguistic Development. International Journal of Social Sciences and Artistic Innovations, 6(1), 45-54. https://doi.org/10.35745/ijssai2026v06.01.0005

REFERENCES

  1. Adami, E. (2022). Design in Gunther Kress’s social semiotics. London Review of Education, 20(1), 41. https://doi.org/10.14324/LRE.20.1.41
  2. Alfathira, N., Wahyuni, N., & Anshori, M. Y. (2024). Digital multimodal composing (DMC) using Canva: EFL students’ perspectives. Available online: https://www.researchgate.net/publication/385400057_Digital_Multimodal_Composing_DMC_Using_Canva_EFL_Students%27_Perspectives (accessed on April 24, 2026).
  3. Androutsopoulos, J. (2015). Networked multilingualism: Some language practices on Facebook and their implications. International Journal of Bilingualism, 19(2), 185–205. https://doi.org/10.1177/1367006913489198
  4. Apata, S. B. (2023). Critical literacy skills: The 21st century skills for language educators in Nigeria. Journal of Arts and Social Sciences Education, 8(1), 19–27. https://www.ijasseonline.com.ng/paper/critical-literacy-skills-the-21st-century-skills-for-language-educators-in-nigeria
  5. Bai, Q., Dan, Q., Mu, Z., & Yang, M. (2019). A systematic review of emoji: Current research and future perspectives. Frontiers in Psychology, 10, 2221. https://doi.org/10.3389/fpsyg.2019.02221
  6. Blikstein, P., & Worsley, M. (2016). Multimodal learning analytics and education data mining: Using computational technologies to measure complex learning tasks. Journal of Learning Analytics, 3(2), 220–238. https://doi.org/10.18608/jla.2016.32.11
  7. Bolter, J. D. (2001). Writing space: Computers, hypertext, and the remediation of print (2nd ed.). London, UK: Routledge. https://doi.org/10.4324/9780203699012
  8. Bucher, T. (2018). If…then: Algorithmic power and politics. Oxford, UK: Oxford University Press. https://doi.org/10.1093/oso/9780190493028.001.0001
  9. Caspi, A., Katriel, Y., & Tuval-Maschiach, R. (2025). Using emojis that alter the meaning of written messages: When contradiction changes interpretation. Journal of Broadcasting & Electronic Media, 69(1), 1–22. https://doi.org/10.1080/08838151.2024.2374778
  10. Chen, C. (2020). Visualizing the knowledge domain of multimodal discourse analysis (2009–2019): A bibliometric review. Discourse, Context & Media, 34, 100383. https://doi.org/10.1016/j.dcm.2020.100383
  11. Cope, B., & Kalantzis, M. (2009). Multiliteracies: New literacies, new learning. Pedagogies: An International Journal, 4(3), 164–195. https://doi.org/10.1080/15544800903076044
  12. Cope, B., & Kalantzis, M. (2023). Multiliteracies: A short update. International Journal of Literacies, 30(2), 1–15. https://doi.org/10.18848/2327-0136/CGP/v30i02/1-15
  13. Crystal, D. (2011). Internet linguistics: A student guide. London, UK: Routledge. https://doi.org/10.4324/9780203828559
  14. Danesi, M. (2017). The semiotics of emoji: The rise of visual language in the age of the internet. London, UK: Bloomsbury.
  15. De Oliveira, J. M., & Gallardo-Echenique, E. (2024). Enhancing multimodal literacy through community service learning: A social semiotics perspective. Frontiers in Education, 9, 1448805. https://doi.org/10.3389/feduc.2024.1448805
  16. Diamantopoulou, S., & Ørevik, S. (Eds.). (2021). Multimodality in English language learning. London, UK: Routledge. https://doi.org/10.4324/9781003155300
  17. Dressman, M. (2020). Multimodality and language learning. In M. Dressman & R. W. Sadler (Eds.), The handbook of informal language learning (pp. 39–55). Hoboken, NJ, USA: Wiley-Blackwell. https://doi.org/10.1002/9781119472384.ch3
  18. Eve, M. P. (2024). Theses on the metaphors of digital-textual history. Cambridge, UK: Open Book Publishers. https://doi.org/10.11647/OBP.0363
  19. Fjørtoft, H. (2020). Multimodal digital classroom assessments: Validity and design in technology-rich settings. Computers & Education, 152, 103882. https://doi.org/10.1016/j.compedu.2020.103882
  20. Garcés-Conejos Blitvich, P., & Bou-Franch, P. (2018). Introduction to analyzing digital discourse: New insights and future directions. In P. Garcés-Conejos Blitvich & P. Bou-Franch (Eds.), Analyzing digital discourse: New insights and future directions (pp. 1–22). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-92663-6_1
  21. Guerrero-Sosa, J. D. T. (2025). A comprehensive review of multimodal learning analytics in education: Foundations, tools, and applications. Applied Sciences, 15(11), 5896. https://doi.org/10.3390/app15115896
  22. Guo, X., & Lee, J. S. (2023). A systematic review of informal digital learning of English: An ecological systems theory perspective. System, 117, 103097. https://doi.org/10.1016/j.system.2023.103097
  23. Heilala, V., Araya, R., & Hämäläinen, R. (2025). Generative AI in multimodal education: Mapping the landscape. British Journal of Educational Technology, 56(2), 433–450. https://doi.org/10.1111/bjet.13455
  24. Jenkins, H. (2006). Convergence culture: Where old and new media collide. New York, NY, USA: New York University Press.
  25. Jiang, L., Zheng, D., & Wu, Y. (2024). Digital multimodal composing as translanguaging assessment in CLIL classrooms. Computers & Education, 212, 105123. https://doi.org/10.1016/j.compedu.2024.105123
  26. Jin, D. Y. (2024). Sounding social media: Expanding multimodal discourse analysis to aural dimensions. New Media & Society. Advance online publication. https://doi.org/10.1177/14614448241213170
  27. Karunanayaka, S., Yatigammana, D., & Muthukumarana, T. (2023). Artificial intelligence in education: Opportunities, challenges, and future directions. Education and Information Technologies, 28(6), 6435–6454. https://doi.org/10.1007/s10639-023-11678-5
  28. Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I. (2015). Sentiment of emojis. PLOS ONE, 10(12), e0144296. https://doi.org/10.1371/journal.pone.0144296
  29. Landow, G. P. (2006). Hypertext 3.0: Critical theory and new media in an era of globalization. Baltimore, MD, USA: Johns Hopkins University Press.
  30. Lankshear, C., & Knobel, M. (2011). New literacies: Everyday practices and social learning (3rd ed.). London, UK: Open University Press.
  31. Li, L. (2018). Pragmatic functions of emoji in internet-based communication: A corpus-based study. Smart Learning Environments, 5, 17. https://doi.org/10.1186/s40561-018-0069-7
  32. Liu, H. (2024). Multimodal discourse studies in the international context: A CiteSpace bibliometric visualization. SAGE Open, 14(1), 1–16. https://doi.org/10.1177/21582440241305454
  33. Lyons, J. (2018). Multimodal expression in written digital discourse: Evoking and enacting meaning. Journal of Pragmatics, 131, 67–82. https://doi.org/10.1016/j.pragma.2018.05.002
  34. Midgette, M., & Stewart, C. (2025). Understanding multimodal assessment practices in higher education to improve equity. Education Sciences, 15(11), 1523. https://doi.org/10.3390/educsci15111523
  35. New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60–92.
  36. Ørevik, S. (2023). Assessing students’ multimodal texts in the subject of English: Synthesising peers’ and teachers’ recognition of semiotic work. TESL-EJ: Teaching English as a Second Language Electronic Journal, 27(2), 119–136. https://files.eric.ed.gov/fulltext/EJ1397866.pdf
  37. Pandey, S. (2025). Large language models in digital multimodal composition: First-year writing instructors’ perspectives. Computers and Composition, 68, 102840. https://doi.org/10.1016/j.compcom.2025.102840
  38. Parmaxi, A. (2020). Virtual reality in language learning: A systematic review and implications for research and practice. Interactive Learning Environments, 30(1), 1–15. https://doi.org/10.1080/10494820.2020.1765392
  39. Rahmanu, I. W. E. D. (2024). Multimodal immersion in English language learning: A systematic review (2013–2024). PLOS ONE, 19(5), e0302143. https://doi.org/10.1371/journal.pone.0302143
  40. Ren, W. (2024). Translanguaging in self-praise on Chinese social media: Multilingual and multi-semiotic resources. Applied Linguistics Review, 15(5), 883–908. https://doi.org/10.1515/applirev-2021-0169
  41. Rowsell, J. (2025). The comfort of screens: Literacy in post-digital times. London, UK: Routledge.
  42. Thabet, R. M. (2024). Multimodal social semiotic theory: Origins and developments. Bulletin of the Faculty of Arts, 73(2), 57–85. https://doi.org/10.21608/bfa.2024.387001
  43. Tinmaz, H., & Lee, J. (2022). A systematic review on digital literacy. Smart Learning Environments, 9, 15. https://doi.org/10.1186/s40561-022-00204-y
  44. UNESCO. (2023). Guidelines on generative AI and education. Paris, France: United Nations Educational, Scientific and Cultural Organization. https://unesdoc.unesco.org/ark:/48223/pf0000386275
  45. Xu, H., Sun, Y., & Wang, W. (2023). Cross-modality discourse in social media: Modeling multimodal coherence in multimedia tweets. Discourse, Context & Media, 53, 100654. https://doi.org/10.1016/j.dcm.2023.100654
  46. Yu, S. (2024). Research into practice: Digital multimodal composition in second-language writing. Language Teaching, 57(3), 327–345. https://doi.org/10.1017/S0261444824000276
  47. Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education—Where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39. https://doi.org/10.1186/s41239-019-0171-0
  48. Zhumabek, A., Yu, L. T., & Teng, F. (2023). Informal digital learning of English and willingness to communicate: The mediating role of self-efficacy. Computer Assisted Language Learning, 36(7), 1393–1416. https://doi.org/10.1080/09588221.2023.2215279