NEGOTIATION OF ORAL MEANING AND EQUALITY IN MULTI-MODAL TRANSLATION OF BILINGUAL DIGITAL STORYBOOKS
DOI:
https://doi.org/10.22437/jiituj.v9i4.49721Keywords:
Bilingual Digital Storybooks, Equivalence, Moral Meaning, Multimodal Translation, TranslanguagingAbstract
This study examines how meaning and moral equality are negotiated in the multimodal translation of bilingual digital storybooks used in Indonesian primary education. Based on the Multimodal Discourse Translation and Analysis Study, this study adopts a qualitative multimodal case study design that focuses on the bilingual digital storybook Putri dans Hutan. The study involved a textual analysis of bilingual translation units, a multimodal analysis of visual and auditory elements, and classroom-based data collected through observation and interviews with teachers and students. These findings reveal that moral equity in bilingual digital storybooks is not only achieved through verbal translation but emerges through the interaction of translation strategies, multimodal resources, and translanguaging practices in the classroom. Dynamic equality is identified as the dominant translation strategy, especially in the morally charged segment, as it prioritizes emotional accessibility and moral clarity for young learners. When linguistic simplification reduces moral explicitness, visual and auditory elements play a compensatory role by reinforcing emotional cues and moral orientation. Classroom translation further mediates moral understanding, allowing students to negotiate and internalize moral meaning by utilizing Indonesian and English. This study contributes to translation studies by extending the concept of equality into multimodal and pedagogical contexts. It also offers practical implications for educators, translators, and digital media designers by highlighting the importance of multimodal coherence and classroom mediation in conveying moral values through bilingual digital storybooks.
Downloads
References
Achivida, J. J. (2025). Multimodal language teaching and language skills development with AI and VR integration: A systematic literature review. Psychology and Education: A Multidisciplinary Journal, 31(6), 587–594. https://doi.org/10.5281/zenodo.14797458.
Andrade Preciado, J. S., Sánchez Ramírez, H. J., & Priego Sánchez, Á. B. (2025). Ethical challenges in ai-assisted translation. EthAIca, 4, 151–170. https://doi.org/10.56294/ai2025151.
Belhassen, S., & Hamda. (2025). Translation Students’ Reliance on and Trust in Artificial Intelligence. Arab World English Journal for Translation & Literary Studies, 9(2). 106-119. http://dx.doi.org/10.24093/awejtls/vol9no2.7.
Braun, V., & Clarke, V. (2022). Conceptual and design thinking for thematic analysis. Qualitative Psychology, 9(1), 3–26. https://doi.org/10.1037/qup0000196.
Bus, A. G., Takacs, Z. K., & Kegel, C. A. T. (2015). Affordances and limitations of electronic storybooks for young children’s emergent literacy. Developmental Review, 35, 79–97. https://doi.org/10.1016/j.dr.2014.12.004.
Bateman, S., Wildfeuer, J., & Hiippala, T. (2017). Multimodality: Foundations, research and analysis. De Gruyter.
Bezemer, J., & Kress, G. (2016). Multimodality, learning and communication. Routledge.
Cenoz, J., & Gorter, D. (2021). Pedagogical translanguaging. System, 92, 102278. https://doi.org/10.1016/j.system.2020.102278.
Chang, C. C. (2025). Integrating Hybrid AI Approaches for Enhanced Translation. Applied Sciences, 15(16), 9039. https://doi.org/10.3390/app15169039.
Chaume, F. (2020). Audiovisual translation: From theory to practice. Perspectives, 28(1), 1–16. https://doi.org/10.1080/0907676X.2019.1693268.
Chen, C. L., Dong, Y., Castillo-Zambrano, C., Bencheqroun, H., Barwise, A., Nalaie, K., Niven, A. S. (2025). A systematic multimodal assessment of AI machine translation tools for enhancing access to critical care education. BMC Medical Education, 25, 1022. https://doi.org/10.1186/s12909-025-07452-9.
Ciesielska, M., Kucirkova, N., & Thomson, J. (2025). How the type and context of children’s storybook reading relate to select empathy skills: A meta-analysis. Early Education and Development, 36(8), 1888–1914. https://doi.org/10.1080/10409289.2025.2516989.
Coillie, J. V., & McMartin, J. (2020). Children’s Literature in Translation. OAPEN(open access). https://doi.org/10.11116/9789461663207.
Creswell, J.W. and Poth, C.N. (2018). Qualitative Inquiry and Research Design Choosing among Five Approaches. 4th Edition, SAGE Publications, Inc., Thousand Oaks
Denzin, N. K. (2012). Triangulation 2.0. Journal of Mixed Methods Research, 6(2), 80–88.
Ding, A. E., Cervantes, J. H., Martin, K., & Zhang, K. (2025). Designing translingual and transmodal scaffolding and VR pair programming for supporting multilingual learners’ participation in scientific sensemaking. Educ. Sci., 15(9), 1236. https://doi.org/10.3390/educsci15091236.
Fares Ferrag & Ikram Aya Bentounsi. (2024). The use of artificial intelligence in academic translation tasks. Ziglôbitha Publications, 2(011), 173–192. https://doi.org/10.60632/ziglobitha.n011.11.vol.2.2024.
García, O., & Kleifgen, J. A. (2018). Educating emergent bilinguals. Teachers College Press.
Garcia, O., & Wei, L. (2014). Translanguaging: Language, bilingualism and education. Palgrave Macmillan. https://doi.org/10.1057/9781137385765.
Guerrero-Sosa, J. D. T., et al. (2025). Multimodal analysis in learning analytics. Applied Sciences, 15(11), 5896. https://doi.org/10.3390/app15115896.
Hartati, E., Nababan, M.R., Santosa, R., & Djatmika. (2024). Translating english children’s storybook into indonesian context: How should the nominal groups be translated? Proceedings of the Third International Conference on Communication, Language, Literature, and Culture (ICCoLliC 2024). https://doi.org/10.2991/978-2-38476-321-4_39.
Holmes, W., Bialik, M., & Fadel, C. (2022). Artificial Intelligence in Education: Promises and implications for teaching and learning. Center for Curriculum Redesign.
House, J. (2015) Translation Quality Assessment. London and New York. Routledge Taylor & Francis Group.
Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing Multimodality. (2nd ed). Routledge.
Jiang, L. (2017). The affordances of digital multimodal composing for EFL Learning. ELT Journal 71(4), 413–422. https://doi.org/10.1093/elt/ccw098.
Kenny, D., & Doherty, S. (2023). Ethics and human agency in AI-assisted translation. Translation Spaces, 12(1), 1–21. https://doi.org/10.1075/ts.22011.ken.
Kress, G. (2018). Multimodality: A social semiotic approach. Routledge.
Kümmerling-Meibauer, B. (2018). The Routledge companion to picturebooks. Routledge.
Lathey, G. (2016). Translating children’s literature. Routledge.
Liang, L., & Lu, S. (2025). The evaluation and reception of the translation quality of three translation modalities in live-streaming contexts: computer-assisted simultaneous interpreting, machine translation (MT) with human revision and raw MT. The Translator, 1–19. https://doi.org/10.1080/13556509.2025.2494566.
Liu Kanglang. (2021). Artificial intelligence (AI) and translation teaching: A critical perspective on the transformation of education. Int. J. Educ. Sci. 33(1–3). https://doi.org/10.31901/24566322.2021/33.1-3.1159.
Liu, S., Reynolds, B. L., Thomas, N., & Soyoof, A. (2024). The use of digital technologies to develop young children’s language and literacy skills: A systematic review. SAGE Open, 14(1), 1–18. https://doi.org/10.1177/21582440241230850.
Lowien, N., & Thomas, D. J. (2025). Multimodal reading interpretation: reading the world–reading the text. Australian Journal of Language and Literacy, 48(2), 141–160. https://doi.org/10.1007/s44020-025-00080-2.
Mardliyah, A., Engliana, E., & Supadi, S. (2024). A study of bilingual children’s storybooks “The Foos”. Transformatika: Journal of Language, Literature and Teaching, 8(2), 341–359.
https://doi.org/10.31002/transformatika.v8i2.1627.
Medina, J.B. & Goddard, M.B. (2024). The effect of digital storytelling on english vocabulary learning in inclusive and diverse education. IJELS International Journal of English Language Studies. 6(1),110-118. https://doi.org/10.32996/ijels.2024.6.1.11.
Miles, MB, Huberman, AM dan Saldana, J. (2014). Qualitative data analysis: A methods sourcebook. Sage, London.
Moneus, A. M. (2024). Artificial intelligence and human translation: A contrastive study based on legal texts. Heliyon, 10(6), e28106. https://doi.org/10.1016/j.heliyon.2024.e28106.
Mutashar, M. K. . (2024). Navigating Ethics in AI-Driven Translation for a Human-Centric Future. Academia Open, 9(2), https://doi.org/10.21070/acopen.9.2024.9407.
Nida, E.A. and Taber, C.R. (1969) The Theory and Practice of Translation. E. J. Brill, Leiden.
Nikolajeva, M. (2014). Reading for Learning: Cognitive Approaches to Children’s Literature. John Benjamins Publishing Company.
O’Hagan, M. (2020). Machine Translation and Translating Technology: A Review of Post-Editing Theory and Practice. Routledge.
O’Halloran, K.L. (2011) Multimodal Analysis and Digital Technology. In: Baldry, A. and Montagna, E., Eds., Interdisciplinary Approaches on Multimodality: Theory and Practice, Palladino, Campobasso, 21-34.
Ollerhead, S. & Pennington, G. (2024). Starting small: Engaging young learners with literacy through multilingual storytelling. Journal of Early Childhood Literacy. https://doi.org/10.1177/14687984241303390.
Oittinen, R. (2018). Translating for Children. Routledge.
Pratama, A. D. Y. (2019). Translation of children’s picturebook: Retorika. Journal of Language Study, 5(2), 168–176. https://doi.org/10.22225/JR.5.2.1355.168-176
Putra, Y. S., et al. (2025). Efficacy of AI-based Text-to-Speech in Indonesian pronunciation training for foreign speakers (BIPA). Journal of Educational Management and Instruction (JEMIN), 5(2), 479–492. https://doi.org/10.22515/jemin.v5i2.12403.
Puurtinen, T. (2016). Simplification in translated children’s literature. Target, 28(2), 240–260. https://doi.org/10.1075/target.28.2.04puu.
Pym, A. (2014). Exploring translation theories (2nd ed.). Routledge.
Shahmerdanova, R. (2025). Artificial intelligence in translation: Challenges and opportunities. Acta Globalis Humanitatis et Linguarum, 2(1), 62-70. https://doi.org/10.69760/aghel.02500108.
Shimizu, A. Y., Havazelet, E., Smith, B.E., & Goodwim, A.P. (2025). Multimodal analyses and visual models for qualitatively understanding digital reading and writing process. Education Sciences, 15(9), 1135. https://doi.org/10.3390/edusci15091135.
Short, K. G. (2018). Narrative as Research: Exploring the Stories of Classroom Life. Routledge.
Sukenti, D. (2025). Readability of bilingual children’s storybooks in Indonesia. J-LELC Journal of Language Education, Linguistics and Culture, 5(3), 219-227. https://doi.org/10.25299/j-lelc.2025.24087.
Tetrawan, A. D., Ayriza, Y., Hadiana, D., Anggono, T., Amalia, H. A. (2024). The effectiveness of storytelling in enhancing empathy in bilingual kindergarten students. Insight: Journal of Psychology, 26(1), 100-112. https://doi.org/10.26486/psikologi.v26i1.3607.
Tour, E., and M. Barnes. (2022). Engaging english language learners in digital multimodal composing: pre-service teachers’ perspectives and experiences. Language and Education, 36(3), 243–258. https://doi.org/10.1080/09500782.2021.1912083.
Umar, F., Khosiyono, B. H., & Irfan, M. (2023). Bilingual-Based digital story telling innovation to grow the pancasila student profile for primary school. JOLLT Journal of Languages and Language Teaching, 11(4), 879-889. https://doi.org/10.33394/jollt.v11i4.8830
Unsworth, L. (2020). Multimodal literacy and digital children’s literature. Language and Education, 34(6), 509–526.
Wang, H. (2025). Multimodal digital story telling as literacy learning and moral cultivation practices for university EFL students. Arab World English Journal (AWEJ), 16(1), 366-383. https://dx.doi.org/10.24093/awej/vol16no1.23.
Yang, C. (2024). The application and challenges of cross-cultural multimodal translation using AI. Eurasian Journal of Applied Linguistics, 10(3), 214–229. http://dx.doi.org/10.32601/ejal.10320.
Yu, B. (2025). Pedagogical Insights from Multimodal Digital Story Production in English as Second Language Teaching. In M. M. Gu, Y. Liu, & C. F. Huang (Eds.), Re-envisioning English-medium Instruction in K-12 Schools: Policy, Research and Practice (pp. 39-59). Springer Nature Switzerland AG. https://doi.org/10.1007/978-3-031-83002-0_3.
Yuniarti, Y., & Yulian, R. (2022). Digital story telling based on multimodal elements on EFL learners’ speaking performance. Jurnal Pendidikan Indonesia, 11(2). https://doi.org/10.23887/jpiundiksha.v11i2.40217.
Zhang, E. D., & S. Yu. (2023). “Implementing digital multimodal composing in L2 writing instruction: A focus on developing L2 student writers.” Innovation in Language Learning and Teaching, 17(4), 769–777. https://doi.org/10.1080/17501229.2022.2135712.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Farida Repelita Waty Kembaren, Utami Dewi, Widia Fransiska , Faradilla Faradilla

This work is licensed under a Creative Commons Attribution 4.0 International License.











