A multimodal analysis on a vocational English book and its effect on students’ English proficiency

Usman Sidabutar; Nenni Triana Sinaga; Nurhayati Sitorus; Febrika Dwi Lestari

doi:10.21744/lingcure.v5nS3.1951

Authors

Usman Sidabutar
usman.sidabutar@uhn.ac.id
Universitas HKBP Nommesen, Medan, Indonesia
Nenni Triana Sinaga Universitas HKBP Nommesen, Medan, Indonesia
Nurhayati Sitorus Universitas HKBP Nommesen, Medan, Indonesia
Febrika Dwi Lestari Universitas HKBP Nommesen, Medan, Indonesia

Keywords:

ELT, multimodal, SFL, verbal, visual

Abstract

The digitization of education is the use of technology as an aspect of the learning system, from the curriculum to the education system, which has a very big influence on innovation. As society and academic demand increase in the modern era, the online learning system (OLS) is encountered by society and academics. The multimodal approach refers to the huge learning competence in English ability as if the method or application is integrated in a digitizing manner. The multimodal approach contains using images, verbal and visual integration with words or text which provides meanings in the mode of communication. The process of analyzing and disclosing the text will give essence to the meaning of a picture message in a printed book will reveal projection, enhancement, concurrence. All of which are discussed based on linguistic analysis to relate the text to the general characteristics of language both verbally and visually. Systemic function Linguistics based on the concept of metafunction has ideational, interpersonal, and textual components linking the internal forms of language and their use in semiotic social contexts will be enacted to the research. The research will use descriptive and qualitative methods.

Downloads

Download data is not yet available.

References

Anastopoulou, S. (2004). Investigating multimodal interactions for the design of learning environments: a case study in science learning (Doctoral dissertation, University of Birmingham).

Baldry, A., & Thibault, P. J. (2008). Applications of multimodal concordances. HERMES-Journal of Language and Communication in Business, (41), 11-41.

Coccetta, F. (2018). Developing university students’ multimodal communicative competence: Field research into multimodal text studies in English. System, 77, 19-27. https://doi.org/10.1016/j.system.2018.01.004

Ek?i, G., & Yak???k, B. Y. (2015). An investigation of prospective English language teachers’ multimodal literacy. Procedia-Social and Behavioral Sciences, 199, 464-471. https://doi.org/10.1016/j.sbspro.2015.07.533

Erfiani, N. M. D., Sukarsih, N. N. T., Wardhana, I. G. N. P., & Lindawati, N. P. (2021). Needs analysis on English language use by homestay owners in Ubud Gianyar. Linguistics and Culture Review, 5(1), 422-437. https://doi.org/10.21744/lingcure.v5n1.1894

Firmansyah, M. B. (2018). Multimodal conception in learning. ISLLAC: Journal of Intensive Studies on Language, Literature, Art, and Culture, 2(1), 40-44.

Fjørtoft, H. (2020). Multimodal digital classroom assessments. Computers & Education, 152, 103892. https://doi.org/10.1016/j.compedu.2020.103892

Gilakjani, A. P., Ismail, H. N., & Ahmadi, S. M. (2011). The effect of multimodal learning models on language teaching and learning. Theory & Practice in Language Studies, 1(10).

Halliday, M. A. K., Matthiessen, C. M., Halliday, M., & Matthiessen, C. (2014). An introduction to functional grammar. Routledge.

Höllerer, M. A., van Leeuwen, T., Jancsary, D., Meyer, R. E., Andersen, T. H., & Vaara, E. (2019). Visual and multimodal research in organization and management studies. Routledge.

Jiang, L. (2018). Digital multimodal composing and investment change in learners' writing in English as a foreign language. Journal of Second Language Writing, 40, 60-72. https://doi.org/10.1016/j.jslw.2018.03.002

Kang, J. (2020). Speaking and Writing Connections in L2: The Roles of Multimodal Teaching and Learning. (Language Research), 56.

Kasni, N. W., & Budiarta, I. W. (2021). The multimodal forms of tourism promotional discourse in the age COVID-19. International Journal of Linguistics, Literature and Culture, 7(6), 422-440. https://doi.org/10.21744/ijllc.v7n6.1945

Laadem, M., & Mallahi, H. (2019). Multimodal Pedagogies in Teaching English for Specific Purposes in Higher Education: Perceptions, Challenges and Strategies. International Journal on Studies in Education, 1(1), 33-38.

Li, J., Brar, A., & Roihan, N. (2021). The use of digital technology to enhance language and literacy skills for Indigenous people: A systematic literature review. Computers and Education Open, 100035. https://doi.org/10.1016/j.caeo.2021.100035

Martínez Lirola, M. (2020). Multimodal Teaching Proposal in an English as A Foreign Language Subject.

Mercer, N., Hennessy, S., & Warwick, P. (2019). Dialogue, thinking together and digital technology in the classroom: Some educational implications of a continuing line of inquiry. International Journal of Educational Research, 97, 187-199. https://doi.org/10.1016/j.ijer.2017.08.007

Mikoladze, D. L. (2020). Translation strategies in English to Persian. Applied Translation, 14(1), 8–15. Retrieved from https://appliedtranslation.nyc/index.php/journal/article/view/1033

Ming-Hao, Y. A. N. G., & Jian-Hua, T. A. O. (2019). Data fusion methods in multimodal human computer dialog. Virtual Reality & Intelligent Hardware, 1(1), 21-38. https://doi.org/10.3724/SP.J.2096-5796.2018.0010

Nehe, B. M., Mayuni, I., & Rahmat, A. (2018). Using sociodrama in EFL speaking class: Related to student achievement. International Journal of Linguistics, Literature and Culture, 4(4), 44-52. https://doi.org/10.21744/ijllc.v4n4.262

Nouri, J. (2018). Students multimodal literacy and design of learning during self-studies in higher education. Technol Knowl Learn 24: 683.

Pagano, A. S., Paula, F. F. D., & Ferreguetti, K. (2018). Verbal and Verbal-Visual Logico-Semantic Relations in Picturebooks: an English-Brazilian Portuguese Parallel Corpus Study. Ilha do Desterro, 71, 53-76.

Papageorgiou, V., & Lameras, P. (2017). Multimodal Teaching and Learning with the Use of Technology: Meanings, Practices and Discourses. International Association for Development of the Information Society.

Perniss, P. (2018). Why we should study multimodal language. Frontiers in psychology, 9, 1109.

Philippe, S., Souchet, A. D., Lameras, P., Petridis, P., Caporal, J., Coldeboeuf, G., & Duzan, H. (2020). Multimodal teaching, learning and training in virtual reality: a review and case study. Virtual Reality & Intelligent Hardware, 2(5), 421-442. https://doi.org/10.1016/j.vrih.2020.07.008

Saha, S., & Deb, S. (2020). BYOD Supported Multimodal Classroom Interaction. Procedia Computer Science, 167, 1533-1542. https://doi.org/10.1016/j.procs.2020.03.364

Salbego, N., Heberle, V. M., & da Silva Balen, M. G. S. (2015). A visual analysis of English textbooks: Multimodal scaffolded learning. Calidoscópio, 13(1), 5-13.

Sankey, M. (2006). A neomillennial learning approach: Helping non-traditional learners studying at a distance. International Journal of Education and Development using ICT, 2(4), 82-99.

Sewell, W. C., & Denton, S. (2011). Multimodal literacies in the secondary English classroom. English Journal, 61-65.

Stec, M. (2018). Multimodality of Cultural Content in ELT Materials-a Comparative Study in the Polish Context. Materia?y i media we wspó?czesnej glottodydaktyce: wybrane zagadnienia, 81-102.

Sullivan, F. R. (2018). Multimodal Learning. Creativity. Technology, and Learning, 96-112.

Sun, M. (2015). Application of Multimodal Learning in Online English Teaching. International Journal of Emerging Technologies in Learning, 10(4).

Suryasa, I.W., Sudipa, I.N., Puspani, I.A.M., Netra, I.M. (2019). Translation procedure of happy emotion of english into indonesian in k???a text. Journal of Language Teaching and Research, 10(4), 738–746

Susanty, L., Hartati, Z., Sholihin, R., Syahid, A., & Liriwati, F. Y. (2021). Why English teaching truth on digital trends as an effort for effective learning and evaluation: opportunities and challenges: analysis of teaching English. Linguistics and Culture Review, 5(S1), 303-316. https://doi.org/10.21744/lingcure.v5nS1.1401

Twiner, A., Littleton, K., Whitelock, D., & Coffin, C. (2021). Combining sociocultural discourse analysis and multimodal analysis to explore teachers' and pupils' meaning making. Learning, Culture and Social Interaction, 30, 100520.

Unsworth, L. (2007). Image/text relations and intersemiosis: Towards multimodal text description for multiliteracies education. In Proceedings of the 33rd IFSC: International Systemic Functional Congress. Pontificia Universidade Catolica de Sao Paulo. https://doi.org/10.1016/j.lcsi.2021.100520

Westberg, G. (2021). Affect as a multimodal practice. Multimodality & Society, 1(1), 20-38.