Developing an Online Formative Assessment Instrument for Listening Skill through LMS
Main Article Content
Abstract
Traditional methods of assessing listening skills in language learners suffer from drawbacks such as subjectivity, inconsistency, and time-intensive grading processes. To overcome these limitations, we introduce an innovative assessment instrument designed to efficiently and effectively evaluate students’ listening skills while offering instructors a dependable means to track progress. This study proposes the development of an online assessment instrument tailored to measure language learners’ comprehension of spoken language. The two instruments incorporate a questionnaire and a variety of question formats, each gauging students’ grasp of spoken discourse across diverse contexts and accents. Additionally, the online assessment assesses their proficiency in identifying main ideas, supporting details, and inferred implications within spoken communication. Accessible through a dedicated learning management system (LMS) platform available at http://lms.elsida.ac.id/, this instrument empowers instructors with a robust mechanism to gauge their students’ advancement. By providing a thorough assessment of listening skills, the instrument stands as a powerful resource for educators seeking to drive ongoing improvement. The study’s findings highlight how this assessment instrument can improve language learning through ongoing feedback. Through ongoing enhancements and testing in language learning contexts, the instrument contributes to a more effective evaluation of listening skills in language education.
Article Details
References
Bai, Y., Mo, D., Zhang, L., Boswell, M., & Rozelle, S. (2016). The impact of integrating ICT with teaching: Evidence from a randomized controlled trial in rural schools in China. Computers & Education, 96, 1–14. https://doi.org/10.1016/j.compedu.2016.02.005
Bervell, B., & Arkorful, V. (2020). LMS-enabled blended learning utilization in distance tertiary education: Establishing the relationships among facilitating conditions, voluntariness of use and use behaviour. International Journal of Educational Technology in Higher Education, 17(6), 1–16. https://doi.org/10.1186/s41239-020-0183-9
Brown, G. T. L., Andrade, H. L., & Chen, F. (2015). Accuracy in student self-assessment: Directions and cautions for research. Assessment in Education: Principles, Policy & Practice, 22(4), 444–457. https://doi.org/10.1080/0969594X.2014.996523
Chen, J., & Zhang, L. J. (2019). Assessing student-writers’ self-efficacy beliefs about text revision in EFL writing. Assessing Writing, 40(March), 27–41. https://doi.org/10.1016/j.asw.2019.03.002
Dai, Z., Xiong, J., Zhao, L., & He, X. (2022). The effectiveness of ICT-enhanced teaching mode using activity theory on raising class interaction and satisfaction in an engineering course. Interactive Learning Environments, 1–20. https://doi.org/10.1080/10494820.2022.2086574
Ferreira, H., de Oliveira, G. P., Araújo, R., Dorça, F., & Cattelan, R. (2019). Technology-enhanced assessment visualization for smart learning environments. Smart Learning Environments, 6(1). https://doi.org/10.1186/s40561-019-0096-z
Fulcher, G. (2015). Re-examining language testing. Routledge. https://doi.org/10.4324/9781315695518
Hwang, G.-J., Hsu, T.-C., Lai, C.-L., & Hsueh, C.-J. (2017). Interaction of problem-based gaming and learning anxiety in language students’ English listening performance and progressive behavioral patterns. Computers & Education, 106, 26–42. https://doi.org/10.1016/j.compedu.2016.11.010
Kashora, T., van der Poll, H. M., & van der Poll, J. A. (2016). E-learning and technologies for open distance learning in management accounting. Africa Education Review, 13(1), 1–19. https://doi.org/10.1080/18146627.2016.1186863
Kattoua, T., Al-Lozi, M., & Alrowwad, A. (2016). A review of literature on e-learning systems in higher education. International Journal of Business Management & Economic Research, 7(5), 754–762.
Kerimbayev, N., Kultan, J., Abdykarimova, S., & Akramova, A. (2017). LMS Moodle: Distance international education in cooperation of higher education institutions of different countries. Education and Information Technologies, 22(5), 2125–2139. https://doi.org/10.1007/s10639-016-9534-5
Kusumawati, A. J. (2020). Redesigning face-to-face into online learning for speaking competence during COVID-19: ESP for higher education in Indonesia. International Journal of Language Education, 4(2), 276–288. https://doi.org/10.26858/ijole.v4i2.14745
Lin, C. C., Liu, G. Z., & Wang, T. I. (2017). Development and usability test of an e-learning tool for engineering graduates to develop academic writing in English: A case study. Educational Technology and Society, 20(4), 148–161.
Masito, F., Risdianto, E., Oka, I. G. A. A. M., Daryanti, Y., & Fathurrochman, I. (2021). Analysis of online learning system needs based on MOOCs. AL-ISHLAH: Jurnal Pendidikan, 13(2), 953–959. https://doi.org/10.35445/alishlah.v13i2.670
Mpungose, C. B. (2020). Is Moodle or WhatsApp the preferred e-learning platform at a South African university? First-year students’ experiences. Education and Information Technologies, 25(2), 927–941. https://doi.org/10.1007/s10639-019-10005-5
Mulyadi, D., Wijayatiningsih, T. D., Swaran Singh, C. K., & Prastikawati, E. F. (2021). Effects of technology enhanced task-based language teaching on learners’ listening comprehension and speaking performance. International Journal of Instruction, 14(3), 717–736. https://doi.org/10.29333/iji.2021.14342a
Ngo, N. (2019). Understanding the impact of listening strategy instruction on listening strategy use from a socio-cultural perspective. System, 81, 63–77. https://doi.org/10.1016/j.system.2019.01.002
Oanh, T. T. H., & Minh, T. Q. (2018). EFL students’ attitudes towards integrating teaching cross-cultural issues and teaching listening skill. Studies in English Language Teaching, 6(2), 97. https://doi.org/10.22158/selt.v6n2p97
Padayachee, P., Wagner-Welsh, S., & Johannes, H. (2018). Online assessment in Moodle: A framework for supporting our students. South African Journal of Higher Education, 32(5). https://doi.org/10.20853/32-5-2599
Panadero, E., Brown, G. T. L., & Strijbos, J. W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2
Radia, B. (2019). Approaching a reading course via Moodle-based blended learning: EFL learners’ insights. Modern Journal of Language Teaching Methods, 9(11), 1–12. http://mjltm.org/browse.php?a_id=555&slc_lang=en&sid=1&printcase=1&hbnr=1&hmb=1
Rukthong, A. (2021). MC listening questions vs. integrated listening-to-summarize tasks: What listening abilities do they assess? System, 97, 102439. https://doi.org/10.1016/j.system.2020.102439
Sabharwal, R., Chugh, R., Hossain, M. R., & Wells, M. (2018). Learning management systems in the workplace: A literature review. 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), 387–393. https://doi.org/10.1109/TALE.2018.8615158
Sandvik, L. V., Smith, K., Strømme, A., Svendsen, B., Aasmundstad Sommervold, O., & Aarønes Angvik, S. (2021). Students’ perceptions of assessment practices in upper secondary school during COVID-19. Teachers and Teaching, 1–14. https://doi.org/10.1080/13540602.2021.1982692
Tanewong, S. (2019). Metacognitive pedagogical sequence for less-proficient Thai EFL listeners: A comparative investigation. RELC Journal, 50(1), 86–103. https://doi.org/10.1177/0033688218754942
Turnbull, D., Chugh, R., & Luck, J. (2021). Learning management systems: A review of the research methodology literature in Australia and China. International Journal of Research & Method in Education, 44(2), 164–178. https://doi.org/10.1080/1743727X.2020.1737002
Webb, M., & Gibson, D. (2015). Technology enhanced assessment in complex collaborative settings. Education and Information Technologies, 20, 675–695. https://doi.org/10.1007/s10639-015-9413-5
Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers and Education, 163(October 2020), 104097. https://doi.org/10.1016/j.compedu.2020.104097
Xin, N. S., Shibghatullah, A. S., Subaramaniam, K. A., & Wahab, M. H. A. (2021). A systematic review for online learning management system. Journal of Physics: Conference Series, 1874(1), 012030. https://doi.org/10.1088/1742-6596/1874/1/012030
Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72–83. https://doi.org/10.1016/j.learninstruc.2009.01.003