Developing an Online Formative Assessment Instrument for Listening Skill through LMS

Main Article Content

Joko Slamet
Nur Mukminatien

Abstract

Traditional methods of assessing listening skills in language learners suffer from drawbacks such as subjectivity, inconsistency, and time-intensive grading processes. To overcome these limitations, we introduce an innovative assessment instrument designed to efficiently and effectively evaluate students’ listening skills while offering instructors a dependable means to track progress. This study proposes the development of an online assessment instrument tailored to measure language learners’ comprehension of spoken language. The two instruments incorporate a questionnaire and a variety of question formats, each gauging students’ grasp of spoken discourse across diverse contexts and accents. Additionally, the online assessment assesses their proficiency in identifying main ideas, supporting details, and inferred implications within spoken communication. Accessible through a dedicated learning management system (LMS) platform available at http://lms.elsida.ac.id/, this instrument empowers instructors with a robust mechanism to gauge their students’ advancement. By providing a thorough assessment of listening skills, the instrument stands as a powerful resource for educators seeking to drive ongoing improvement. The study’s findings highlight how this assessment instrument can improve language learning through ongoing feedback. Through ongoing enhancements and testing in language learning contexts, the instrument contributes to a more effective evaluation of listening skills in language education.

Article Details

How to Cite
Slamet, J. ., & Mukminatien, N. . (2024). Developing an Online Formative Assessment Instrument for Listening Skill through LMS. LEARN Journal: Language Education and Acquisition Research Network, 17(1), 188–211. Retrieved from https://so04.tci-thaijo.org/index.php/LEARN/article/view/270382
Section
Research Articles
Author Biographies

Joko Slamet, Faculty of Letters, Universitas Negeri Malang

A doctorate student in ELT at Universitas Negeri Malang, Indonesia. His main research interests include English Language Teaching, Linguistics, ESP, Technology in Language Learning, and Research & Development (R&D). ORCID ID: 0000-0002-8676-8525.

Nur Mukminatien, Faculty of Letters, Universitas Negeri Malang

A professor in English Language Teaching at Universitas Negeri Malang, East Java, Indonesia. Her interest in teaching and research is Writing. She has actively participated in Teacher Certification Program as a national trainer for pre-service and in-service teacher training.

References

Bai, Y., Mo, D., Zhang, L., Boswell, M., & Rozelle, S. (2016). The impact of integrating ICT with teaching: Evidence from a randomized controlled trial in rural schools in China. Computers & Education, 96, 1–14. https://doi.org/10.1016/j.compedu.2016.02.005

Bervell, B., & Arkorful, V. (2020). LMS-enabled blended learning utilization in distance tertiary education: Establishing the relationships among facilitating conditions, voluntariness of use and use behaviour. International Journal of Educational Technology in Higher Education, 17(6), 1–16. https://doi.org/10.1186/s41239-020-0183-9

Brown, G. T. L., Andrade, H. L., & Chen, F. (2015). Accuracy in student self-assessment: Directions and cautions for research. Assessment in Education: Principles, Policy & Practice, 22(4), 444–457. https://doi.org/10.1080/0969594X.2014.996523

Chen, J., & Zhang, L. J. (2019). Assessing student-writers’ self-efficacy beliefs about text revision in EFL writing. Assessing Writing, 40(March), 27–41. https://doi.org/10.1016/j.asw.2019.03.002

Dai, Z., Xiong, J., Zhao, L., & He, X. (2022). The effectiveness of ICT-enhanced teaching mode using activity theory on raising class interaction and satisfaction in an engineering course. Interactive Learning Environments, 1–20. https://doi.org/10.1080/10494820.2022.2086574

Ferreira, H., de Oliveira, G. P., Araújo, R., Dorça, F., & Cattelan, R. (2019). Technology-enhanced assessment visualization for smart learning environments. Smart Learning Environments, 6(1). https://doi.org/10.1186/s40561-019-0096-z

Fulcher, G. (2015). Re-examining language testing. Routledge. https://doi.org/10.4324/9781315695518

Hwang, G.-J., Hsu, T.-C., Lai, C.-L., & Hsueh, C.-J. (2017). Interaction of problem-based gaming and learning anxiety in language students’ English listening performance and progressive behavioral patterns. Computers & Education, 106, 26–42. https://doi.org/10.1016/j.compedu.2016.11.010

Kashora, T., van der Poll, H. M., & van der Poll, J. A. (2016). E-learning and technologies for open distance learning in management accounting. Africa Education Review, 13(1), 1–19. https://doi.org/10.1080/18146627.2016.1186863

Kattoua, T., Al-Lozi, M., & Alrowwad, A. (2016). A review of literature on e-learning systems in higher education. International Journal of Business Management & Economic Research, 7(5), 754–762.

Kerimbayev, N., Kultan, J., Abdykarimova, S., & Akramova, A. (2017). LMS Moodle: Distance international education in cooperation of higher education institutions of different countries. Education and Information Technologies, 22(5), 2125–2139. https://doi.org/10.1007/s10639-016-9534-5

Kusumawati, A. J. (2020). Redesigning face-to-face into online learning for speaking competence during COVID-19: ESP for higher education in Indonesia. International Journal of Language Education, 4(2), 276–288. https://doi.org/10.26858/ijole.v4i2.14745

Lin, C. C., Liu, G. Z., & Wang, T. I. (2017). Development and usability test of an e-learning tool for engineering graduates to develop academic writing in English: A case study. Educational Technology and Society, 20(4), 148–161.

Masito, F., Risdianto, E., Oka, I. G. A. A. M., Daryanti, Y., & Fathurrochman, I. (2021). Analysis of online learning system needs based on MOOCs. AL-ISHLAH: Jurnal Pendidikan, 13(2), 953–959. https://doi.org/10.35445/alishlah.v13i2.670

Mpungose, C. B. (2020). Is Moodle or WhatsApp the preferred e-learning platform at a South African university? First-year students’ experiences. Education and Information Technologies, 25(2), 927–941. https://doi.org/10.1007/s10639-019-10005-5

Mulyadi, D., Wijayatiningsih, T. D., Swaran Singh, C. K., & Prastikawati, E. F. (2021). Effects of technology enhanced task-based language teaching on learners’ listening comprehension and speaking performance. International Journal of Instruction, 14(3), 717–736. https://doi.org/10.29333/iji.2021.14342a

Ngo, N. (2019). Understanding the impact of listening strategy instruction on listening strategy use from a socio-cultural perspective. System, 81, 63–77. https://doi.org/10.1016/j.system.2019.01.002

Oanh, T. T. H., & Minh, T. Q. (2018). EFL students’ attitudes towards integrating teaching cross-cultural issues and teaching listening skill. Studies in English Language Teaching, 6(2), 97. https://doi.org/10.22158/selt.v6n2p97

Padayachee, P., Wagner-Welsh, S., & Johannes, H. (2018). Online assessment in Moodle: A framework for supporting our students. South African Journal of Higher Education, 32(5). https://doi.org/10.20853/32-5-2599

Panadero, E., Brown, G. T. L., & Strijbos, J. W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830. https://doi.org/10.1007/s10648-015-9350-2

Radia, B. (2019). Approaching a reading course via Moodle-based blended learning: EFL learners’ insights. Modern Journal of Language Teaching Methods, 9(11), 1–12. http://mjltm.org/browse.php?a_id=555&slc_lang=en&sid=1&printcase=1&hbnr=1&hmb=1

Rukthong, A. (2021). MC listening questions vs. integrated listening-to-summarize tasks: What listening abilities do they assess? System, 97, 102439. https://doi.org/10.1016/j.system.2020.102439

Sabharwal, R., Chugh, R., Hossain, M. R., & Wells, M. (2018). Learning management systems in the workplace: A literature review. 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), 387–393. https://doi.org/10.1109/TALE.2018.8615158

Sandvik, L. V., Smith, K., Strømme, A., Svendsen, B., Aasmundstad Sommervold, O., & Aarønes Angvik, S. (2021). Students’ perceptions of assessment practices in upper secondary school during COVID-19. Teachers and Teaching, 1–14. https://doi.org/10.1080/13540602.2021.1982692

Tanewong, S. (2019). Metacognitive pedagogical sequence for less-proficient Thai EFL listeners: A comparative investigation. RELC Journal, 50(1), 86–103. https://doi.org/10.1177/0033688218754942

Turnbull, D., Chugh, R., & Luck, J. (2021). Learning management systems: A review of the research methodology literature in Australia and China. International Journal of Research & Method in Education, 44(2), 164–178. https://doi.org/10.1080/1743727X.2020.1737002

Webb, M., & Gibson, D. (2015). Technology enhanced assessment in complex collaborative settings. Education and Information Technologies, 20, 675–695. https://doi.org/10.1007/s10639-015-9413-5

Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers and Education, 163(October 2020), 104097. https://doi.org/10.1016/j.compedu.2020.104097

Xin, N. S., Shibghatullah, A. S., Subaramaniam, K. A., & Wahab, M. H. A. (2021). A systematic review for online learning management system. Journal of Physics: Conference Series, 1874(1), 012030. https://doi.org/10.1088/1742-6596/1874/1/012030

Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72–83. https://doi.org/10.1016/j.learninstruc.2009.01.003