Development and Preliminary Validation of a CEFR-Aligned Evaluation Checklist for Job Application Writing
Article Sidebar
Main Article Content
Abstract
This study presents the development and preliminary validation of the Job Application Writing Evaluation Checklist (JAWEC), a CEFR-aligned instrument designed to assess job application letters produced by graduating university students in an English for Professional Purposes (EPP) course. Although the Common European Framework of Reference for Languages (CEFR) has been extensively applied to academic writing assessment, its application to professional writing genres, such as job application letters, remains underexplored. To address this gap, the JAWEC was developed through the integration of CEFR B2+ descriptors, established genre frameworks for job application writing, and established principles of checklist-based assessment design. The instrument was refined through expert consultation to ensure content relevance, clarity, and applicability. To provide preliminary empirical support, the JAWEC was piloted with 25 student-produced job application letters independently assessed by two experienced EPP instructors. Inter-rater reliability analysis revealed good agreement, suggesting that the instrument can be applied with reasonable consistency across raters in this pilot context. The results suggest that the JAWEC provides a theoretically grounded and pedagogically practical instrument for formative and summative assessment of job application writing, with the potential to enhance feedback practices and support students’ workplace communication readiness.
Article Details
References
Andrade, H., & Du, Y. (2007). Student responses to criteria‐referenced self‐assessment. Assessment & Evaluation in Higher Education, 32(2), 159–181. https://doi.org/10.1080/02602930600801928
Aziz, S., Mansor, N., & Saad, S. (2023). An analysis of errors in resumes and job application letters: The study of Malaysian Undergraduate students. International Journal of Advanced Research in Education and Society. https://doi.org/10.55057/ijares.2023.5.4.7
Bhatia, V. K. (1993). Analysing genre: Language use in professional settings. Longman.
Boud, D., & Soler, R. (2015). Sustainable Assessment Revisited. Assessment & Evaluation in Higher Education, 41, 400-413. https://doi.org/10.1080/02602938.2015.1018133
Cadiao, E. C. H. (2022). An analysis of the physical elements and rhetorical moves in application letters of Filipinos and Thais. International Journal of Research Publication and Reviews, 1698–1704. https://doi.org/10.55248/gengpi.2022.3.8.50
Council of Europe. (2020). Common European Framework of Reference for Languages: Learning, teaching, assessment—Companion volume. Council of Europe Publishing. http://www.coe.int/lang-cefr
De Mello, G., Krishnan, I. A., Arumugam, N., Ibrahim, M. N. a. B., Ma’mor, M. S. H. @., & Ramalingam, S. (2021). Schematic analysis of job application letters by Malaysian graduates. Australian Journal of Career Development, 30(1), 72–79. https://doi.org/10.1177/1038416221994208
Ferris, D. R. (2003). Response to Student Writing: Implications for Second Language Students. Lawrence Erlbaum Associates.
JobStreet. (2022, May 25). What is a cover letter? Benefits and dos & don’ts for job applications. https://www.jobstreet.com.my/career-resources/job-hunting/analyzing-avoiding-common-cover-letter-errors/
Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144.
Khan, A., & Tin, T. B. (2012). Generic patterns in application letters: The context of Pakistan. RELC Journal, 43(3), 393–410. https://doi.org/10.1177/0033688212463277
McGrath, I. (2016). Materials evaluation and design for language teaching. Edinburgh University Press. https://doi.org/10.1515/9780748694822
Ministry of Education Malaysia. (2015). English language education reform in Malaysia: The roadmap 2015-2025. Kementerian Pendidikan Malaysia.
North, B., & Piccardo, E. (2016). Developing illustrative descriptors of aspects of mediation for the Common European Framework of Reference (CEFR). Language Teaching, 49(3), 1–5. https://doi.org/10.1017/S0261444816000100
Panadero, E., & Jonsson, A. (2013). The use and design of rubrics to support assessment for learning. In D. Carless, S. Bridges, C. Chan, & R. Glofcheski (Eds.), Scaling up assessment for learning in higher education (pp. 99–111). Springer.
Panadero, E., Jonsson, A., Pinedo, L., & Fernández-Castilla, B. (2023). Effects of rubrics on academic performance, self-regulated learning, and self-efficacy: A meta-analytic review. Educational Psychology Review, 35, 113. https://doi.org/10.1007/s10648-023-09823-4
Paramasivam, S., & Rahim, M. I. (2016). Genre analysis of job application letters in Malaysia. The Asian ESP Journal, 12(2), 144-170.
Read, J. (2019). The influence of the Common European Framework of Reference (CEFR) in the Asia-Pacific region. LEARN Journal: Language Education and Acquisition Research Network, 12(1), 12–18. https://files.eric.ed.gov/fulltext/EJ1225686.pdf
Rohayati, D. (2018). Moves analysis of application letters written by agribusiness students. JALL (Journal of Applied Linguistics and Literacy), 2(1), 1-7. https://doi.org/10.25157/jall.v2i1.2184
Ting, S., Marzuki, E., Chuah, K., Misieng, J., & Jerome, C. (2017). Employers’ views on importance of English proficiency and communication skill for employability in Malaysia. Indonesian Journal of Applied Linguistics, 7(2), 315-327. https://doi.org/10.17509/ijal.v7i2.8132
Tongpoon-Patanasorn, A., & Thumnong, P. (2020). Move and politeness strategies in job application letters in ASEAN context. LEARN Journal: Language Education and Acquisition Research Network, 13(2), 105-125.
Upton, T. A., & Connor, U. (2001). Using computerized corpus analysis to investigate the textlinguistic discourse moves of a genre. English for Specific Purposes, 20(4), 313–329. https://doi.org/10.1016/s0889-4906(00)00022-3
Vasileiadou, D., & Karadimitriou, K. (2021). Examining the impact of self-assessment with the use of rubrics on primary school students’ performance. International Journal of Educational Research Open, 2(2), 100031. https://doi.org/10.1016/j.ijedro.2021.100031
Yan, Z., Lao, H., Panadero, E., Fernández-Castilla, B., Yang, L., & Yang, M. (2022). Effects of self-assessment and peer-assessment interventions on academic performance: A meta-analysis. Educational Research Review, 37, 100484. https://doi.org/10.1016/j.edurev.2022.100484
