“I am now satisfied with all changes ...”: a corpus analysis of self-mentions in transparent peer review reports across review rounds
Main Article Content
Abstract
This study explored how interpersonal communication is established between parties involved in transparent peer review reports (TPR). Although traditional peer review is a long-standing practice, TPR is considered an emerging genre because the recent institutional practice of making reports publicly accessible alters the rhetorical context and the reviewer’s authorial visibility compared to traditional ‘hidden’ reviews. In this study, we investigated how reviewers construct their authorial identity in the TPR genre through self-mentions. To this end, we used corpus tools to examine 150 TPRs on the same published articles across three consecutive rounds. The findings show that reviewers employed self-mentions to fulfill a range of rhetorical functions, from highlighting flaws and requesting clarifications to suggesting structural changes, expressing approval, and offering praise. Additionally, the data suggest that reviewers tend to be more critical in the initial review rounds, gradually adopting a more appreciative tone in subsequent rounds. Based on the results of the study, we offer pedagogical implications for reviewer training sessions, exploring how transparency and constructive criticism are conveyed through language, thereby contributing to a healthier discourse in the scientific community. We suggest that analyzing these changes through the lens of English for Specific Purposes (ESP) offers valuable insights into the specialized language and discourse patterns emerging within these contexts.
Article Details
References
Akbaş, E., Sönmez, D., & Tekin, M. (2023, December 27). Corpus of Transparent Peer Review (Version #1). [Data Set]. Mendeley Data. https://doi.org/10.17632/3zcx3xdgp5.1
Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Longman grammar of spoken and written English. Pearson Education.
Breeze, R., & Gerns, P. (2024). Open versus traditional referee reports: Performing criticism in digital peer reviewing genres. In A. Curado Fuentes, M. Rico García, & L. Fielden Burns (Eds.), Exploring open science in applied linguistics: Reviews and case studies (pp. 110-126). Applied Linguistics Press.
Bornmann, L., Herich, H., Joos, H., & Daniel, H. D. (2012). In public peer review of submitted manuscripts, how do reviewer comments differ from comments written by interested members of the scientific community? A content analysis of comments written for atmospheric chemistry and physics. Scientometrics, 93(3), 915-929. https://doi.org/10.1007/s11192-012-0731-8
Chong, S. W., & Gao, A. L. (2024). Introduction. In S. W. Chong, & A. L. Gao (Eds), Developing feedback literacy for academic journal peer review: Narratives from researchers in education and applied Lnguistics (pp. 1-17). Routledge. https://doi.org/10.4324/9781003365662
Coniam, D. (2012). Exploring reviewer reactions to manuscripts submitted to academic journals. System, 40(4), 544-553.
https://doi.org/10.1016/j.system.2012.10.002
Englander, K., & López-Bonilla, G. (2011). Acknowledging or denying membership: Reviewers’ responses to non-anglophone scientists’ manuscripts. Discourse Studies, 13(4), 395–416. https://doi.org/10.1177/1461445611403261
Feak, C. B. (2009). Negotiating publication: Author responses to peer review of medical research articles in thoracic surgery. Revista Canaria de Estudios Ingleses, 59, 17–34.
Fortanet, I. (2008). Evaluative language in peer review referee reports. Journal of English for Academic Purposes, 7(1), 27-37.
http://dx.doi.org/10.1016/j.jeap.2008.02.004
He, Y., Tian, K., & Xu, X. (2023). A validation study on the factors affecting the practice modes of open peer review. Scientometrics, 128, 587–607. https://doi.org/10.1007/s11192-022-04552-x
Hewings, M. (2004). An ‘important contribution’ or ‘tiresome reading’? A study of evaluation in peer reviews of journal article submissions. Journal of Applied Linguistics, 1, 247–274. https://utppublishing.com/doi/10.1558/japl.v1.i3.247
Hyland, K. (2002a). Directives: Argument and engagement in academic writing. Applied Linguistics, 23(2), 215-239. https://doi.org/10.1093/applin/23.2.215
Hyland, K. (2002b). Authority and invisibility: Authorial identity in academic writing. Journal of Pragmatics, 34, 1091-1112.
https://doi.org/10.1016/S0378-2166(02)00035-8
Hyland, K. (2005). Stance and engagement: A model of interaction in academic discourse. Discourse studies, 7(2), 173-192. https://doi.org/10.1177/1461445605050365
Hyland, K. (2012). Individuality or conformity? Identity in personal and university academic homepages. Computers and Composition, 29(4), 309-322. https://doi.org/10.1016/j.compcom.2012.10.002
Hyland, K. (2020). Peer review: Objective screening or wishful thinking?. Journal of English for Research Publication Purposes, 1(1), 51-65.
Hyland, K. (2023). Open Science: What’s not to like?. Ibérica, (46), 23–32. https://doi.org/10.17398/2340-2784.46.23
Hyland, K., & Jiang, F. K. (2020). “This work is antithetical to the spirit of research”: An anatomy of harsh peer reviews. Journal of English for Academic Purposes, 46, 100867.
https://doi.org/10.1075/jerpp.19010.hyl?locatt=mode:legacy
Kourilová, M. (1998). Communicative characteristics of reviews of scientific papers written by non-native users of English. Endocrine Regulations, 32, 107-114.
Lin, Y. (2024). ‘‘We agree completely with the reviewer, but…”: Stance in author rebuttal letters for journal manuscript reviews. English for Specific Purposes, 73, 159-171.
https://doi.org/10.1016/j.esp.2023.10.004
Moreno, A. I., & Suárez, L. (2008). A study of critical attitude across English and Spanish academic book reviews. Journal of English for Academic purposes, 7(1), 15-26. https://doi.org/10.1016/j.jeap.2008.02.009
Mulligan, A., Hall, L., & Raphael, E. (2013). Peer review in a changing world: An international study measuring the attitudes of researchers. Journal of American Society for Information Science and Technology, 64, 132–161. https://doi.org/10.1002/asi.22798
Mühlhäusler, P., & Harré, R. (1990). Pronouns and people: The linguistic construction of social and personal identity. Oxford.
Paltridge, B. (2017). The discourse of peer review: Reviewing submissions to academic journals. Palgrave Macmillan. https://doi.org/10.1057/978-1-137-48736-0
Paltridge, B. (2020). Engagement and reviewers’ reports on submissions to academic journals. Journal of English for Research Publication Purposes, 1(1), 4–27. https://doi.org/10.1075/jerpp.19007.pal
Paltridge, B. (2024). Language in manuscript reviewing. Reference Module in Social Sciences. (1-6). https://doi.org/10.1016/B978-0-323-95504-1.00070-3
Samraj, B. (2021). Variation in interpersonal relations in manuscript reviews with different recommendations. English for Specific Purposes, 62, 70-83. https://doi.org/10.1016/j.esp.2020.12.003
Starfield, S., & Paltridge, B. (2019). Journal editors: Gatekeepers or custodians?. In P. Habibie, & K. Hyland (Eds), Novice Writers and Scholarly Publication (pp. 253-270). Palgrave Macmillan. https://doi.org/10.1007/978-3-319-95333-5_14
Sönmez, D., & Akbaş, E. (2023). 'Great work folks!': establishing interpersonal communication through politeness strategies in transparent peer reviews of research articles, Ibérica, 46, 69-95. https://doi.org/10.17398/2340-2784.46.69
Tang, R., & John, S. (1999). The ‘I’ in identity: Exploring writer identity in student academic writing through the first-person pronoun. English for Specific Purposes, 18, S23-S39.
https://doi.org/10.1016/S0889-4906(99)00009-5
Vicente-Saez, R., & Martinez-Fuentes, C. (2018). Open science now: A systematic literature review for an integrated definition. Journal of Business Research, 88, 428-436.
https://doi.org/10.1016/j.jbusres.2017.12.043
Wang, P., You, S., Manasa, R., & Wolfram, D. (2017). Open peer review in scientific publishing: A web mining study of authors and reviewers. Journal of data and information science, 1(4), 60-80. https://doi.org/10.20309/jdis.201625
Yakhontova, T., & Franko, I. (2019). ‘The authors have wasted their time…’: Genre features and language of anonymous peer reviews. Topics in Linguistics, 20(2), 67–89. https://doi.org/10.2478/topling-2019-0010