A PROPOSED FRAMEWORK FOR WASHBACK EFFECTS OF E-PORTFOLIOS IN SPEAKING ASSESSMENT
DOI:
https://doi.org/10.63023/2525-2445/jfs.ulis.5406Abstract
This paper aims to propose a framework to explore the washback effects of e-portfolios in speaking assessment. Drawing on multiple theoretical frameworks in washback research, it first reviews classical models of language assessment and illustrates how evolving priorities in language education have led some educators to adopt alternative, technology-driven approaches, notably e-portfolios. The paper then synthesizes prior theoretical foundations alongside empirical studies to identify key stakeholders including students, teachers, and school administrators and their roles in shaping and experiencing washback effects. Building on this synthesis, the paper proposes a framework that shows how stakeholders’ beliefs, attitudes, and practices intersect when e-portfolios are used to assess English speaking skills. Finally, it underlines the framework’s theoretical significance for valid and responsive assessment design and provides pedagogical recommendations for educators and assessment practitioners seeking to implement e-portfolios effectively in diverse instructional contexts.Downloads
References
Abidin, M. (2021). Stakeholders Evaluation on Educational Quality of Higher Education. International Journal of Instruction, 14(3), 287-308. https://doi.org/10.29333/iji.2021.14317a
Ahangari, S., & Akbari Hamed, L. A. (2013). The effect of peer assessment on oral presentation in an EFL context. International Journal of Applied Linguistics & English Literature, 2(3), 45–53. https://doi.org/10.7575/aiac.ijalel.v.2n.3p.45
Alawdat, M. (2013). Using E-portfolios and ESL Learners. US-China Education Review A, 3(5), 339-351. https://files.eric.ed.gov/fulltext/ED543181.pdf
Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied linguistics, 14(2), 115-129. https://doi.org/10.1093/applin/14.2.115
Alqahtani, F. (2021). The impact of language testing washback in promoting teaching and learning processes: A theoretical review. English Language Teaching, 14(7), 21-26. https://doi.org/10.5539/elt.v14n7p21
Athiworakun, C., & Adunyarittigun, D. (2022). Investigating washback effects on teaching: A case study of an exit examination at the higher education level. LEARN Journal: Language Education and Acquisition Research Network, 15(2), 776-801.
Aydin, D. Ü., & Şahin, S. (2024). Washback effect of a national English language teacher field knowledge test for teacher recruitment in Türkiye: A scale development study. Innovational Research in ELT, 5(1), 1-19. https://doi.org/10.29329/irelt.2023.558.1
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice. Oxford: Oxford University Press.
Bailey, K. M. (1996). Working for washback: a review of the washback concept in language testing. Language Testing, 13(3), 257-279. https://doi.org/10.1177/026553229601300303
Bailey, R., & Garner, M. (2010). Is the feedback in higher education assessment worth the paper it is written on? Teachers' reflections on their practices. Teaching in Higher Education, 15(2), 187-198.
Balaban, I. (2020). An empirical evaluation of E-Portfolio critical success factors. International Journal of Emerging Technologies in Learning (iJET), 15(4), 37-52. https://doi.org/10.3991/ijet.v15i04.11757
Banegas, D. L., Corrales, K., & Poole, P. (2020). Can engaging L2 teachers as material designers contribute to their professional development? Findings from Colombia. System, 91, 1-45. https://doi.org/10.1016/j.system.2020.102265
Barrett, H. (2005). Electronic portfolios as digital stories of deep learning. On the Horizon, 13(2), 45-52.
Baturay, M. H. (2015). Online English language learners' perceptions of portfolio assessment. Teaching English with Technology, 15(4), 16-28.
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability (formerly: Journal of personnel evaluation in education), 21, 5-31. https://doi.org/10.1007/s11092-008-9068-5
Brown, H. D. (2004). Language assessment: Principles and classroom practices. NY: Pearson Education.
Brown, H. D., & Abeywickrama, P. (2019). Language assessment: Principles and classroom practices. Pearson.
Canale, M., & Swain, M. (1980). Theoretical bases of com-municative approaches to second language teaching and testing. Applied linguistics, 1(1), 1-47. https://doi.org/https://doi.org/10.1093/applin/1.1.1
Cepik, S., & Yastibas, A. E. (2013). The use of e-portfolio to improve English speaking skill of Turkish EFL learners. The Anthropologist, 16(1-2), 307-317. https://doi.org/10.1080/09720073.2013.11891358
Chak, M.-C. (2024). Washback in language learning strategies under high stakes language testing: A study of the Hong Kong secondary system. rEFLections, 31(1), 1-24. https://doi.org/10.61508/refl.v31i1.269539
Chang, C.-C., Chou, P.-N., & Liang, C. (2018). Using ePortfolio-based learning approach to facilitate knowledge sharing and creation among college students. Australasian Journal of Educational Technology, 34(1), 30-41. https://doi.org/10.14742/ajet.2687
Chang, C. C., Tseng, K. H., Chou, P. N., & Chen, Y. H. (2011). Reliability and validity of web-based portfolio peer assessment: A case study for a senior high school’s students taking computer course. Computers & Education, 57(1), 1306-1316. https://doi.org/10.1016/j.compedu.2011.01.014
Cheng, L., & Curtis, A. (2012). Test impact and washback: Implications for teaching and learning. In C. Coombe, P. Davidson, B. O'Sullivan, & S. Stoynoff (Eds.), Cambridge Guide to Second Language Assessment.
Cook-Sather, A. (2006). Sound, presence, and power:“Student voice” in educational research and reform. Curriculum inquiry, 36(4), 359-390. https://doi.org/10.1111/j.1467-873X.2006.00363.x
Dammak, H., Khatibi, A., & Azam, S. F. (2022). Washback of the high-stakes English Baccalaureate exam: Empirical investigation of 4th English language teachers' attitudes and practices in Tunisia. Journal of Positive School Psychology, 6(5), 5106–5126.
Dawadi, S. (2021). Factors affecting washback of a high-stakes English as a foreign language test. TESL-EJ: The Electronic Journal for English as a Second Language, 25(3).
Dong, M., & Liu, X. (2022). Impact of learners' perceptions of a high-stakes test on their learning motivation and learning time allotment: A study on the washback mechanism. Heliyon, 8(12), 1-9. https://doi.org/10.1016/j.heliyon.2022.e11910
Duong, M. T., & Nguyen, L. T. (2022). An E-portfolio: A promising tool for promoting learners’ autonomous learning competencies in an EFL speaking course. VNU Journal of Foreign Studies, 38(6), 148-159. https://doi.org/10.25073/2525-2445/vnufs.4891
Eagly, A. H., & Chaiken, S. (1998). Attitude Structure and Function. In D. T. Gilbert, S. T. Fiske, & G. Lindzey (Eds.), Handbook of Social Psychology (pp. 269-322). New York: McGraw-Hill.
Europe, C. O. (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge, UK: Cambridge University Press.
Farrell, O. (2020). From portafoglio to eportfolio: The evolution of portfolio in higher education. Journal of Interactive Media in Education, 2020(1), 1-14. https://doi.org/https://doi.org/10.5334/jime.574
Fulcher, G. (2015). Assessing second language speaking. Language Teaching, 48(2), 198-216. https://doi.org/10.1017/S0261444814000391
Galaczi, E., & Taylor, L. (2018). Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly, 15(3), 219-236. https://doi.org/10.1080/15434303.2018.1453816
Ghany, S. A., & Alzouebi, K. (2019). Exploring teacher perceptions of using e-portfolios in public schools in the United Arab Emirates. International Journal of Education & Literacy Studies, 7(4), 180-191. https://doi.org/10.7575/aiac.ijels.v.7n.4p.180
Green, A. (2013). Washback in language assessment. International Journal of English Studies, 13(2), 39-51. https://doi.org/10.6018/ijes.13.2.185891
Hakim, P. K., & Srisudarso, M. (2020). A washback study on portfolio assessment. ELT in Focus, 3(1), 9-14. https://doi.org/10.35706/eltinfc.v3i1.3693
Hallinger, P., Walker, A., Nguyen, D. T. H., Truong, T., & Nguyen, T. T. (2017). Perspectives on principal instructional leadership in Vietnam: a preliminary model. Journal of Educational Administration, 55(2), 222-239. https://doi.org/10.1108/JEA-11-2015-0106
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research, 77(1), 81-112.
Hoyos Pipicano, Y. A. (2024). Exploring standardized tests washback from the decolonial option: Implications for rural teachers and students. Cogent Arts & Humanities, 11(1), 2300200. https://doi.org/10.1080/23311983.2023.2300200
Hughes, A. (1988). Testing for language teachers. Cambridge University Press.
Hughes, A. (2003). Testing for language teachers (2nd ed.). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511732980
Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385-402. https://doi.org/10.1177/0265532208090158
Jonassen, D. H., & Rohrer-Murphy, L. (1999). Activity theory as a framework for designing constructivist learning environments. Educational Technology Research and Development, 47(1), 61-79. https://doi.org/10.1007/BF02299477
Lantolf, J., Thorne, S., & Poehner, M. (2015). Sociocultural Theory and Second Language Development. In B. van Patten & J. Williams (Eds.), Theories in Second Language Acquisition (pp. 207-226). New York: Routledge.
Lasminiar, P. (2022). A Teacher's Experiences on the Use of E-Portfolio as Students' Portfolio Assessment in Teaching Speaking: A Narrative Inquiry. Jurnal Basicedu, 6(3), 3858-3866. https://doi.org/10.31004/basicedu.v6i3.2765
Leithwood, K., & Jantzi, D. (2000). The effects of transformational leadership on organizational conditions and student engagement with school. Journal of Educational Administration, 38(2), 112-129. https://doi.org/10.1108/09578230010320098
Liu, X., & Yu, J. (2021). Relationships between learning motivations and practices as influenced by a high-stakes language test: The mechanism of washback on learning. Studies in Educational Evaluation, 68, 100967.
Luoma, S. (2004). Assessing speaking. Cambridge university press.
Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American psychologist, 52(11), 1187. https://doi.org/10.1037/0003-066X.52.11.1187
Messick, S. (1996). Validity and washback in language testing. Language Testing, 13(3), 241-256.
Muñoz, P., Véliz-Campos, M., & Véliz, L. (2019). Assessment in the English language classroom in Chile: Exploring the washback effect of traditional testing and alternative assessment on seventh grade students. Paideia Revista de Educación,(64), 97-118. https://doi.org/10.29393/Pa64-4APM30004
Nguyen, A. N. T., & Nguyen, H. D. T. (2023). Effects of Teacher’ Feedback on Learners: Perspectives of English Majors at a Private University. Vietnam journal of education, 240-251. https://doi.org/10.52296/vje.2023.317
Nguyen, D. D., Duong, V. C., & Tang, T. H. (2023). Learners’ Feedback in Quality Improvement at VNU National Defense and Security Training Center. VNU Journal of Science: Education Research, 39(1S). https://doi.org/10.25073/2588-1159/vnuer.4843
Nguyen, H. T. M. (2023a). The washback of the International English Language Testing System (IELTS) as an English language proficiency exit test on the learning of final-year English majors. Tesl-Ej, 27(2), 1-34. https://doi.org/10.55593/ej.26106a8
Nguyen, H. T. M. (2023b). The washback of the International English Language Testing System (IELTS) as an English language proficiency exit test on the learning of final-year English majors. Tesl-Ej, 27(2), n2. https://doi.org/10.55593/ej.26106a8
Phung, T. L., & Dang, T. T. (2022). Reconsiderations on the effects e-portfolios on EFL students’ speaking achievement. Journal of Inquiry into Languages and Cultures, 6(1), 60-72. https://doi.org/10.63506/jilc.0601.106
Poole, P., Brown, M., McNamara, G., O’Hara, J., O’Brien, S., & Burns, D. (2018). Challenges and supports towards the integration of ePortfolios in education. Lessons to be learned from Ireland. Heliyon, 4(11), 1-23. https://doi.org/10.1016/j.heliyon.2018.e00899
Pourdana, N., & Tavassoli, K. (2022). Differential impacts of e-portfolio assessment on language learners’ engagement modes and genre-based writing improvement. Language Testing in Asia, 12(1), 1-19. https://doi.org/10.1186/s40468-022-00156-7
Quines, L. A., & Monteza, M. T. (2023). The mediating effect of teacher collegiality on the relationship between instructional leadership and professional development of teachers. European Journal of Education Studies, 10(3), 192-219. https://doi.org/10.46827/ejes.v10i3.4716
Rai, J. K. (2018). Exploring the teacher-administrator relationship in schools: a workshop to build and sustain relationships [Master's Thesis, Vancouver Island University].
Sadeghi, K., Ballıdağ, A., & Mede, E. (2021). The washback effect of TOEFL iBT and a local English Proficiency Exam on students' motivation, autonomy and language learning strategies. Heliyon, 7(10), e08135. https://doi.org/10.1016/j.heliyon.2021.e08135
Safari, M., & Koosha, M. (2016). Instructional efficacy of portfolio for assessing Iranian EFL learners' speaking ability. English Language Teaching, 9(3), 102-116. https://doi.org/10.5539/elt.v9n3p102
Saglam, A. L. G., & Farhady, H. (2019). Can exams change how and what learners learn? Investigating the washback effect of a university English language proficiency test in the Turkish context. Advances in Language and Literary Studies, 10(1), 177-186. https://doi.org/10.7575/aiac.alls.v.10n.1p.177
Saif, S. (2006). Aiming for positive washback: a case study of international teaching assistants. Language Testing, 23(1), 1-34. https://doi.org/10.1191/0265532206lt322oa
Shih, C.-M. (2007). A new washback model of students’ learning. Canadian Modern Language Review, 64(1), 135-161. https://doi.org/10.3138/cmlr.64.1.135
Shijun, C. (2022). Consequences, Impact and Washback of CET Test within Assessment for Use Argument to Validation. International Education Studies, 15(4), 42-57. https://doi.org/10.5539/ies.v15n4p42
Shohamy, E. (2020). The power of tests: A critical perspective on the uses of language tests. Routledge. https://doi.org/10.4324/9781003062318
Shohamy, E., Donitsa-Schmidt, S., & Ferman, I. (1996). Test impact revisited: Washback effect over time. Language Testing, 13(3), 298-317. https://doi.org/10.1177/026553229601300305
Ta, H. T. T., Nguyen, C. H., Le, H. T., Pham, N. T. T., Pham, H. T., & Trinh, N. T. (2023). Survey dataset on student perceptions and experiences of quality assurance in Vietnamese universities. Data Brief, 49, 109305. https://doi.org/10.1016/j.dib.2023.109305
Tong, T. L. C., & Pham, T. H. N. (2024). EFL teaching practices under the washback of high-stakes tests: What aspects are affected? Hue University Journal of Science: Social Sciences and Humanities, 133(6B), 127-146. https://doi.org/10.26459/hueunijssh.v133i6d.7407
Vernon, P. E. (1958). Educational testing and test‐form factors. ETS Research Bulletin Series, 1958(1), i-77. https://doi.org/10.1002/j.2333-8504.1958.tb00079.x
Wiseman, S. (1961). Examinations and English education. Manchester University Press.
Wu, J., & Lee, M. C.-L. (2017). The relationships between test performance and students’ perceptions of learning motivation, test value, and test anxiety in the context of the English benchmark requirement for graduation in Taiwan’s universities. Language Testing in Asia, 7, 1-21. https://doi.org/10.1186/s40468-017-0041-4
Xie, Q., & Andrews, S. (2013). Do test design and uses influence test preparation? Testing a model of washback with Structural Equation Modeling. Language Testing, 30(1), 49-70. https://doi.org/10.1177/0265532212442634
Yujie, G., Albattat, A., & Azar, A. S. (2024). The relationship of transformational leadership and institutional culture of assessment on teacher assessment for learning practices: A mediated-moderated study. Forum for Linguistic Studies, 6(2). https://doi.org/10.0926/Fls.2024541497
Zaim, M., & Arsyad, S. (2020). Authentic Assessment for Speaking Skills: Problem and Solution for English Secondary School Teachers in Indonesia. International Journal of Instruction, 13(3), 587-604. https://doi.org/10.29333/iji.2020.13340a
Zechner, K., & Evanini, K. (2019). Automated speaking assessment: Using language technologies to score spontaneous speech. Routledge.
Zhang, P., & Tur, G. (2022). Educational e-portfolio overview: Aspiring for the future by building on the past. IAFOR Journal of Education, 10(3), 51–74. https://doi.org/10.22492/ije.10.3.03
Zheng, Y., & Barrot, J. S. (2022). Social media as an e-portfolio platform: Effects on L2 learners’ speaking performance. Language Learning & Technology, 26(1), 1-19. https://hdl.handle.net/10125/73487
Zimmerman, B. J., & Schunk, D. H. (2013). Self-regulated learning and academic achievement: Theoretical perspectives (B. J. Zimmerman & D. H. Schunk, Eds. 2nd ed.). Routledge. https://doi.org/10.4324/9781410601032
