Automated writing evaluation system for feedback in the digital world: an online learning opportunity for English as a foreign language students

Abstract

It is imperative to use new technologies in a supportive manner to meet the learners’ and teachers’ demanding needs as educational environments change in the digital age. The continuous expansion of online learning and distance education opportunities responds to the demands of learners and teachers while pioneering the use of technology in education. One advancement in English language teaching and learning in online environments, which assists teachers in reducing their workload and providing students with instant digital feedback, is the automated writing evaluation (AWE) tools. To gain a deeper understanding of the potential and limitations of these digital tools, this study aims to investigate the effectiveness of AWE feedback in error reduction in writing in English and the explore views of students regarding the utility of AWE tools. For this purpose, a total of 38 students at a university in Turkiye participated in the study, and three of their essays were evaluated. Within a concurrent triangulation mixed-method design, the changes in errors of the experimental group (n=18) receiving AWE feedback, and the control group (n=20) receiving teacher feedback were analyzed quantitatively, and the written reflection reports and semi-structured interviews conducted with the students were analyzed qualitatively. The results indicated that teacher feedback and AWE feedback were both effective in reducing errors in 11 categories. AWE feedback appeared to minimize errors in mechanics and usage more efficiently and teacher feedback was required more in content and organization issues. As a result, AWE was found as a complementary and effective tool supporting the improvement of target language writing skills saving time and energy for teachers. Furthermore, students expressed positive views regarding the use of AWE despite minor limitations. The findings of this study in general sheds light on using online digital tools of ubiquitous nature such as AWE to assist language improvement outside the class.