Human versus machine feedback: The contributions of Automated Writing Evaluation (AWE) tools to writing quality and self-regulation of language learners.
Human versus machine feedback: The contributions of Automated Writing Evaluation (AWE) tools to writing quality and self-regulation of language learners.

Summary/Abstract: This study explored how feedback from teachers and Grammarly Premium, an Automated Writing Evaluation (AWE) system, impacts intermediate-level Eng- lish as Foreign Language (EFL) learners. A mixed-methods approach was imple- mented with 50 students, split into control and experimental groups. Both groups were assessed using the IELTS General Writing Task 1 (2021) and a self- regulation questionnaire. During the study, the control group received teacher feedback, while the experimental group got personalized Grammarly feedback on grammar, vocabulary, and clarity. After the one-month intervention, both groups completed a new writing task similar to the IELTS General Writing Task 1 (2021) as well as self-regulation questionnaire. Results showed significant im- provements in writing skills and self-regulation among the participants of the experimental group. In particular, it was found AWE benefited students in ‘ef- fort’ and ‘self-monitoring’ dimensions of self-regulation. The results of qualita- tive analysis demonstrated that AWE is noticeably beneficial for ‘Understanding mistakes and correction’. It was also revealed that students’ ‘desired for precise issue pinpointing’ as the most articulated concern, entailing the fact that AWE might lack transparency and details and needs more clarification.

• Details
• Contents