Development and Validation of an Instrument to Evaluate Constructs for Integrating AI Into ELT
Development and Validation of an Instrument to Evaluate Constructs for Integrating AI Into ELT

Summary/Abstract: The COVID-19 pandemic has transformed teaching and learning in ESLeducation, particularly through the integration of artificial intelligence (AI)technologies into current English Language Teaching (ELT) practices. However,to ensure the seamless integration of these technologies into ELT practices, aproper framework needs to be developed and validated for future reference byESL educators. Hence, this study aims to develop and validate the proposedconstructs for the framework, using the Content Validity Index (CVI) methodwith assistance from six experts. Eleven constructs were identified from previousstudies, with seven derived from the AI-TPACK framework and four from theFramework for Teaching. These constructs are categorised into three domains:Technological Proficiency, Pedagogical Compatibility, and Social Awareness. Thedata were analysed using the CVI method. The results show that the S-CVI/Ave value was 0.91, meeting the satisfactory CVI threshold for six experts(>0.83). However, the S-CVI/UA value was 0.73, which does not meet theacceptable CVI value (>0.83). As a result, 10 items with an S-CVI/UA lessthan 0.83 were removed. Additionally, two more items were excluded due totheir constructs having insufficient valid items, with only one item remaining ineach construct. Following these amendments, both the S-CVI/Ave and S-CVI/UA values improved to 0.99 and 0.91, respectively. The study proves that thecontent validity process is crucial to ensuring a reliable and valid instrument fordeveloping a framework for integrating AI into the ELT practices.

• Details
• Contents