Beyond the Euphoria: A Balinese-AI User Interface for Assessing Character, Thought, and Action in Tourism Schools
Beyond the Euphoria: A Balinese-AI User Interface for Assessing Character, Thought, and Action in Tourism Schools

Summary/Abstract: This study aims to design, develop, and validate a culturally embedded, AI-driven e-assessment user interface (UI) that accurately measures these three competencies while preserving local wisdom. Following the full ten-stage Borg & Gall research and development framework, the research encompassed literature review, needs analysis, initial UI prototyping, and two rigorous empirical testing phases. The Alpha Test involved 2 informatics experts, 2 educational experts, 15 evaluators, and 45 teachers; the Beta Field Trial engaged 2 informatics experts, 2 educational experts, 30 evaluators, and 65 teachers from five tourism vocational high schools in Bali. The data used in this research were gathered from several sources: Tests of functionality, heuristic evaluations, the system usability scale (SUS), the technological acceptance model (TAM) questionnaires, structured observations, and detailed interviews. The Alpha Test results yielded a mean score of 89.23% (excellent), and improvements were made to the AI model’s accuracy, the richness of scenarios, and the API’s security, as well as the addition of an explainable AI (XAI) reasoning panel. The Field Trial results yielded an almost identical mean score of 89.20%, and the TAM scores for perceived usefulness and perceived ease of use were also 89.20%. The validated prototype demonstrates that AI design with a culturally centered, responsive approach will not only deliver superior acceptance and usability but also shift the modernization euphoria paradigm toward culturally responsive design.

• Details
• Contents