Development of a Competency Assessment Tool Using AI and an Academic Achievement Reporting System for the Rayong Education Innovation Area

Abstract

This research aims to: 1) develop a competency assessment tool for learners based on the Rayong MARCO curriculum framework using Artificial Intelligence (AI); 2) develop an information system for reporting academic achievement in pilot schools in the Rayong Educational Innovation Area; 3) assess the effectiveness of the competency assessment system based on the Rayong MARCO curriculum framework using AI; 4) evaluate the performance of the academic achievement reporting system in the pilot schools; and 5) examine user satisfaction with the competency assessment system and its integration with the reporting information system. The sample group included 102 participants, consisting of the Rayong Educational Innovation Area steering committee, educational supervisors, school administrators, and teachers from the pilot schools. The research and development process was divided into four phases: (1) data and needs analysis, (2) design of data processing and output display database, (3) development of the information system and AI-based data processing, and (4) system testing and evaluation of performance and user satisfaction. The findings show that the developed competency assessment tool for learners, based on the Rayong MARCO curriculum framework, successfully assessed multiple-choice, open-ended, and voice-based answers. AI was used to process and transfer data via the LINE messaging system to the information system for real-time reporting. The competency assessment system demonstrated 100% accuracy in processing high-quality multiple-choice answer sheets, 97.50% accuracy in medium-quality answer sheets, 99% accuracy for high-quality handwritten responses, and 93.20% accuracy for medium-quality handwritten responses. The information system for reporting academic achievement was highly effective (M=3.50), with user satisfaction also rated high (M=3.59). The Rayong MARCO-based competency assessment system using AI has significantly contributed to solving academic achievement issues in real-time, enabling timely interventions for students who have not met performance standards.