Cognitive skills of secondary school students: A tentative model and an online test

Abstract

The current research endeavour aimed to 1) develop a measurement model, 2) develop an online test, and 3) evaluate the quality of a cognitive skills test. The developed online test was assessed by a trial with a sample group consisting of 1,299 secondary students. The results showed that the cognitive skills measurement model consisted of 1) critical thinking, with 3 indicators (quantitative critical thinking, verbal critical
thinking, and social situations), and 2) creative problem solving, with 3 indicators (mess finding, problem finding, and solution finding). Tests for each level consisted of 2 sub scales, which were 1) critical thinking, in the form of multiple-choice questions, and a situation test, 60 items overall, which were scored by computer, and 2) creative problem solving, in the form of 10 essay-type questions, which were scored by 3 evaluators. For quality of the cognitive skills test based on a classical test theory, the discrimination index (r) was mostly medium, while the difficulty index (p) was
moderate and quite difficult, respectively. The reliability index was .79 and .86, respectively. The results of the test validation based on Multidimensional Item Response Theory revealed that the cognitive skills tests for both grades appeared to be multidimensional as follows. The results on each item showed that most questions possessed a medium discrimination parameter and difficulty parameter. Also, the confirmatory factor analysis suggested that the cognitive skill model for students in both grades possessed construct validity.