DEVELOPMENT OF AN ATTITUDE SCALES FOR TEACHING PROFESSION BASED ON MULTIDIMENSIONAL ITEM RESPONSE MODEL: MULTIDIMENSIONAL COMPUTERIZED ADAPTIVE TESTING

Authors

  • ชญารัตน์ บุญพุฒิกร, เสรี ชัดแช้ม, ปิยะทิพย์ ประดุจพรม

Keywords:

Attitude scales for teaching profession, Multidimensional item response model, Multidimensional computerized adaptive testing

Abstract

The purposes of this research were 1) to develop an attitude scale for the teaching profession based on the multidimensional item response model (ASTP-MIRT), 2) to construct an item bank for the attitude scale, 3) to develop an attitude scale for the teaching profession based on multidimensional computerized adaptive testing (ASTP-MCAT), and 4) to study the relationship between the estimation results from ASTP-MCAT and the those from testing by using all items in the item bank. The sample was 952 fourth year undergraduate students in the Faculty of Education, academic year 2017 from 17 public educational institutions, derived by multi-stage random sampling.

            The results were as follows:

  1. The ASTP-MIRT consisted of 97 items in three dimensions: cognitive, affective, and behavioral. The reliability analyzed by EAP Reliability was equally to .935, .953, and .960, respectively. The construct validity by the Multidimensional Between-Items Model of ASTP-MIRT was more appropriate than the Composite Approach Model, and the Consecutive Approach. The Model was in accordance with the empirical data (x2= 70.37, = 69, = .43, = 0.00). The interpretation criteria of the developed scale consisted of percentile rank, z-score, T-score, and stanine by teacher attitudes and is divided into five levels (very high, high, moderate, low, and very low).
  2. The item bank was divided into three sub-item banks including 31 cognitive items, 32 affective items, and 34 behavioral items.
  3. The ASTP-MCAT was judged to be acceptable at a high level.
  4. The correlation coefficient between teaching profession attitudes from the ASTP-MCAT and the test using the whole item bank showed a positive relationship, 0.34 (p<.05).

References

ข้อบังคับคุรุสภาว่าด้วยจรรยาบรรณของวิชาชีพ. (2556, 4 ตุลาคม). ราชกิจจานุเบกษา. หน้า 72-74.

สุชาดา สกลกิจรุ่งโรจน์, เสรี ชัดแช้ม และ ม.ร.ว. สมพร สุทัศนีย์. (2558). การพัฒนาโปรแกรม การทดสอบแบบปรับเหมาะด้วยคอมพิวเตอร์ สาหรับมาตรวัดความสุขของคนไทย. วิทยาการวิจัยและวิทยาการปัญญา, 13(1), 1-17

Adams, R. J., Wilson, M., & Wang, W. C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1-23.

Allen, D. D., & Wilson, M. (2006). Introducing multidimensional item response modeling in health behavior and health education research. Health Education Research, 21(suppl_1), i73-i84.

De Ayala, R. J. (2009). The Theory and Practice of Item Response Theory. New York: The Guildford Press.

Edmonds, W. A., & Kennedy, T. D. (2017). An applied reference guide to research designs: Quantitative, qualitative, and mixed methods (2nded.). Thousand Oaks, California: Sage Publications.

Embetson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, New York: Lawrence Erlbaum.

Frey, A., & Seitz, N. N. (2009). Multidimensional adaptive testing in educational and psychological measurement: Current state and future challenges. Studies in Educational Evaluation, 35(2), 89-94.

Garcia Nascimento Graveto, J. M., Martins Cardoso, R. J., & Dias Zamith Silva, F. A. (2015). Construction and Validation of the Escala de Comportamentos de Abordagem aos Média por Enfermeiros (Scale of Media Use Behaviours by Nurses). Revista de Enfermagem Referência, 4(7), 61-70.

Gravetter, F. J., & Forzano, L. B. (2012). Research Methods for the Behavioral Sciences (4th ed.). Canada: Wadsworth Cengage Learning.

Hajjar, S. T. E. (2018). Statistica analysis: Internal- consistency reliability and construct validity. International Journal of Quantitative and Qualitative Research Methods, 6(1), 46-57.

Hogg, M. A., & Cooper, J. (Eds.). (2003). The Sage handbook of social psychology. New York: Psychology Press.

Kuo, B. C., Daud, M., & Yang, C. W. (2015). Multidimensional computerized adaptive testing for Indonesia junior high school biology. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 1105-1118.

Maio, G., & Haddock, G. (2014). The psychology of attitudes and attitude change. London: Sage Publications Ltd.

Polit, D.F., Beck, C.T. (2008). Nursing Research: Generating and Assessing Evidence for Nursing Practice (8th ed). Philadelphia: Lippincott Williams & Wilkins.

Pratkanis, A. R., Breckler, S. J., & Greenwald, A. G. (1989). Attitude structure and function. Psychology Press.

Reckase, M. (2009). Multidimensional item response theory (Vol. 150). New York, New Jersey: Springer.

Renthlei, M. L., & Malsawmi, H. (2015). Construction of an Attitude Scale towards Teaching Profession: A Study among Secondary School Teachers in Mizoram. Art, Humanities and Management, 1(4), 29-36.

Reynolds, C. R., & Livingston, R. B. (2012). Mastering modern psychological testing: Theory and methods. Upper Saddle River, New Jersey: Pearson Education.

Thompson, N. A., & Weiss, D. J. (2011). A Framework for the Development of Computerized Adaptive Tests. Practical Assessment, Research & Evaluation, 16(1). Available online: https://pareonline.net/getvn.asp?v=16&n=1.

Veldkamp, B. P., & Matteucci, M. (2013). Bayesian computerized adaptive testing. Ensaio: Avaliação e Políticas Públicas em Educação, 21(78), 57-82.

Wainer, H., Dorans, N., Eignor, D., Flaugher, R., Green, B. F., Mislevy, R. J., & Steinberg, L. (2001). Computerized adaptive testing: A primer. Qual Life Res, 10(8), 733-734.

Weiten, W. (2013). Psychology: Themes and variations: Themes and variations (9nd ed.). Las Vegas: Cengage Learning.

Wright, B. D., Linacre, J. M., Gustafson, J. E., & Martin-Lof, P. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 13(3), 122-128.

Wu, M. L., Adams, R. J., Wilson, M., & Haldane, S. A. (2007). ACER ConQuest: Generalized item response modelling software. Camberwell. Victoria: ACER Press.

Downloads

Published

2019-06-23

Issue

Section

Research Articles