Characteristics of Two-Tier Multiple Choice (TTMC) High Order Thinking Skill (HOTS) Instruments and the Estimation of HOTS Abilities of Vocational Education Students Using the Item Response Theory Approach

Abstract

This research aims to design and build an isomorphous binary phase diagram animation media using Adobe Flash Abstract—This study aims to determine the characteristics of the HOTS instrument item parameters in the form of two-tier multiple-choice (TTMC) and estimate the HOTS ability of vocational high school students using the Item Response Theory (IRT) approach. The research method used is quantitative. The research subjects were 264 vocational high school students using class XI in West Java and Banten provinces. The test instrument used was Newton's Law concept and Two-Tier Multiple Choice (TTMC). Data analysis includes a unidimensional test, the fitness of the polytomous IRT model, the determination of item characteristics, and the estimation of students' HOTS ability. The results showed that the data were unidimensional, and the fitness IRT polytomous scoring model was GPCM2PL. The discrimination parameter (a) of all items with a percentage of 100% is included in the good criteria. Analysis of the level of difficulty (b) also shows that 100% of items are included in the moderate criteria. This result was obtained because the instrument used was developed through developing an appropriate instrument. Thus, its validity and reliability were good. It means that the instrument used is feasible to be tested on vocational high school students. Other studies show that the mean of students' HOTS abilities is in the medium category.