First International Conference on Advances in Education, Humanities, and Language, ICEL 2019, Malang, Indonesia, 23-24 March 2019

Research Article

Applying Item Response Theory In Validating An Indonesian Language Profeciency Test

Download633 downloads
  • @INPROCEEDINGS{10.4108/eai.23-3-2019.2284880,
        author={M  Sudaryanto and D  Mardapi and S  Hadi},
        title={Applying Item Response Theory In Validating An Indonesian Language Profeciency Test},
        proceedings={First International Conference on Advances in Education, Humanities, and Language, ICEL 2019, Malang, Indonesia, 23-24 March 2019},
        publisher={EAI},
        proceedings_a={ICEL},
        year={2019},
        month={7},
        keywords={mirt validation reliability indonesian language test},
        doi={10.4108/eai.23-3-2019.2284880}
    }
    
  • M Sudaryanto
    D Mardapi
    S Hadi
    Year: 2019
    Applying Item Response Theory In Validating An Indonesian Language Profeciency Test
    ICEL
    EAI
    DOI: 10.4108/eai.23-3-2019.2284880
M Sudaryanto1,*, D Mardapi1, S Hadi1
  • 1: Yogyakarta State University, Yogyakarta, Indonesia
*Contact email: memet.sudaryanto2016@student.uny.ac.id

Abstract

The Indonesian language test is a measurement of competence in understanding the discourse of written and oral media. The understanding of examining the dimensions of the test needs to be analyzed to look for factors that can explain the relationship or correlation between the various independent indicators observed. This study investigated the application of Item Response Theory (IRT) in analyzing packages of Indonesian test for foreign speakers. The test consists of 3 competencies that measure the ability in listening, reading, and grammar. The stages of testing are testing content validation through the Aiken index, testing the instrument dimensions, confirmatory factor analysis, KR-20 reliability estimation, estimation of alpha reliability from Cronbach, and estimation of reliability through item information function. The difficulty level of the test item is measured by IRT Model package of the freeware R. The results of the study indicate that the Indonesian language test consists of 3 dimensions that correlate to explain latent factors. Based on test validation testing, the Indonesian language test instrument measures the competency according to the test construction. Test reliability is estimated by three methods showing quite high results. Based on the reliability estimation the test shows that the instrument has the consistency of the test results indicated by a coefficient above 0.7.