EVALUASI KUALITAS INSTRUMEN TES MAHARAH QIRA’AH MENGGUNAKAN CLASSICAL TEST THEORY

Sri Wahyuni Hidayanti; Moch Fajarul Falah

doi:10.24256/jale.v9i1.10787

Authors

Sri Wahyuni Hidayanti Universitas Islam Negeri Ar-Raniry, Indonesia
Moch Fajarul Falah Universitas Islam Negeri Ar-Raniry, Indonesia

DOI:

https://doi.org/10.24256/jale.v9i1.10787

Keywords:

Arabic Learning Evaluation, Classical Test Theory, Maharah Qira’ah, Test Instrument

Abstract

This study is motivated by the importance of the quality of assessment instruments in measuring maharah qira’ah (reading comprehension skills) accurately and objectively. The study aims to evaluate the quality of a maharah qira’ah test instrument using the Classical Test Theory (CTT) approach through the analysis of item validity, reliability, difficulty level, and discrimination power. This research employed a descriptive quantitative method, with the object of study being a multiple-choice test instrument consisting of 10 items that had been used in Arabic language learning assessment. The data were obtained from the responses of 17 students from UIN Ar-Raniry and Syiah Kuala University who participated in maharah qira’ah learning at Dayah Darul Aman. Data analysis was conducted using IBM SPSS Statistics 22 through the Corrected Item-Total Correlation (CITC), Cronbach’s Alpha, item difficulty index, and item discrimination analysis. The results show that 8 items were valid and 2 items were invalid due to negative CITC values. The reliability coefficient of the instrument was 0.660, which falls into the moderate category. The analysis of item difficulty indicates that 8 items were categorized as easy and 2 items as moderate. Meanwhile, the discrimination index results show that most items were in the good category; however, 2 items had negative discrimination power. The study concludes that the maharah qira’ah test instrument has a fairly good quality, but still requires revision on several items to improve its validity and reliability. The findings indicate that the quality of an assessment instrument is not only determined by the number of valid items, but also by the balance of indicators, the quality of item construction, and the appropriateness of cognitive levels being measured. This study contributes empirical evidence on the importance of item analysis before instruments are used in Arabic language assessment, in order to improve the accuracy of measuring students’ reading comprehension skills.

Abstrak

Penelitian ini dilatarbelakangi oleh pentingnya kualitas instrumen evaluasi dalam mengukur kemampuan maharah qira’ah secara akurat dan objektif. Penelitian bertujuan untuk mengevaluasi kualitas instrumen tes maharah qira’ah menggunakan pendekatan Classical Test Theory (CTT) melalui analisis validitas, reliabilitas, tingkat kesukaran, dan daya pembeda butir soal. Penelitian ini menggunakan metode deskriptif kuantitatif dengan objek penelitian berupa instrumen tes pilihan ganda sebanyak 10 butir soal yang telah digunakan dalam evaluasi pembelajaran bahasa Arab. Data penelitian diperoleh dari hasil jawaban 17 mahasiswa UIN Ar-Raniry dan Universitas Syiah Kuala yang mengikuti pembelajaran maharah qira’ah di Dayah Darul Aman. Analisis data dilakukan menggunakan IBM SPSS Statistics 22 melalui uji Corrected Item-Total Correlation (CITC), Cronbach Alpha, indeks kesukaran, dan daya pembeda butir soal. Hasil penelitian menunjukkan bahwa terdapat 8 butir soal valid dan 2 butir soal tidak valid karena memiliki nilai CITC negatif. Nilai reliabilitas instrumen memperoleh Cronbach Alpha sebesar 0,660 yang berada pada kategori cukup. Analisis tingkat kesukaran menunjukkan 8 butir soal berada pada kategori mudah dan 2 butir soal berada pada kategori sedang. Sementara itu, hasil daya pembeda menunjukkan sebagian besar butir soal berkategori baik, namun terdapat 2 butir soal dengan daya pembeda negatif. Penelitian ini menyimpulkan bahwa instrumen tes maharah qira’ah memiliki kualitas yang cukup baik, namun masih memerlukan revisi pada beberapa butir soal agar lebih valid dan reliabel. Temuan penelitian menunjukkan bahwa kualitas instrumen tidak hanya ditentukan oleh jumlah butir soal yang valid, tetapi juga oleh keseimbangan indikator, kualitas konstruksi soal, serta kesesuaian tingkat kognitif yang diukur. Kontribusi penelitian ini memberikan informasi empiris mengenai pentingnya analisis butir soal sebelum instrumen digunakan dalam evaluasi pembelajaran bahasa Arab sehingga dapat meningkatkan kualitas pengukuran kemampuan membaca peserta didik.

References

Afifah, Aulia, Hayatun Zayrin, Khalista Nupus, Maizia Khansa, Marsela Siska, Hidayatullah Rully, and Harmonedi. “Analisis Instrumen Penelitian Pendidikan (Uji Validitas Dan Relibilitas Instrumen Penelitian).” Jurnal QOSIM Jurnal Pendidikan Sosial & Humaniora 3, no. 2 (2025).

Agisna, Robi, Zulfikri Alwi Jauhari, M. Saifudin Zuar, Muhammad Sholihin, and Anis Khusnul I. “Evaluasi Pembelajaran.” Social Science Academic 1, no. 2 (2023): 353–62. https://doi.org/10.37680/ssa.v1i2.3582.

Agung Purwa Antara, Anak. Penyetaraan Vertikal Dengan Pendekatan Klasik Dan Item Response Theory. Edited by Avinda Yuda Wati. Jurnal Penelitian Dan Evaluasi Pendidikan. 1st ed. Vol. 19. Yogyakarta: CV Budi Utama, 2020. https://doi.org/10.21831/pep.v19i1.4551.

Ambarita, Rahel Sonia, Neneng Sri Wulan, and D Wahyudin. “Analisis Kemampuan Membaca Pemahaman Pada Siswa Sekolah Dasar.” Edukatif : Jurnal Ilmu Pendidikan 3, no. 5 (2021): 2336–44. https://doi.org/10.31004/edukatif.v3i5.836.

Arief Maulana, Ikhsan. “تحليل بنود أسئلة الاختبار التحصيلي لمهارة القراءة بمعيار ‘روبرت إبل’ في مدرسة يافينا الثانوية الإسلامية بمدينة لهوكسيوماوي بأتشيه.” جامعة موالان مالك إبراهيم اإلسالمية احلكومية, 2025.

Armedi, Rama. “Karakteristik Tes Yang Baik Dan Proses Penyusunan Instrumen Tes Untuk Pembelajaran Di Sekolah.” PENDAGOGIA: Jurnal Pendidikan Dasar 5, no. April (2025): 10–17.

Cesilia, Citra, Diah Asri Wulandari, and Meita Dhamayanti. “Validitas Dan Reliabilitas Ages & Stages Questionnaire: Social-Emotional 2 Versi Indonesia Validitas Dan Reliabilitas Ages & Stages Questionnaire: Social-Emotional 2 Versi Indonesia.” Sari Pediatri 22, no. 6 (2021): 343. https://doi.org/10.14238/sp22.6.2021.343-50.

Damogalad, Nurul Aulia, Ibnu Rawandhy N Hula, and Nurul Aini Pakaya. “Design and Development of Maharah Qira’ah Test Using the Kahoot Application.” Jurnal Naskhi Jurnal Kajian Pendidikan Dan Bahasa Arab 6, no. 2 (2024): 38–55. https://doi.org/10.47435/naskhi.v6i2.3062.

Djaali, and Pudji Mulyono. Pengukuran Dalam Bidang Pendidikan. Grasindo Publisher. 1st ed. Jakarta: PT Gramedia Widiasarana, 2008.

Handoko, Fatkhur Rohman, Syahla Athiya Farha, Hana Salsabila Putri, and Diah Ayu Sucitra. “Optimalisasi Kualitas Butir Soal Melalui Pelatihan Penyusunan Indikator Dengan Uji Validitas Dan Reliabilitas.” Jurnal Pengabdian Masyarakat Ilmu Pendidikan 4, no. 2 (2025): 296–305. https://doi.org/https://doi.org/10.23960/jpm-ip.vol.4i.2.1083.

Hashim, Hasnurol, Kaseh Abu Bakar, and Maheram Ahmad. “Penguasaan Kosa Kata Bahasa Arab Menerusi Pengetahuan Makna Dan Penggunaannya.” Malim: Jurnal Pengajian Umum Asia Tenggara (Sea Journal of General Studies) 21, no. 1 (2020): 160–74. https://doi.org/10.17576/malim-2020-2101-13.

Hendriyani. “Editorial Note: Uji Validitas Dengan Korelasi Item-Total?” Jurnal Manajemen Strategi Dan Aplikasi Bisnis 4, no. 1 (2021): 315–20. https://doi.org/https://doi.org/10.36407/jmsab.v4i2.404.

Hilmi, Ahmad Mashadar, Muhammad Syihabul Ihsan Al Haqiqy, and Rahmah Fadhilah Agustina. “Educational Quality Management in Elementary Schools: Measuring the Validity and Reliability of Maharah Qira’ah Test Items.” Journal of Educational Management Research 4, no. 2 (2025): 931–46. https://doi.org/https://doi.org/10.61987/jemr.v4i2.534.

Karakaya, Sevinc, and Zeliha Alparslan. “Sample Size in Reliability Studies: A Practical Guide Based on Cronbach’s Alpha.” Psychiatry and Behavioral Sciences 12, no. 3 (2022): 150. https://doi.org/10.5455/pbs.20220127074618.

Keith, S. T. “The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education.” Research in Science Education 48 (2018): 1273–96. https://doi.org/10.1007/s11165-016-9602-2.

Kilic, Selim. “Cronbach’s Alpha Reliability Coefficient.” Journal of Mood Disorders 6, no. 1 (2016): 47. https://doi.org/10.5455/jmood.20160307122823.

Lastrijanah, Lastrijanah, Teguh Prasetyo, and Annisa Mawardini. “Pengaruh Media Pembelajaran Geoboard Terhadap Hasil Belajar Siswa.” Didaktika Tauhidi: Jurnal Pendidikan Guru Sekolah Dasar 4, no. 2 (2017): 87. https://doi.org/10.30997/dt.v4i2.895.

Lazuardi, Fajar, Muhammad Zhafir Al-Hazmi, Ubaid Ridlo, and Raswan. “Pengembangan Instrumen Evaluasi Maharah Qiraah.” As-Sulthan Journal Of Education 2, no. 4 (2025): 435–424.

Nazilah, Ulfatun, and Rusdiana Navlia. “Evaluasi Program Pendidikan Dalam Meningkatkan Kualitas Pembelajaran.” JIMAD Jurnal Ilmiah Mutiara Pendidikan 4, no. 1 (2026): 1–14. https://doi.org/10.61404/jimad.v4i1.450.

Rejeki, Sri, Angela Bayu Pertama Sari, Dwi Iswahyuni, Devita Widyaningtyas Yogyanti, Sutanto Sutanto, and Helta Anggia. “Discrimination Index, Difficulty Index, and Distractor Efficiency in MCQs English for Academic Purposes Midterm Test.” Journal of English Language and Pedagogy 6, no. 1 (2023): 1–11. https://doi.org/https://doi.org/10.36597/jelp.v6i1.14738.

Rezigalla, Assad Ali, Ali Mohammed Elhassan Seid Ahmed Eleragi, Amar Babikir Elhussein, Jaber Alfaifi, Mushabab A. ALGhamdi, Ahmed Y. Al Ameer, Amar Ibrahim Omer Yahia, Osama A. Mohammed, and Masoud Ishag Elkhalifa Adam. “Item Analysis: The Impact of Distractor Efficiency on the Difficulty Index and Discrimination Power of Multiple-Choice Items.” BMC Medical Education 24, no. 1 (2024): 2–7. https://doi.org/10.1186/s12909-024-05433-y.

Subhaktiyasa Putu Gede. “Evaluasi Validitas Dan Reliabilitas Instrumen Penelitian Kuantitatif: Sebuah Studi Pustaka.” Journal of Education Research 5 (2024): 5599–5609.

Suharsimi Arikunto. Dasar-Dasar Evaluasi Pendidikan. Edited by Restu Damayanti. 3rd ed. Jakarta: PT Bumi Aksara, 2018.

Sumaryanta. Teori Tes Klasik Dan Teori Respon Butir: Konsep Dan Contoh Penerapannya. Cetakan Pertama. 1st ed. Vol. 15. Cirebon: CV. Confident, 2021.

Suseno, Endro, and Purwo Susongko. Mengukur Validitas Tes. Edited by Endro Suseno. 1st ed. Jawa Timur: Pameral Edukreatif, 2021.

Waruwu, Marinu, Siti Natijatul Pu`at, Patrisia Rahayu Utami, Elli Yanti, and Marwah Rusydiana. “Metode Penelitian Kuantitatif: Konsep, Jenis, Tahapan Dan Kelebihan.” Jurnal Ilmiah Profesi Pendidikan 10, no. 1 (2025): 917–32. https://doi.org/10.29303/jipp.v10i1.3057.

Yustiandi, and Duden Saepuzaman. “Teori Analisis Butir Soal, Nilai Daya Pembeda Yang Negatif Menunjukkan Bahwa Butir Soal Tidak Mampu Membedakan Peserta Didik Berkemampuan Tinggi Dan Rendah, Bahkan Berpotensi Berlawanan Dengan Tujuan Pengukuran.” Basicedu 8, no. 6 (2024): 4700–4706. https://doi.org/https://doi.org/10.31004/basicedu.v8i6.9031.

Zaenal, Arifin. “Kriteria Instrumen Dalam Suatu Penelitian.” Jurnal THEOREMS (The Original Research of Mathematics) 2, no. 1 (2017): 28–36.

Zhang, Sijun, and Kimberly Colvin. “Comparison of Different Reliability Estimation Methods for Single-Item Assessment: A Simulation Study.” Frontiers in Psychology 15, no. 1 (2024): 148. https://doi.org/10.3389/fpsyg.2024.1482016.