ITEMAN-Based Evaluation of End-of-Semester Assessment Items: A Case Study of Language Test in Indonesian School Context

Riswanda Himawan(1*), Hermanto Hermanto(2), Burhan Nurgiyantoro(3), Suyono Suyono(4), Didin Widyartono(5), Agustina Purwanti(6), Li Yujing(7), Victor A. Pogadaev(8)

(1) Faculty of Letters, Universitas Negeri Malang
(2) Faculty of Teacher Training and Education, Universitas Ahmad Dahlan
(3) Faculty of Languages, Arts and Culture, Universitas Negeri Yogyakarta
(4) Faculty of Letters, Universitas Negeri Malang
(5) Faculty of Letters, Universitas Negeri Malang
(6) Sekolah Menengah Pertama Negeri 8, Kota Yogyakarta
(7) Faculty of Education, University Hainan College of Foreign Studies
(8) Faculty of Languages and Linguistics, Moscow State Institute of International Relations
(*) Corresponding Author

Abstract

Assessment is an inseparable part of the learning process. Assessment is a way to decide the choices that a teacher will make for students, so that what they do is truly measurable. In line with this description, this study aims to determine the quality of the end-of-semester assessment questions for Indonesian, grade VIII, at SMPN 8 Yogyakarta. The method used in this research is descriptive quantitative. Quantitative descriptive is used to analyze documents in the form of output analysis results from the ITEMAN application. The results of the review that will be submitted later are in the form of validity, reliability, IDB, ITK and the functioning of the distractor. In obtaining the results of the study. The research steps carried out in this study were are testing the validity of the question grids, testing the reliability, IDB, ITK, and distractors through the ITEMAN program, analyze the results according to expert opinions and research that are relevant to this study, and conclude the results of the study. There were 50 questions that were analyzed and tested on 32 class VIII students of SMPN 8 Yogyakarta. Overall, the research results show all questions are declared valid, Alpha is 0.926. This shows that the reliability of the items is very high, IDB results show 38 items in good, 5 moderate, 4 sufficient, and 3 failed categories, the results of ITK analysis showed 31 very easy questions, 10 easy questions, 5 moderate questions, 2 difficult questions, and 2 very difficult questions, and the results of the distractor function show that 32 questions do not work, and 18 item distractors work. Overall, the results of this analysis aim to provide a reference base related to the quality of questions through ITEMAN, especially in learning Indonesian, which so far has not been done much

Keywords

assesment item semester; indonesian school context; ITEMAN analysis; item discrimination index; learning objectives achievement

Full Text:

PDF

References

Al-faruq, Z. (2023). Peran Penggunaan Desain Evaluasi Untuk Meningkatkan Kualitas Pembelajaran. Ilma Jurnal Pendidikan Islam, 1(2), 158–171. https://doi.org/10.58569/ilma.v1i2.587

Alfarisa, F., Chudari, I. N., & Robiansyah, F. (2019). Analisis Butir Soal IPS Kelas V Sekolah Dasar Menggunakan Software ITEMAN. EduBasic Journal: Jurnal Pendidikan Dasar, 1(2), 100–106. https://doi.org/10.17509/ebj.v1i2.26474

Alnovgada, V. R. S., & Suyata, P. (2019). The Effectiveness of Picture and picture Cooperative Learning Models of Writing Instructions Skills in Class VIII Students of SMP Negeri 2 Sui Ambawang. 297(Icille 2018), 432–437. https://doi.org/10.2991/icille-18.2019.90

Anggraini, D., & Suyata, P. (2014). Karakteristik Soal Uasbn Mata Pelajaran Bahasa Indonesia Di Daerah Istimewa Yogyakarta Pada Tahun Pelajaran 2008/2009. Jurnal Prima Edukasia, 2(1), 57. https://doi.org/10.21831/jpe.v2i1.2644

Arifin, Z., & Retnawati, H. (2017). Pengembangan instrumen pengukur higher order thinking skills matematika siswa SMA kelas X. PYTHAGORAS: Jurnal Pendidikan Matematika, 12(1), 98. https://doi.org/10.21831/pg.v12i1.14058

Arvianto, I. R. (2016). Pemanfaatan program Iteman 3.0 untuk analisis butir soal lomba cerdas cermat teknologi informasi dan komunikasi tingkat SMA sederajat. Jurnal Teknologi Informasi, XI(33), 1–13.

Asrial, A., Syahrial, S., Sabil, H., Kurniawan, D. A., Perdana, R., Nawahdani, A. M., Widodi, B., Rahmi, R., & Nyirahabimana, P. (2023). Quantitative Analysis Of Elementary School Students’ Curiosity and Web-Based Assessment Responses. Indonesian Journal on Learning and Advanced Education (IJOLAE), 5(2), 107–119. https://doi.org/10.23917/ijolae.v5i2.21646

Azizah, N., & Sumardi, H. (2021). Analisis Kualitas Dan Tingkat Kognitif Soal Matematika Penilaian Akhir Semester (Pas) Ganjil Kelas Ix Di Smp N 10 Kota Bengkulu Tahun 2020/2021. Journal Mathematics Education Sigma [JMES], 2(2). https://doi.org/10.30596/jmes.v2i2.7936

Dewi, S. K., & Sudaryanto, A. (2020). Validitas dan Reliabilitas Kuesioner Pengetahuan , Sikap dan Perilaku Pencegahan Demam Berdarah. Seminar Nasional Keperawatan Universitas Muhammadiyah Surakarta (SEMNASKEP) 2020, 73–79.

Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Tes Klasik Dan Model Rasch. Indonesian Journal of Educational Research and Review, 3(1), 11–19.

Fernanda, J. W., & Hidayah, N. (2020). Analisis Kualitas Soal Ujian Statistika Menggunakan Classical Test Theory dan Rasch Model. Square : Journal of Mathematics and Mathematics Education, 2(1), 49. https://doi.org/10.21580/square.2020.2.1.5363

Fitriani, F., Ibrahim, I., & Nugroho, E. D. (2020). Analisis Soal Ujian Akhir Semester Pada Mata Pelajaran Ipa Berdasarkan Dimensi Proses Kognitif Taksonomi Anderson Dankemampuan Berpikir Kritisdi Smp Negeri 1 Nunukan Selatan. Biopedagogia, 2(1), 37–43. https://doi.org/10.35334/biopedagogia.v2i1.1716

Fridaram, O., Istharini, E., Cicilia, P. G. C., Nuryani, A., & Wibowo, D. H. (2021). Meningkatkan Konsentrasi Belajar Peserta Didik dengan Bimbingan Klasikal Metode Cooperative Learning Tipe Jigsaw. Magistrorum et Scholarium: Jurnal Pengabdian Masyarakat, 1(2), 161–170. https://doi.org/10.24246/jms.v1i22020p161-170

Hanifah, N. (2014). Perbandingan Tingkat Kesukaran, Daya Pembeda Butir Soal Dan Reliabilitas Tes Bentuk Pilihan Ganda Biasa Dan Pilihan Ganda Asosiasi Mata Pelajaran Ekonomi. SOSIO E-KONS, 6(1), 41–55.

Himawan, Suyata, K. (2024). Developing Project-Based Learning-Based eBook “Critical and Creative Reading” to Improve Students’ Critical Thinking Skills Riswanda. Jurnal Kependidikan: Jurnal Hasil Penelitian Dan Kajian Kepustakaan Di Bidang Pendidikan, Pengajaran Dan Pembelajaran, 10(1), 392–404.

Himawan, R., & Nurgiyantoro, B. (2022). Analisis butir soal latihan penilaian akhir semester ganjil mata pelajaran bahasa Indonesia kelas VIII SMPN 1 Bambanglipuro Bantul menggunakan program ITEMAN ( Analysis of exercise items for odd semester end of semester Indonesian language subjects class. Kembara: Jurnal Keilmuan Bahasa, Sastra, Dan Pengajarannya, 8(1), 160–180.

Himawan, R., & Suyata, P. (2022). DEVELOPING HOTS QUESTIONS : EVALUATING PERSUASIVE SPEECH TEXT LEARNING IN GRADE IX OF JUNIOR HIGH SCHOOL. Jurnal Gramatika: Jurnal Penelitian Pendidikan Bahasa Dan Sastra Indonesia, 8(1), 50–64.

Ida, F. F., & Musyarofah, A. (2021). Validitas dan Reliabilitas dalam Analisis Butir Soal. Al-Mu’Arrib: Journal of Arabic Education, 1(1), 34–44. https://doi.org/10.32923/al-muarrib.v1i1.2100

Iskandar, A., & Rizal, M. (2018). Analisis kualitas soal di perguruan tinggi berbasis aplikasi TAP. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(1), 12–23. https://doi.org/10.21831/pep.v22i1.15609

Kurniawan, T. (2015). Analisis Butir Soal Ulangan Akhir Semester Gasal Mata Pelajaran IPS Sekolah Dasar (Analysis of Odd Semester Final Test Items in Elementary School of Social Studies Subjects). Journal of Elementary Education, 4(1), 1–6.

Kusumaningtyas, D. A., Manyunu, M., Kurniasari, E., Awalin, A. N., Rahmaniati, R., & Febriyanti, A. (2024). Enhancing Learning Outcomes: A Study on the Development of Higher Order Thinking Skills based Evaluation Instruments for Work and Energy in High School Physics. Indonesian Journal on Learning and Advanced Education (IJOLAE), 6(1), 14–31. https://doi.org/10.23917/ijolae.v6i1.23125

Magdalena, I., Fauziah, S. N., Faziah, S. N., & Nupus, F. S. (2021). Analisis Validitas, Reliabilitas, Tingkat Kesulitan Dan Daya Beda Butir Soal Ujian Akhir Semester Tema 7 Kelas III SDN Karet 1 Sepatan. BINTANG : Jurnal Pendidikan Dan Sains, 3(2), 198–214.

Mardiana, M., & Suyata, P. (2017). Evaluating the philosophical foundation of 2013 Curriculum. Jurnal Penelitian Dan Evaluasi Pendidikan, 21(2), 175–188. https://doi.org/10.21831/pep.v21i2.13336

Martin, T. I. H. (2020). Pengembangan Instrumen Soal HOTS (High Order Thinking Skill) Pada Mata Kuliah Fisika Dasar 1. Jurnal Pendidikan Fisika, 8(1), 18–21.

Muhith, A. (2018). Problematika Pembelajaran Tematik Terpadu di Min III Bondowoso. Indonesian Journal of Islamic Teaching, 1(1), 45–61.

Mustafidah, H., Hartati, S., Wardoyo, R., & Suyata, P. (2021). Intelligent computational model to determine the order of thinking skills of test items. ICIC Express Letters, 15(9), 999–1006. https://doi.org/10.24507/icicel.15.09.999

Nanda Pratiwiningtyas, B., Susilaningsih, E., & Made Sudana, I. (2017). Pengembangan Instrumen Penilaian Kognitif untuk Mengukur Literasi Membaca Bahasa Indonesia Berbasis Model Pirls pada Siswa Kelas IV SD. Journal of Educational Research and Evaluation Sejarah Artikel, 6(1), 1–9.

Nayla Amalia, A., & Widayati, A. (2012). Analisis Butir Soal Tes Kendali Mutu Kelas XII Sma Mata Pelajaran Ekonomi Akuntansi Di Kota Yogyakarta. Jurnal Pendidikan Akuntansi Indonesia, X(1), 1–26.

Nurgiyantoro, B. (2016). Penilaian Pembelajaran Bahasa Berbasis Kompetensi. BPFE-Yogyakarta.

Nurgiyantoro, B., Lestyarini, B., & Rahayu, D. H. (2020). Konstruk Asesmen Literasi Fungsional Untuk Siswa Sekolah Menengah Pertama. Litera, 19(2), 194–211. https://doi.org/10.21831/ltr.v19i2.32977

Nurhalimah, S., Hidayati, Y., Rosidi, I., & Hadi, W. P. (2022). Hubungan Antara Validitas Item Dengan Daya Pembeda Dan Tingkat Kesukaran Soal Pilihan Ganda Pas. Natural Science Education Research, 4(3), 249–257. https://doi.org/10.21107/nser.v4i3.8682

Nuryanti, S., Masykuri, M., & Susilowati, E. (2018). Analisis Iteman dan Model Rasch pada Pengembangan Instrumen Kemampuan Berpikir Kritis Peserta Didik Sekolah Menengah Kejuruan. Jurnal Inovasi Pendidikan IPA, 4(2), 224–233.

Pangesti, F., Fauzan, F., & Risnawati, R. (2020). Kualitas butir soal try out uji pengetahuan dalam memprediksi tingkat kelulusan mahasiswa PPG. Jurnal Pendidikan Profesi …, 1(2), 91–98.

Parancika, R. B., & Suyata, P. (2020). Implementasi Pembelajaran Menulis Teks Eksplanasi Kompleks Pada Siswa Kelas XI SMAN 10 Yogyakarta Dengan Menggunakan Strategi Writing a Story Based on a Picture / Photograph. Rumpun Jurnal Persatuan Melayu, 8(1), 13–25.

Prastikawati, E. F., Adeoye, M. A., & Ryan, J. C. (2024). Fostering Effective Teaching Practices: Integrating Formative Assessment and Mentorship in Indonesian Preservice Teacher Education. Indonesian Journal on Learning and Advanced Education, 6(2), 230–253. https://doi.org/10.23917/ijolae.v6i2.23431

Pujiastuti, R., & Kulup, L. I. (2021). Penyusunan Instrumen Penilaian Kognitif Berbasis HOTS Melalui Problem Based Learning dan Peer Assessment. Indonesian Language Education and Literature, 7(1), 88. https://doi.org/10.24235/ileal.v7i1.9058

Purniasari, L., Masykuri, M., & Ariani, S. R. D. (2021). Analisis Butir Soal Ujian Sekolah Mata Pelajaran Kimia SMA N 1 Kutowinangun Tahun Pelajaran 2019/2022 Menggunakan Model Iteman dan Rasch. Jurnal Pendidikan Kimia, 10(2), 205–214.

Putri Pangestu, D., & Rohinah, R. (2019). Pengaruh Kesiapan Belajar Terhadap Keaktifan Peserta Didik dalam Proses Pembelajaran AUD. Golden Age: Jurnal Ilmiah Tumbuh Kembang Anak Usia Dini, 3(2), 81–90. https://doi.org/10.14421/jga.2018.32-02

Putri, R. H., & Ofianto. (2019). Efektivitas Analisis Butir Menggunakan Anajohn, Anates dan Iteman Studi Soal USBN Pelajaran Sejarah Kota Padang. Jurnal Mahasiswa Ilmu Sejarah Dan Pendidikan, 1(2), 1–11.

Retnawati, H. (2015). Validitas, Realibilitas & Karakteristik Butir. Parama Publishing.

Rotama, A. D., Budiutomo, T. W., & Bowo, A. N. A. (2020). ANALISIS BUTIR SOAL PENILAIAN TENGAH SEMESTER MATA PELAJARAN PPKn KELAS VII DI SMP MUHAMMADIYAH 7 YOGYAKARTA. Academy of Education Journal, 11(01), 24–35. https://doi.org/10.47200/aoej.v11i01.314

Ruay Garcés, R. (2018). La Evaluación: Una estrategia para desarrollar Aprendizajes Profundos en el estudiante. Boletín Redipe, 7, 47–62.

Setiawan, K. E. P., Yudha, R. K., & Arwansyah, Y. B. (2022). ANALISIS BUTIR SOAL PENILAIAN AKHIR TAHUN (PAT) BAHASA INDONESIA KELAS XI SMA NEGERI 1 POLANHARJO KLATEN. Lingua Rima, 11(2), 25–33.

Setiawan, M. A., Susongko, P., & Hayati, M. N. (2020). Pendeteksian DIF pada Perangkat Tes Objektif Penilaian Akhir Semester IPA dengan Mengunakan Permodelan Rasch. Pancasakti Science Education Journal, 5(2), 23–29.

Shanta Monica, Y. sudarman. (2013). Analisis Butir Soal Ujian Tengah Semester Ganjil Seni Budaya Kelas VII Di SMPN 29 Sijunjung. Journal of Chemical Information and Modeling, 53(9), 1689–1699.

Suharti, S. (2017). Kualitas Tes Bahasa Arab dan Prestasi Peserta Didik Madrasah Tsanawiyah Kabupaten Bantul ( Analisis Butir Soal UAMBN. Jurnal Pendidikan Madrasah, 2(1), 185–196.

Susanto, H., Rinaldi, A., & Novalia. (2015). Analisis Validitas Reabilitas Tingkat Kesukaran dan Daya Beda pada Butir Soal Ujian Akhir Semester Ganjil Mata Pelajaran Matematika. Al-Jabar: Jurnal Pendidikan Matematika, 6(2), 343.

Syaifudin. (2020). Validitas dan Reliabilitas Instrumen Penilaian Pada Mata Pelajaran Bahasa Arab. Jurnal Kajian Perbatasa Antarnegara, 3(2), 106–118.

Syarifah, L. L., Yenni, Y., & Dewi, W. K. (2020). Analisis Soal-Soal Pada Buku Ajar Matematika Siswa Kelas XI Ditinjau Dari Aspek Kognitif. Jurnal Cendekia : Jurnal Pendidikan Matematika, 4(2), 1259–1272. https://doi.org/10.31004/cendekia.v4i2.335

Timor, U., Bahasa, P., Km, J., & Sasi, K. (2022). PENGEMBANGAN SOAL LITERASI MEMBACA MODEL PISA DEVELOPMENT OF PISA MODEL READING LITERACY QUESTIONS BASED ON. 7, 42–50.

Wahyuni, A., & Kurniawan, P. (2018). Hubungan Kemampuan Berpikir Kreatif Terhadap Hasil Belajar Mahasiswa. Matematika, 17(2), 1–8. https://doi.org/10.29313/jmtm.v17i2.4114

Wijaya, A., Eresti, A., Despa, D., & Walid, A. (2019). Analisis Butir Soal Persiapan Ujian Nasional Ipa Smp/Mts Tahun 2018 Sampai Dengan 2019 Berdasarkan Taksonomi Bloom. LENSA (Lentera Sains): Jurnal Pendidikan IPA, 9(2), 57–63. https://doi.org/10.24929/lensa.v9i2.78

Yadi, H. (2017). Validitas isi: tahap awal pengembangan kuesioner. Jurnal Riset Manajemen Dan Bisnis (JRMB) Fakultas Ekonomi UNIAT, 2(2), 169–178.

Yusmilda, Y., Budi, I. S., & Zuhad, H. (2023). Pengembangan Instrumen Penilaian Tes Berbasis HOTS Pada Jenjang Pendidikan Dasar Di Era Society 5.0. Al-Madrasah: Jurnal Pendidikan Madrasah Ibtidaiyah, 7(1), 429. https://doi.org/10.35931/am.v7i1.1885

DOI: 10.23917/ijolae.v6i3.23254

Article Metrics

Abstract view(s): 105 time(s)
PDF: 56 time(s)

Refbacks

  • There are currently no refbacks.