Enhancing Learning Outcomes: A Study on the Development of Higher Order Thinking Skills based Evaluation Instruments for Work and Energy in High School Physics

Dian Artha Kusumaningtyas(1*), Muhamatsakree Manyunuh(2), Efi Kurniasari(3), Annisa Nabilla Awalin(4), Rita Rahmaniati(5), Amalia Febriyanti(6)

(1) Faculty of Teacher Training and Education, Universitas Ahmad Dahlan
(2) Faculty of Education, Fatoni University
(3) Faculty of Teacher Training and Education, Universitas Ahmad Dahlan
(4) Faculty of Teacher Training and Education, Universitas Ahmad Dahlan
(5) Faculty of Teacher Training and Education, University Muhammadiyah Palangka Raya
(6) College of Teacher Education, University of Northem Philippines
(*) Corresponding Author

Abstract

This study aimed to enhance student learning outcomes in the field of work and energy within senior high schools through the development of evaluation instruments based on higher-order thinking skills (HOTS). Higher-order thinking encompasses advanced cognitive abilities such as analysis, evaluation, and creative problem-solving. The evaluation instrument created was meticulously designed to encourage students to think critically, solve intricate problems, and apply physics principles to real-world scenarios. The research methodology employed the development research approach. The instrument development process comprised several stages, including needs analysis, instrument design, validation, and revision. To ensure the instrument's precision and validity, experts in physics education and educational evaluation actively participated in the validation process. The resulting evaluation instrument included a combination of multiple-choice questions and open-ended responses. Students underwent assessment using this instrument following their study of work and energy. Evaluation data were subsequently analyzed through both quantitative and qualitative methods. The outcomes demonstrated a significant improvement in student learning achievements concerning work and energy when using evaluation instruments founded on higher-order thinking. Students who utilized this instrument exhibited superior critical thinking skills, enhanced problem-solving abilities, and an improved capacity to apply physics concepts in real-life situations. This study provides invaluable recommendations for educators and curriculum developers, advocating for the adoption of higher-order thinking-based evaluation instruments in high school physics education. Such an approach has the potential to bolster students' higher-order thinking capabilities and augment their learning outcomes in the context of work and energy. In summary, the successful development and validation of the HOTS based evaluation instrument for 10th-grade high school physics students studying work and energy attest to its viability. Rigorous evaluations from both subject matter experts and media specialists consistently affirmed its suitability across diverse aspects, encompassing appearance, content, and language. Educators, who play a pivotal role in instrument implementation, lauded its effectiveness in teaching work and energy concepts. Positive feedback from students, the primary beneficiaries of this evaluation instrument, underscores its widespread acceptance and appropriateness. In sum, this research underscores the instrument's strong validity and practicality for evaluating students' grasp and application of work and energy principles in high school physics, endorsing its capacity to augment learning outcomes.

Keywords

enhancing learning outcomes; study, development; higher order thinking skills; evaluation instruments; work and energy; high school physics

Full Text:

PDF

References

Abdurrahman, A., Maulina, H., Nurulsari, N., Sukamto, I., Umam, A. N., & Mulyana, K. M. (2023). Impacts of integrating engineering design process into STEM makerspace on renewable energy unit to foster students’ system thinking skills. Heliyon, 9(4), e15100. https://doi.org/10.1016/j.heliyon.2023.e15100

Agasisti, T., Antequera, G., & Delprato, M. (2023). Technological resources, ICT use and schools efficiency in Latin America – Insights from OECD PISA 2018. International Journal of Educational Development, 99, 102757. https://doi.org/10.1016/j.ijedudev.2023.102757

Amaliyah, P. (2023). Pengembangan Instrumen Tes Berbasis Pemecahan Masalah pada Materi Hukum Newton. INPAFI (Inovasi Pembelajaran Fisika), 11(02). https://doi.org/10.24114/inpafi.v11i02.44891

Arafah, K., Amin, B. D., Sari, S. S., & Hakim, A. (2021). The Development of Higher Order-Thinking Skills (HOTS) Instrument Assessment in Physics Study. Journal of Physics: Conference Series, 1899(1), 012140. https://doi.org/10.1088/1742-6596/1899/1/012140

Arifin, T., Mustadi, A., Zulfiati, H. M., & Fathoni, A. (2023). Analysis of HOT Content in the Integrated Thematic Students’ and Teachers’ Handbook of the 2013 Curriculum. Indonesian Journal Of Educational Research and Review, 6(1), 206–218. https://doi.org/10.23887/ijerr.v6i1.54325

Asriadi, M., & Istiyono, E. (2020). Exploration of Creative Thinking Skills of Students in Physics Learning. Journal of Educational Science and Technology (EST), 6(2), 151. https://doi.org/10.26858/est.v6i2.12737

Astalini, A., Darmaji, D., Agus Kurniawan, D., & Wulandari, M. (2021). Male or Female, who is better? Students’ Perceptions of Mathematics Physics E-Module Based on Gender. Indonesian Journal on Learning and Advanced Education (IJOLAE), 3(3), 207–224. https://doi.org/10.23917/ijolae.v3i3.14830

Bahtiar, Sukmawati, A., & Setiawan, T. (2020). Developing assessment of higher-order thinking skills in physics learning based on local wisdom. Journal of Physics: Conference Series, 1567(4), 042045. https://doi.org/10.1088/1742-6596/1567/4/042045

Bahufite, E., Kasonde-Ng’andu, S., & Akakandelwa, A. (2023). The relationships between learners’ academic achievement due to the use of constructivist methods in physical science and their self-esteem in Zambian secondary schools. Social Sciences & Humanities Open, 8(1), 100632. https://doi.org/10.1016/j.ssaho.2023.100632

Berry Devanda, Lufri, & Elizar, E. (2023). The Effectiveness of the STEM Project-Based Learning Approach in Physics Learning to Improve Scientific Work Skills of High School Students. International Journal Of Humanities Education and Social Sciences (IJHESS), 2(4). https://doi.org/10.55227/ijhess.v2i4.358

Blegur, J., Mahendra, A., Mahardika, I. M. S., Lumba, A. J. F., & Rajagukguk, C. P. M. (2023). Construction of Analytical Thinking Skills Instruments for Micro Teaching Courses. Journal of Education Research and Evaluation, 7(2), 184–196. https://doi.org/10.23887/jere.v7i2.57025

Desilva, D., Sakti, I., & Medriati, R. (2020). Pengembangan Instrumen Penilaian Hasil Belajar Fisika Berorientasi Hots (Higher-Order Thinking Skills) pada Materi Elastisitas dan Hukum Hooke. Jurnal Kumparan Fisika, 3(1), 41–50. https://doi.org/10.33369/jkf.3.1.41-50

Desiriah, E., & Setyarsih, W. (2021). Tinjauan Literatur Pengembangan Instrumen Penilaian Kemampuan Berpikir Tingkat Tinggi (Hots) Fisika di SMA. ORBITA: Jurnal Kajian, Inovasi Dan Aplikasi Pendidikan Fisika, 7(1), 79. https://doi.org/10.31764/orbita.v7i1.4436

Dewi, J. N., Patonah*, S., & Sukamto, S. (2023). Validation of Science, Technology, Engineering, and Mathematics Based Diagnostik Assessment on Natural Resource Material for Phase B Elementary School Students using Rasch Model. Jurnal Pendidikan Sains Indonesia, 11(3), 654–667. https://doi.org/10.24815/jpsi.v11i3.31165

Firdaus, M. A., Mawardi, M., & Suryani, O. (2023). Development of teaching material based on the plomp development model to support Merdeka curriculum on global warming topic. Jurnal Pijar Mipa, 18(4), 537–545. https://doi.org/10.29303/jpm.v18i4.5286

Forawi, S. A. (2016). Standard-based science education and critical thinking. Thinking Skills and Creativity, 20, 52–62. https://doi.org/10.1016/j.tsc.2016.02.005

Hartini, T. I., & Martin. (2020). Pengembangan Instrumen Soal Hots (High-Order Thinking Skill) pada Mata Kuliah Fisika Dasar 1. Jurnal Pendidikan Fisika, 8(1).

Hauptman, H., & Cohen, A. (2011). The synergetic effect of learning styles on the interaction between virtual environments and the enhancement of spatial thinking. Computers & Education, 57(3), 2106–2117. https://doi.org/10.1016/j.compedu.2011.05.008

Hikmawati, Sahidu, H., Kosim, Sutrio, & Gunawan. (2023). The development of a STEM-based physics module to improve students' higher-order thinking skills. 110001. https://doi.org/10.1063/5.0122573

Huang, Y.-M., Silitonga, L. M., & Wu, T.-T. (2022). Applying a business simulation game in a flipped classroom to enhance engagement, learning achievement, and higher-order thinking skills. Computers & Education, 183, 104494. https://doi.org/10.1016/j.compedu.2022.104494

Husna, A., Hasan, M., Mustafa, M., Syukri, M., & Yusrizal, Y. (2020). Pengembangan Modul Fisika Berbasis Integrasi Islam-Sains pada Materi Gerak Lurus untuk Meningkatkan Hasil Belajar Peserta Didik. Jurnal Pendidikan Sains Indonesia, 8(1), 55–66. https://doi.org/10.24815/jpsi.v8i1.15539

Istiyono, E. (2017). The analysis of senior high school students’ physics HOTS in Bantul District measured using PhysReMChoTHOTS. 070008. https://doi.org/10.1063/1.4995184

Istiyono, E., Sunu, W., Fenditasari, K., Rai, M., & Saepuzaman, D. (2023). The Development of a Four-Tier Diagnostic Test Based on Modern Test Theory in Physics Education. European Journal of Educational Research, 12(1), 371–385. https://doi.org/10.12973/eu-jer.12.1.371

Juita, Z., Sundari, P. D., Sari, S. Y., & Rahim, F. R. (2023). Identification of Physics Misconceptions Using Five-tier Diagnostic Test: Newton’s Law of Gravitation Context. Jurnal Penelitian Pendidikan IPA, 9(8), 5954–5963. https://doi.org/10.29303/jppipa.v9i8.3147

Kurniawan, A., Tantri, I. D., & Fian, K. (2023). Effectiveness of STEM-Based Lectora Inspire Media to Improve Students’ HOTS in Physics Learning. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 9(1), 55–66. https://doi.org/10.21009/1.09106

Kurniawan, D. A., Astalini, A., Darmaji, D., Tanti, T., & Maryani, S. (2022). Innovative Learning: Gender Perception of e-Module Linear Equations in Mathematics and Physics. Indonesian Journal on Learning and Advanced Education (IJOLAE), 4(2), 92–106. https://doi.org/10.23917/ijolae.v4i2.16610

Kurniawan, F., Samsudin, A., Chandra, D. T., Sriwati, E., & Coştu, B. (2023). IMPAS: Modification of the PAS Questionnaire to Measure Attitudes of High School Students towards Physics in Indonesia. Indonesian Journal on Learning and Advanced Education (IJOLAE), 5(2), 198–216. https://doi.org/10.23917/ijolae.v5i2.22508

Latifah, S., Meisuri, M., & Kesuma, A. A. (2023). Development of Physics Worksheet Based on Higher-Order Thinking Skills (HOTS) Integrated with Bilingual Class Learning. Indonesian Journal of Science and Mathematics Education, 6(1), 82–95. https://doi.org/10.24042/ijsme.v6i1.14131

Linuwih, S., & Safutra, Y. (2023). Development of HOTS questions on the first law of thermodynamics materials to measure higher-order thinking skills for SMAN 1 Jakenan students. 050051. https://doi.org/10.1063/5.0125849

Listiaji, P., Widianingrum, R. A., Saputri, A. A. I., & Rahman, N. F. A. (2022). PjBL Model Assisted by Smartphone Sensors to Improve Critical Thinking Skills of Prospective Science Teachers. Indonesian Journal on Learning and Advanced Education (IJOLAE), 4(3), 246–256. https://doi.org/10.23917/ijolae.v4i3.18942

Liu, Y., & Pásztor, A. (2022). Effects of problem-based learning instructional intervention on critical thinking in higher education: A meta-analysis. Thinking Skills and Creativity, 45, 101069. https://doi.org/10.1016/j.tsc.2022.101069

Mantau, B. A. K., & Talango, S. R. (2023). Pengintegrasian Keterampilan Abad 21 dalam Proses Pembelajaran (Literature Review). Irfani, 19(1), 86–107. https://doi.org/10.30603/ir.v19i1.3897

Martawijaya, M. A., Rahmadhanningsih, S., Swandi, A., Hasyim, M., & Sujiono, E. H. (2023). The Effect of Applying the Ethno-STEM-Project-based Learning Model on Students’ Higher-order Thinking Skill and Misconception of Physics Topics Related to Lake Tempe, Indonesia. Jurnal Pendidikan IPA Indonesia, 12(1), 1–13. https://doi.org/10.15294/jpii.v12i1.38703

Masturi, Khasanah, N., Anggraeni, A., & Susilawati. (2023). The development of higher-order thinking skills (HOTS) wave test instrument for high school students. 050050. https://doi.org/10.1063/5.0125874

Muflikhun, A. S., & Setyarsih, W. (2022). Characteristics of Instruments and Profile of Creative Thinking Ability of Students on Work and Energy Material. Prisma Sains : Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 10(3), 726. https://doi.org/10.33394/j-ps.v10i3.5408

Mukti, T. S., Elvira, M., & Hussin, Z. B. (2023). Development of the Game-based HOTS Assessment Instrument for Measuring Science Literacy Skills of Islamic Elementary School Students. Al Ibtida: Jurnal Pendidikan Guru MI, 10(1), 63. https://doi.org/10.24235/al.ibtida.snj.v10i1.11393

Mulyana, V., & Desnita, D. (2023). Empirical Validity and Reliability of the Scientific Literacy Assessment Instrument Based on the Tornado Physics Enrichment Book. Jurnal Penelitian Pendidikan IPA, 9(5), 3961–3967. https://doi.org/10.29303/jppipa.v9i5.3290

Naibaho, D., & Ritonga, W. (2023). Pengembangan Instrumen Tes Berbasis Higher-Order Thinking Skills (HOTS) pada Materi Gerak Lurus. JURNAL IKATAN ALUMNI FISIKA, 9(1), 32. https://doi.org/10.24114/jiaf.v9i1.32700

Nurjanah, S. (2021). Objek Asesmen dalam Perspektif Kurikulum 2013. Jurnal Pendidikan Dan Pengajaran Guru Sekolah Dasar (JPPGuseda), 4(2), 85–91. https://doi.org/10.55215/jppguseda.v4i2.3607

Pinto, A. A., Sutama, Adnan, M., Novitasari, M., Prihatini, C., & Hardianti, D. (2023). Analysis of higher order thinking skills (HOTS) questions on number patterns in junior high schools. 020069. https://doi.org/10.1063/5.0141466

Rahman, A., Rusnayati, H., & Muslim, M. (2021). Analysis of the Characteristics of Higher Order Thinking Skills (HOTS) Test on Momentum and Impulse for Senior High School Student Using Item Response Theory. Jurnal Penelitian Fisika Dan Aplikasinya (JPFA), 11(2), 127–137. https://doi.org/10.26740/jpfa.v11n2.p127-137

Ramadhan, S., Mardapi, D., Kun, Z., & Budi, H. (2019). The Development of an Instrument to Measure the Higher Order Thinking Skill in Physics. European Journal of Educational Research, 8(3), 743–751. https://doi.org/10.12973/eu-jer.8.3.743

Robertson, S. L. (2021). Provincializing the OECD-PISA global competencies project. Globalisation, Societies and Education, 19(2), 167–182. https://doi.org/10.1080/14767724.2021.1887725

Sari, Y., Qadar, R., & Hakim, A. (2023). Analysis of High School Students’ Conceptual Understanding of Physics on Temperature and Heat Concepts. International Journal of STEM Education for Sustainability, 3(1), 212–224. https://doi.org/10.53889/ijses.v3i1.92

Setiawan, J., Ajat Sudrajat, A., Aman, A., & Kumalasari, D. (2021). Development of higher-order thinking skill assessment instruments in learning Indonesian history. International Journal of Evaluation and Research in Education (IJERE), 10(2), 545. https://doi.org/10.11591/ijere.v10i2.20796

Setlik, J., & Silva, H. C. da. (2023). Texts and reading practices in physics education: Analysis of the voices of subjects in initial teacher education. Teaching and Teacher Education, 127, 104112. https://doi.org/10.1016/j.tate.2023.104112

Suciati, I. (2022). Implementasi Higher-Order Thinking Skills Terhadap Kemampuan Berpikir Kritis Peserta Didik dalam Pembelajaran. Koordinat Jurnal MIPA, 3(1), 7–16. https://doi.org/10.24239/koordinat.v3i1.32

Sugiarti, T., Kaniawati, I., & Aviyanti, L. (2017a). Development of Assessment Instrument of Critical Thinking in Physics at Senior High School. Journal of Physics: Conference Series, 812, 012018. https://doi.org/10.1088/1742-6596/812/1/012018

Sugiarti, T., Kaniawati, I., & Aviyanti, L. (2017b). Development of Assessment Instrument of Critical Thinking in Physics at Senior High School. Journal of Physics: Conference Series, 812, 012018. https://doi.org/10.1088/1742-6596/812/1/012018

Sugiyono. (2013). Metode Penelitian Kuantitatif, Kualitatif, dan R&D. Alfa Betta.

Sulistyanto, H., Anif, S., Sutama, S., Narimo, S., Sutopo, A., Haq, M. I., & Nasir, G. A. (2022). Education Application Testing Perspective to Empower Students’ Higher Order Thinking Skills Related to The Concept of Adaptive Learning Media. Indonesian Journal on Learning and Advanced Education (IJOLAE), 4(3), 257–271. https://doi.org/10.23917/ijolae.v4i3.19432

Sulistyanto, H., Sumardjoko, B., Haq, M. I., Zakaria, G. A. N., Narimo, S., Astuti, D., Adhantoro, M. S., Setyabudi, D. P., Sidiq, Y., & Ishartono, N. (2023). Impact of Adaptive Educational Game Applications on Improving Student Learning: Efforts to Introduce Nusantara Culture in Indonesia. Indonesian Journal on Learning and Advanced Education (IJOLAE), 5(3), 249–261. https://doi.org/10.23917/ijolae.v5i3.23004

Sun, H., Xie, Y., & Lavonen, J. (2022). Exploring the structure of students' scientific higher-order thinking in science education. Thinking Skills and Creativity, 43, 100999. https://doi.org/10.1016/j.tsc.2022.100999

Tambunan, H. (2019). The Effectiveness of the Problem Solving Strategy and the Scientific Approach to Students’ Mathematical Capabilities in High Order Thinking Skills. International Electronic Journal of Mathematics Education, 14(2). https://doi.org/10.29333/iejme/5715

Utomo, D. K. (2023). Pengembangan Bahan Ajar Fisika Berbasis High-Order Thinking Skill (HOTS) pada Materi Listrik Dinamis. SECONDARY: Jurnal Inovasi Pendidikan Menengah, 3(2), 146–153. https://doi.org/10.51878/secondary.v3i2.2205

Vázquez-Villegas, P., Mejía-Manzano, L. A., Sánchez-Rangel, J. C., & Membrillo-Hernández, J. (2023). Scientific Method’s Application Contexts for the Development and Evaluation of Research Skills in Higher-Education Learners. Education Sciences, 13(1), 62. https://doi.org/10.3390/educsci13010062

Waizah, N., & Herwani, H. (2021). Penilaian Pengetahuan Tertulis Dalam Kurikulum 2013. Tafkir: Interdisciplinary Journal of Islamic Education, 2(2), 207–228. https://doi.org/10.31538/tijie.v2i2.54

Wardhani, U. K., & Setiyarsih, W. (2021). Kajian Literatur Pengembangan Instrumen Kemampuan Problem Solving Pada Materi Fisika. IPF: Inovasi Pendidikan Fisika, 10(2), 16–27. https://doi.org/10.26740/ipf.v10n2.p16-27

Weisdiyanti, N., & Juliani, R. (2023). Development of Critical Thinking Skills-Based Physic Test Instruments for High School. Proceedings of the 4th International Conference on Science and Technology Applications, ICoSTA 2022, 1-2 November 2022, Medan, North Sumatera Province, Indonesia. https://doi.org/10.4108/eai.1-11-2022.2326211

Wisman, Y., Effrata, E., & Tutesa, T. (2021). Penerapan Konsep Instrumen Evaluasi Hasil Belajar. Jurnal Ilmiah Kanderang Tingang, 12(1), 1–9. https://doi.org/10.37304/jikt.v12i1.105

Xu, E., Wang, W., & Wang, Q. (2023). The effectiveness of collaborative problem-solving in promoting students' critical thinking: A meta-analysis based on empirical literature. Humanities and Social Sciences Communications, 10(1), 16. https://doi.org/10.1057/s41599-023-01508-1

Zakwandi, R., & Istiyono, E. (2023). A framework for assessing computational thinking skills in the physics classroom: a study on cognitive test development. SN Social Sciences, 3(3), 46. https://doi.org/10.1007/s43545-023-00633-7

Zhou, Y., Gan, L., Chen, J., Wijaya, T. T., & Li, Y. (2023). Development and validation of a higher-order thinking skills assessment scale for pre-service teachers. Thinking Skills and Creativity, 48, 101272. https://doi.org/10.1016/j.tsc.2023.101272

DOI: 10.23917/ijolae.v6i1.23125

Article Metrics

Abstract view(s): 1047 time(s)
PDF: 171 time(s)

Refbacks

  • There are currently no refbacks.