Gender and Grade DIF Analysis of Elementary School Students’ Ecological Awareness Instrument

Authors

DOI:

https://doi.org/10.52647/jep.v8i1.493

Keywords:

Ecological Awareness, DIF, IRT, Primary School, Gender Bias

Abstract

The use of ecological awareness instruments in educational settings raises significant concerns regarding measurement fairness across different demographic groups. This study aims to identify items that exhibit differential item functioning (DIF) in an ecological awareness instrument administered to elementary school students. Data were collected from 623 elementary school students in Nusa Penida, consisting of 329 boys and 294 girls across Grades 4 to 6. The instrument was analyzed using Item Response Theory (IRT) with the Generalized Partial Credit Model (GPCM), and DIF was detected using the lordif package in R. Results indicate that six items exhibited gender-based DIF, predominantly in the environmental participation dimension, while five items showed grade-based DIF, primarily within the environmental knowledge dimension. Female students demonstrated higher levels of ecological awareness than male students across all grade levels. These findings highlight the importance of selecting items that are equally interpretable across gender and grade groups to ensure fair and valid assessment of ecological awareness in elementary schools.

Downloads

Download data is not yet available.

References

Ágoston, C., Balázs, B., Mónus, F., & Varga, A. (2024). Age differences and profiles in pro-environmental behavior and eco-emotions. International Journal of Behavioral Development (per DOI). https://doi.org/10.1177/01650254231222436

Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30. https://doi.org/10.18637/jss.v039.i08

Crespo-Martín, J., Muñoz-Losa, A., & Corbacho, I. (2026). Promoting sustainability engagement in primary education: Knowledge, behaviors, and gender differences. The Journal of Educational Research (per DOI). https://doi.org/10.1080/00220671.2026.2630919

Davidson, D. J., & Freudenburg, W. R. (1996). Gender and Environmental Risk Concerns: A Review and Analysis of Available Research. Environment and Behavior, 28(3), 302–339. https://doi.org/10.1177/0013916596283003

Falcinelli, I., Fini, C., Mazzuca, C., Alessandri, G., Alivernini, F., Baiocco, R., & Borghi, A. M. (2025). Thinking climate change through the lens of abstractness: A multi-task and multi-setting investigation into generational differences in the conceptualization of ecology. Cognitive Research: Principles and Implications. https://doi.org/10.1186/s41235-025-00689-4

Fuertes Camacho, M. T., Marimon, F., & Albareda-Tiana, S. (2025). Design and Validation of a Multidimensional Instrument for Measuring Eco-Social Competences in Education for Sustainability in Early Childhood Education. Sustainability, 17(17), 7629. https://doi.org/10.3390/su17177629

Gyurián Nagy, N. (2025). Gender Differences in Environmental Attitudes: An Analysis Using the NEP Scale. The American Sociologist (per DOI). https://doi.org/10.1007/s12147-024-09349-1

Jensen, B. B., & Schnack, K. (1997). The Action Competence Approach in Environmental Education. Environmental Education Research, 3(2), 163–178. https://doi.org/10.1080/1350462970030205

Kessler, R. (2008). Competency-based performance reviews. Career Press.

Kuchkinov, A., Tilavova, S., Razak, N. A., Zulkifli, C. Z., Jansaitova, J., Artikova, N., & Otajonova, D. (2026). Pedagogical strategies for enhancing environmental education in Uzbek primary schools: A mixed-methods study. International Journal of Evaluation and Research in Education (IJERE), 15(1). https://doi.org/10.11591/ijere.v15i1.35558

Lopez-Bermudez, E., Palacios Gálvez, M. S., García-Moro, F. J., & Gómez-Baya, D. (2025). Positive Youth Development and Pro-Environmental Behaviours: Examining the Role of Gender among Spanish University Students. International Journal of Mental Health Promotion. https://doi.org/10.32604/ijmhp.2025.068013

Luhmann, N. (1989). Ecological Communication. Polity Press.

Maxwell, T. P. (2003). Integral Spirituality, Deep Science, and Ecological Awareness. Zygon: Journal of Religion and Science, 38(2). https://doi.org/10.1111/1467-9744.00499

Moore, J. H. (1971). Defining and Interpreting Ecology. The Journal of Environmental Education, 3(1), 54–57. https://doi.org/10.1080/00958964.1971.10801610

Muhaimin. (2015). Membangun kecerdasan ekologis: Model pendidikan untuk meningkatkan kompetensi ekologis. Alfabeta.

Muñoz-Losa, A., Sandoval-Aliseda, T., Crespo-Martín, J., & Corbacho, I. (2025). Evolution of pupils’ environmental awareness during the primary education stage. International Research in Geographical and Environmental Education. https://doi.org/10.1080/10382046.2025.2606283

Pada, A., Chanunun, S., & Rahmat, I. (2025). Fostering environmental awareness through sustainable development goal-oriented ethno-STEM approach in elementary education. Jurnal Pendidikan IPA Indonesia, 14(3). https://doi.org/10.15294/jpii.v14i3.24420

Pamungkas, A., Dewantari, T., Tohir, A., ., S., & Soraya, R. (2026). The Effectiveness of the Flipped Classroom Model in Improving English Reading Comprehension of Seventh-Grade Junior High School Students. Journal of Cultural Analysis and Social Change, 11(1), 999–1006. https://doi.org/10.64753/jcasc.v11i1.4009

Parfilova, G. G., & Kalimullin, A. M. (2014). Research of Russian students’ ecological competency. Procedia - Social and Behavioral Sciences, 131, 35–39.

Paula, M. V. G. D., Schimmelpfeng, P. H. C., Lapa, L. G., & Pato, C. M. L. (2026). Corporeity and Ecological Awareness: An Experiential Study with Children and Adolescents. Sustainability, 18(1), 521. https://doi.org/10.3390/su18010521

Pearson, A. T. (1987). The competency concept. Educational Studies, 11(2), 145–152. https://doi.org/10.1207/s15326993es1102_3

Pooley, J. A., & O’Connor, M. (2000). Environmental Education and Attitudes: Emotions and Beliefs are What is Needed. Environment and Behavior, 32(5), 711–723. https://doi.org/10.1177/0013916500325007

Putra, H. S., Tohir, A., & Mashari, A. (2025). Analysis of Teacher’ Digital Literacy Competencies as Support for Teachers’ Skills at SDN 7 Gunung Agung. Jurnal Evaluasi Dan Pembelajaran, 7(2), 206–216. https://doi.org/10.52647/jep.v7i2.400

Retnawati, H. (2008). Identifying item bias using the simple volume indices and multidimensional item response theory likelihood ratio (IRT-LR) test. International Conference on Mathematics.

Retnawati, H. (2013). Pendeteksian keberfungsian butir pembeda dengan indeks volume sederhana berdasarkan teori respons butir multidimensi. Jurnal Penelitian Dan Evaluasi Pendidikan, 17(2).

Sanghi, S. (2007). The handbook of competency mapping: Understanding, designing and implementing competency models in organizations (2nd ed.). Sage Publications.

Scarci, F., Cecalupo, A., Mosca, O., & Maricchiolo, F. (2025). Addressing the gender environmentalism gap: The role of universalism, self-construal, and perceived urbanization in shaping environmental prioritization. Analyses of Social Issues and Public Policy. https://doi.org/10.1111/asap.70041

S.C.K. (2026). Design and evaluation of an Integrated Science Education Strategy (ISES) incorporating thematic team-teaching, traditional practices, and collaborative pedagogies for primary science learning. Discover Education (per DOI). https://doi.org/10.1007/s44217-026-01143-3

Sengupta, M., & Das, J. (2010). Environmental awareness and environment related behaviour of twelfth grade students in Kolkata: Effects of stream and gender. Anwesa, 5, 1–8.

Simsekli, Y. (2015). An Implementation To Raise Environmental Awareness Of Elementary Education Students. Procedia - Social and Behavioral Sciences, 191, 222–226. https://doi.org/10.1016/j.sbspro.2015.04.449

Sudira, P. (2011). Praksis ideologi Tri Hita Karana dalam pembudayaan kompetensi pada SMK di Bali [Doctoral dissertation]. Universitas Negeri Yogyakarta.

Tidball, K. G., & Krasny, M. E. (2011). Toward an ecology of environmental education and learning. Ecosphere, 2(2), art21. https://doi.org/10.1890/ES10-00153.1

Torkar, G., & Bogner, F. X. (2019). Environmental values and environmental concern. Environmental Education Research, 25(10), 1570–1581. https://doi.org/10.1080/13504622.2019.1649367

Wiradika, I. N. I. (2024). Asesmen dan Evaluasi Pendidikan dengan Program R (I. M. G. Sunarya, Ed.). Undiksha Press. https://www.penerbit.undiksha.ac.id

Xiao, C., & McCright, A. M. (2015). Gender Differences in Environmental Concern: Revisiting the Institutional Trust Hypothesis in the USA. Environment and Behavior, 47(1), 17–37. https://doi.org/10.1177/0013916513491571

Yunansah, H., & Herlambang, Y. T. (2017). PENDIDIKAN BERBASIS EKOPEDAGOGIK DALAM MENUMBUHKAN KESADARAN EKOLOGIS DAN MENGEMBANGKAN KARAKTER SISWA SEKOLAH DASAR. EduHumaniora | Jurnal Pendidikan Dasar Kampus Cibiru, 9(1), 27. https://doi.org/10.17509/eh.v9i1.6153

Downloads

Published

2026-03-30

How to Cite

I Nyoman Indhi Wiradika, & Gede Surya Mahendra. (2026). Gender and Grade DIF Analysis of Elementary School Students’ Ecological Awareness Instrument. Jurnal Evaluasi Dan Pembelajaran, 8(1), 1–11. https://doi.org/10.52647/jep.v8i1.493

Issue

Section

Articles