Selecting an Appropriate Cognitive Diagnostic Model for Eighth Grade Math Questions: TIMSS 2019 Study
DOI:
https://doi.org/10.61838/kman.pdmd.3.2.2Keywords:
Cognitive Diagnostic Models, Model Fit, TIMSS 2019, MathematicsAbstract
Background and Objective: Traditional assessment methods have been criticized for neglecting the cognitive processes required by test-takers to provide correct responses. To address these issues, cognitive diagnostic models have been introduced by researchers. This study aimed to explore and apply cognitive diagnostic models to estimate the psychometric properties of published eighth-grade math questions from TIMSS 2019.
Methods and Materials: The research method employed in this study is mixed-methods, conducted with a retrofitting approach to existing tests. The statistical population of this study consisted of all Iranian eighth-grade students who participated in the TIMSS 2019 study. The population size included 1,095,026 students from 23,895 schools. The sample consisted of 5,980 Iranian eighth-grade students from 220 schools, selected through a two-stage cluster sampling method, with an average age reported as 14.1 years.
Findings: Using a qualitative method, 16 skills across four content domains—knowledge, application, and reasoning—were identified and the Q-matrix was developed. Then, in the quantitative section, the fit of the DINA model as a compensatory model, the DINO model as a non-compensatory model, and the G-DINA model as a general model were examined with data from students' responses to math questions in blocks 1, 2, 3, and 5. The findings showed that in terms of model fit, the G-DINA model had the weakest fit, while the DINA model had the best fit. Absolute fit indices of the models also indicated that the DINA model was better, and the DINO model did not fit. Relative fit indices of the models showed no significant difference between the G-DINA model and the other two models, and overall, the non-compensatory DINA model demonstrated the best fit.
Conclusion: The results indicated that the DINA model had the best fit with the data and can be considered the optimal model for analyzing the eighth-grade mathematics questions in TIMSS 2019.
Downloads
References
Amiri, M., Rahmani, J., & Saadatmand, Z. (2023). Studying the Social Health of Students with an Emphasis on Curriculum
Planning [Research Article]. Iranian Journal of Educational Sociology, 6(2), 168-175.
https://doi.org/10.61186/ijes.6.2.168
Araujo, A. A. d. (2011). Adjustment Issues of International Students Enrolled in American Colleges and Universities: A Review
of the Literature. Higher Education Studies, 1(1). https://doi.org/10.5539/hes.v1n1p2
Assante, G. M., Popa, N., & Grădinariu, T. (2022). Evidence to the Need for a Unifying Framework: Critical Consciousness
and Moral Education in Adolescents Facilitate Altruistic Behaviour in the Community. Behavioral Sciences, 12(10), 376.
https://doi.org/10.3390/bs12100376
Bilgin, O., & Taş, İ. (2018). Effects of Perceived Social Support and Psychological Resilience on Social Media Addiction
Among University Students. Universal Journal of Educational Research, 6(4), 751-758.
https://doi.org/10.13189/ujer.2018.060418
Bozanta, A., & Mardikyan, S. (2017). The Effects of Social Media Use on Collaborative Learning: A Case of Turkey. Turkish
Online Journal of Distance Education, 18(1), 96-96. https://doi.org/10.17718/tojde.285719
Casado, R. d. P., Frías-Osuna, A., Palomino-Moral, P. A., Ruzafa‐Martínez, M., & Ramos-Morcillo, A. J. (2018). Social
Support and Subjective Burden in Caregivers of Adults and Older Adults: A Meta-Analysis. PLoS One, 13(1), e0189874.
https://doi.org/10.1371/journal.pone.0189874
Dawson, K. J., Han, H., & Choi, Y. (2021). How Are Moral Foundations Associated With Empathic Traits and Moral Identity?
Current Psychology, 42(13), 10836-10848. https://doi.org/10.1007/s12144-021-02372-5
Edgcumbe, D. R. (2019). Edgcumbe. 2019 - The Relationship Between Cognitive Reflection and Morality Judgments Are
Mediated by Thinking Dispositions. https://doi.org/10.31234/osf.io/aeyd8
Frier, A., Devine, S., Barnett, F., & Dunning, T. (2019). Utilising Clinical Settings to Identify and Respond to the Social
Determinants of Health of Individuals With Type 2 Diabetes—A Review of the Literature. Health & Social Care in the
Community, 28(4), 1119-1133. https://doi.org/10.1111/hsc.12932
Golabchi, H., Kiaee, M., & Kameli, M. J. (2024). Designing a Superior Service Delivery Model in Education to Enhance Public
Satisfaction
[Research
Article].
Iranian
Journal
of
Educational
Sociology,
7(1),
189-197.
https://doi.org/10.61838/kman.ijes.7.1.18
Goodyke, M. P., Hershberger, P. E., & Dunn, S. L. (2021). Perceived Social Support and Heart Rate Variability: An Integrative
Review. Western Journal of Nursing Research, 44(11), 1057-1067. https://doi.org/10.1177/01939459211028908
Grennan, S., Mannion, A., & Leader, G. (2018). Gelotophobia and High-Functioning Autism Spectrum Disorder. Review
Journal of Autism and Developmental Disorders, 5(4), 349-359. https://doi.org/10.1007/s40489-018-0144-6
Hem, M. H., Molewijk, B., Gjerberg, E., Lillemoen, L., & Pedersen, R. (2018). The Significance of Ethics Reflection Groups
in Mental Health Care: A Focus Group Study Among Health Care Professionals. BMC Medical Ethics, 19(1).
https://doi.org/10.1186/s12910-018-0297-y
Jiang, J., & Luo, D. (2021). The Relationship Between Perceived Social Support and Social in College Students: The Mediation
of Sense of Coherence. SHS Web of Conferences, 123, 01006. https://doi.org/10.1051/shsconf/202112301006
Khakpour, N., Mohamadzadeh Edmelaie, R., Sadeghi, J., & Nazoktabar, H. (2021). The Effectiveness of Cognitive-Social
Problem Solving Skills Training on Coping Strategies and Feelings of Failure in Female Adolescents with High-Risk
Behaviors [Research]. Journal of nursing education, 9(1), 77-88. http://ijpn.ir/article-1-1734-en.html
Napier, J. L., & Luguri, J. B. (2013). Moral Mind-Sets. Social Psychological and Personality Science, 4(6), 754-759.
https://doi.org/10.1177/1948550612473783
Pourmaveddat, K., Neshat Doost, H. T., Kajbaf, M. B., & Talebi, H. (2021). Comparison of social information processing
based on Crick & Dodge's social cognitive model in children with and without disruptive mood dysregulation disorder
[Research]. Advances in Cognitive Sciences, 23(2), 33-46. https://doi.org/10.30514/icss.23.2.3
Shiravand, M., & Mirhadi, Z. (2020). The Role of Questioning of the Educators (Teachers) in Intellectual Cultivation of the
Educated (Students) Focusing on the Traditions of Immaculate Imams (peace be upon them). Ethical Reflections, 1(1),
135-154. https://jer.znu.ac.ir/article_37557_f5dc6271cbd82f3cbe700ead206af2ef.pdf
Sun, L. (2019). Perceived Organizational Support: A Literature Review. International Journal of Human Resource Studies,
9(3), 155. https://doi.org/10.5296/ijhrs.v9i3.15102
Ulubey, Ö., & Alpaslan, M. M. (2022). Examination of the Relationship between Educational Philosophy, Critical Thinking,
Classroom Engagement and Academic Achievement. Psycho-Educational Research Reviews, 11(3), 462-479.
https://doi.org/10.52963/PERR_Biruni_V11.N3.05
Wang, Y. (2024). Ethical Concepts in the Tao Te Ching and Professional Ethics Education: Principles, Challenges, and
Opportunities. The Educational Review Usa, 8(2), 232-236. https://doi.org/10.26855/er.2024.02.006
Weinstock, M., Assor, A., & Broide, G. (2008). Schools as Promoters of Moral Judgment: The Essential Role of Teachers’
Encouragement of Critical Thinking. Social Psychology of Education, 12(1), 137-151. https://doi.org/10.1007/s11218
008-9068-9
Yıldırım, D., & Akman, Ö. (2023). Perceived Social Support and Psychological Well-Being in Patients With Chronic Diseases.
Balıkesır Health Sciences Journal. https://doi.org/10.53424/balikesirsbd.1202679
Downloads
Publication Timeline
- Submitted
- Revised
- Accepted
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
