Developing and validating a listening mindset questionnaire through Think-Aloud Protocol
Keywords:
Growth and Fixed Language Mindset, Listening Skill, Listening Mindset Questionnaire, Think, Aloud ProtocolsAbstract
Purpose: This study aims to develop and validate the Listening Mindsets Questionnaire (LMQ) to assess EFL learners' incremental (growth) and entity (fixed) mindsets regarding English listening skills.
Methodology: The research employed a mixed-methods approach, specifically a convergent parallel design. The Listening Mindsets Questionnaire (LMQ) was developed based on the framework of Lou and Noels (2017) and consisted of 18 items. It was administered to 289 English language learners at B1, B2, and C1 levels according to the Common European Framework of Reference (CEFR), studying at various English institutes in Zanjan, Iran. Additionally, 10 learners were randomly selected to participate in Think-Aloud Protocols for qualitative validation. The validity of the questionnaire was assessed through factor analysis and Think-Aloud Protocols, while reliability was measured using Cronbach’s Alpha. The qualitative data obtained from Think-Aloud Protocols were analyzed through coding in MAXQDA software.
Findings: The results from both the factor analysis and the qualitative coding of Think-Aloud Protocols confirmed the validity of the newly developed questionnaire. The LMQ demonstrated a clear factor structure that aligned with the theoretical framework, ensuring its appropriateness for measuring listening mindsets. Additionally, Think-Aloud Protocols supported the questionnaire's validity but highlighted certain limitations in using verbal reports as a validation method. The reliability analysis indicated that the LMQ had a high internal consistency, confirming its suitability for assessing EFL learners' mindsets toward listening.
Conclusion: The study provides empirical support for the validity and reliability of the Listening Mindsets Questionnaire (LMQ). The instrument can serve as a useful tool for researchers and educators to assess and understand learners’ perceptions of language learning ability in the context of listening skills. Future research should explore further refinements and applications of the questionnaire across diverse learner populations.
Downloads
References
Abdellatif, M. S., Alshehri, M. A., Alshehri, H. W. E., Gafar, M. G., & Lamouchi, A. (2024). I am all ears: listening exams with AI and its traces on foreign language learners' mindsets, self-competence, resilience, and listening improvement. Language testing in Asia, 14(54). https://doi.org/10.1186/s40468-024-00329-6
Alzamil, J. (2021). Listening Skills: Important but Difficult to Learn. Arab World English Journal (AWEJ), 12(3). https://doi.org/10.24093/awej/vol12no3.25
Claro, S., Paunesku, D., & Dweck, C. S. (2016). Growth mindset tempers the effects of poverty on academic achievement. Proceedings of the National Academy of Sciences, 113(31), 8664-8668. https://doi.org/10.1073/pnas.1608207113
Cohen, A. D., & Wang, I. K. H. (2024). Revisiting 'think aloud' in language learner strategy research. Language Teaching Research. https://doi.org/10.1177/13621688241266949
Derakhshan, A., & Fathi, J. (2024). Growth mindset, self-efficacy, and self-regulation: A symphony of success in L2 speaking. System, 123, 103320. https://doi.org/10.1016/j.system.2024.103320
Dweck, C. S. (2008). Mindset: The new psychology of success. Random House Digital, Inc. https://books.google.com/books/about/Mindset.html?id=fdjqz0TPL2wC
Dweck, C. S. (2010). Mindset and Equitable Education. Principal leadership, 26-29. https://www.greatschoolspartnership.org/wp-content/uploads/2016/11/Mindsets-and-Equitable-Education.pdf
Dweck, C. S. (2013). Self-theories: Their role in motivation, personality, and development. Psychology Press. https://www.taylorfrancis.com/books/mono/10.4324/9781315783048/self-theories-carol-dweck
Dweck, C. S. (2019). The Choice to Make a Difference. Perspectives on Psychological Science, 14(1), 21-25. https://doi.org/10.1177/1745691618804180
Eren, A., & Rakıcıoğlu-Söylemez, A. (2023). Language mindsets, perceived instrumentality, engagement and graded performance in English as a foreign language student. Language Teaching Research, 27(3), 544-574. https://doi.org/10.1177/1362168820958400
Fayzullayeva, N. (2023). THE IMPROVING OF LISTENING SKILL. Modern Science and Research, 2(10), 272-276. https://inlibrary.uz/index.php/science-research/article/view/25086
Hochanadel, A., & Finamore, D. (2015). Fixed and growth mindset in education and how grit helps students persist in the face of adversity. Journal of International Education Research, 11. https://doi.org/10.19030/jier.v11i1.9099
Hoeve, S. (2018). Using mindset pedagogy to promote growth and increase efficacy in student writers Western Michigan University]. https://scholarworks.wmich.edu/dissertations/3321
Khajavy, G. H., MacIntyre, P. D., & Hariri, J. (2020). A Closer Look at Grit and Language Mindset as Predictors of Foreign Language Achievement. Studies in Second Language Acquisition, 43(2), 379-402. https://doi.org/10.1017/S0272263120000480
Khajavy, G. H., Pourtahmasb, F., & Li, C. (2021). Examining the domain-specificity of language mindset: a case of L2 reading comprehension. Innovation in Language Learning and Teaching, 16(3), 208-220. https://doi.org/10.1080/17501229.2021.1956936
Lanvers, U. (2020). Changing language mindsets about modern languages: a school intervention. The Language Learning Journal. https://doi.org/10.1080/09571736.2020.1802771
Leslie, S. J., Cimpian, A., Meyer, M., & Freeland, E. (2015). Expectations of brilliance underlie gender distributions across academic disciplines. Science, 347(6219), 262-265. https://doi.org/10.1126/science.1261375
Lou, N., Chaffee, K. E. M., & Noels, K. A. (2022). Growth, fixed, and mixed mindsets: Mindset system profiles in foreign language learners and their role in engagement and achievement. Studies in Second Language Acquisition, 44(3), 607-632. https://doi.org/10.1017/S0272263121000401
Lou, N. M., & Noels, K. A. (2016). Changing language mindsets: Implications for goal orientations and responses to failure in and outside the second language classroom. Contemporary Educational Psychology, 46, 22-33. https://doi.org/10.1016/j.cedpsych.2016.03.004
Lou, N. M., & Noels, K. A. (2017). Measuring language mindsets and modeling their relations with goal orientations and emotional and behavioral responses in failure situations. The Modern Language Journal, 101(1), 214-243. https://doi.org/10.1016/j.cedpsych.2016.03.004
Lou, N. M., & Noels, K. A. (2019). Language Mindsets, Meaning-Making, and Motivation. In M. Lamb, K. Csizér, A. Henry, & S. Ryan (Eds.), The Palgrave Handbook of Motivation for Language Learning (pp. 537-559). Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-030-28380-3_26
Lou, N. M., & Noels, K. A. (2020). Breaking the vicious cycle of language anxiety: Growth language mindsets improve lower-competence ESL students' intercultural interactions. Contemporary Educational Psychology, 61, 101847. https://doi.org/10.1016/j.cedpsych.2020.101847
Nunan, D. (1998). Approaches to Teaching Listening in the Language Classroom. Seoul.
Nurraida, & Muharrami, N. (2022). The Correlation Between Students' Mindset and Speaking Skill: A correlational Study. English Teaching and Linguistics Journal (ETLiJ), 3(2), 153-155. https://doi.org/10.30596/etlij.v3i2.11001
Ocampo, M. B. (2016). Brainwaves of Emotion among Japanese EFL Learners as Proof of the Effectiveness of Family Environment Mode Approach (FEMA). PEOPLE: International Journal of Social Sciences, 2(1). https://doi.org/10.20319/pijss.2016.s21.196211
Papi, M., Wolff, D., & Bellwoar, E. (2021). Motivational factors underlying learner preferences for corrective feedback: Language mindsets and achievement goals. Language Teaching Research, 25(6). https://doi.org/10.1177/13621688211018808
Pepper, D., Hodgen, J., Lamesoo, K., Kõiv, P., & Tolboom, J. (2016). Think aloud: using cognitive interviewing to validate the PISA assessment of student self-efficacy in mathematics. International Journal of Research & Method in Education, 41(1), 3-16. https://doi.org/10.1080/1743727X.2016.1238891
Resnick, L. B., & Hall, M. W. (2003). Principles of learning for effort-based education. University of Pittsburgh. https://peacethruknowledge.wordpress.com/wp-content/uploads/2013/03/principles_of_learning_for_effort_based_education_resnick.pdf
Shirvan, M. E., Lou, N. M., & Taherian, T. (2021). Where do Language Mindsets Come from? An Ecological Perspective on EFL Students' Mindsets About L2 Writing. Journal of Psycholinguistic Research, 50, 1065-1086. https://doi.org/10.1007/s10936-021-09787-y
Solak, E., & Altay, F. (2014). Prospective EFL Teachers' Perceptions of Listening Comprehension Problems in Turkey. Journal of international social research, 7(30), 190-198. https://files.eric.ed.gov/fulltext/ED553402.pdf
Thu, L. N. A., & Vien, T. (2022). The Effects of Think-Aloud Strategy on EFL Young Learners' Reading Skill Practice. European Journal of English Language Teaching, 7(5). https://doi.org/10.46827/ejel.v7i5.4503
Yeager, D. S., & Dweck, C. S. (2012). Mindsets that promote resilience: When students believe that personal characteristics can be developed. Educational Psychologist, 47(4), 302-314. https://doi.org/10.1080/00461520.2012.722805
Zarrinabadi, N., Lou, N. M., & Shirzad, M. (2021). Autonomy support predicts language mindsets: Implications for developing communicative competence and willingness to communicate in EFL classrooms. Learning and Individual Differences, 86, 101981. https://doi.org/10.1016/j.lindif.2021.101981
Zarrinabadi, N., & Mantou Lou, N. (2022). Mindsets in language learning and teaching: an introduction to the special issue. Innovation in Language Learning and Teaching, 16(3), 205-207. https://doi.org/10.1080/17501229.2022.2080955
Zeeb, H., Ostertag, J., & Renkl, A. (2020). Towards a Growth Mindset Culture in the Classroom: Implementation of a Lesson-Integrated Mindset Training. Education Research International, 2020, Article ID 8067619. https://doi.org/10.1155/2020/8067619
Downloads
Published
Submitted
Revised
Accepted
Issue
Section
License
Copyright (c) 2024 Seyed Behnam Arabi Zanjani, Mahshad Tasnimi, Mahnaz Azad (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
