Article published In: Journal of Immersion and Content-Based Language Education
Vol. 12:2 (2024) ► pp.135–161
Cognitive processes and strategies of bilingual students when attempting assessments in an L2
Published online: 11 December 2023
https://doi.org/10.1075/jicb.23011.ten
https://doi.org/10.1075/jicb.23011.ten
Abstract
In bilingual education programs, students learn content knowledge through an additional language (L2). Their
content knowledge is also assessed through their L2, which raises concerns about underestimating their actual learning. This study
addresses such concerns by investigating the cognitive processes and strategies of bilingual learners when being assessed in their
L2. 49 university students, divided into more proficient and less proficient L2 learners, participated in an eye-tracking
experiment which captured their eye movements when attempting a biology assessment. They then reported their thinking processes
and strategies during the assessment process in a stimulated recall. In general, the participants engaged in more cognitive
processes when attempting questions that were more cognitively demanding and required productive language skills. The less
proficient group had more and longer fixations and regressions than their more proficient counterparts, but the two groups
reported similar strategies. These findings have implications for assessment design in bilingual education programs.
Keywords: bilingual education, assessment, eye-tracking, cognitive processing, strategies
抽象的
在雙語教育中,學生透過附加語言(L2)學習學科知識,並以此L2參與學科的評估。這評估方式很可能低估了學生的實際學習進度,因而未必準確。
本研究調查雙語學生以L2進行評估時的思考過程和策略,以加深對雙語教育評估潛在問題的了解。 49 名大學生參加了一項眼球追蹤實驗,他們被分為英語程度較高和較低兩組。該實驗紀錄了他們在作答生物科評估問題時的眼球移動。
然後,他們在刺激回憶訪談中報告了在評估過程中的思考過程和策略。 研究結果顯示,參加者在作答認知要求和語文能力要求較高的問題時,會經歷較深入的思考過程。 英語程度較低的參加者比英語程度較高者有更多、更長的注視和回望,但兩組報告了相似的策略。
這些研究結果對雙語教育的評估設計有啟示作用。
Article outline
- 1.Introduction
- 1.1Assessment issues of bilingual learners
- 1.2Cognitive processing of bi/multilinguals
- 2.Methods
- 2.1Research design
- 2.2Participants
- 2.3Research instruments
- 2.4Experiment procedures
- 2.5Data analysis
- 3.Results
- 3.1Impact of cognitive demands, linguistic demands and L2 proficiency levels on cognitive processing of bilingual students
- 3.2Strategies adopted by bilingual students when attempting assessments
- 4.Discussion
- 5.Conclusion
References
References (41)
Attar, Z., Blom, E., & Le Pichon, E. (2022). Towards
more multilingual practices in the mathematics assessment of young refugee students: Effects of testing language and validity
of parental assessment. International Journal of Bilingual Education and
Bilingualism, 25(4), 1546–1561.
Brown, C. L. (2005). Equity
of literacy-based math performance assessments for English language learners. Bilingual
Research
Journal, 29(2), 337–363.
Brown, L., Sherbenou, R. J., & Johnsen, S. K. (2010). Test
of Nonverbal Intelligence (4th
ed.) (TONI-4). Pro-Ed.
Catrysse, L., Gijbels, D., Donche, V., de Maeyer, S., van den Bossche, P., & Gommers, L. (2016). Mapping
processing strategies in learning from expository text: An exploratory eye tracking study followed by a cued
recall. Frontline Learning
Research, 4(1), 1–16.
Castellano-Risco, I., Alejo-González, R., & Piquer-Píriz, A. M. (2020). The
development of receptive vocabulary in CLIL vs EFL: Is the learning context the main
variable? System, 911, 102263.
Cummins, J. (1981). The
role of primary language development in promoting educational success for language minority
students. In California State Department of
Education (Ed.), Schooling and Language Minority Students: A Theoretical
Rationale (pp. 3–49). California State University.
Dalton-Puffer, C. (2013). A
construct of cognitive discourse functions for conceptualising content-language integration in CLIL and multilingual
education. European Journal of Applied
Linguistics, 1(2), 216–253.
Dalton-Puffer, C., Hüttner, J., & Llinares, A. (2022). CLIL
in the 21st Century: Retrospective and prospective challenges and opportunities. Journal of
Immersion and Content-Based Language
Education, 10(2), 182–206.
Fernández-Sanjurjo, J., Fernández-Costales, A., & Blanco, J. M. A. (2019). Analysing
students’ content-learning in science in CLIL vs. non-CLIL programmes: Empirical evidence from
Spain. International Journal of Bilingual Education and
Bilingualism, 22(6), 661–674.
García, O., & Sylvan, C. (2011). Pedagogies
and practices in multilingual classrooms: Singularities in pluralities. The Modern Language
Journal, 95(3), 85–400.
Gorter, G., & Cenoz, J. (2017). Language
education policy and multilingual assessment. Language and
Education, 31(3), 231–248.
Hawker, I. A. (2013). The
CLIL learning experience: Strategies and underlying knowledge employed by limited English primary school students during
conceptual and linguistics comprehension. In S. Breidbach & B. Viebrock (Eds.), Content
and Language Integrated Learning (CLIL) in
Europe (pp. 159–179). Peter Lang.
HKEAA (Hong Kong Examination and Assessment
Authority). (2022). 2022 HKDSE entry statistics. [URL]
Hsiao, J. H., & Cottrell, G. W. (2008). Two
fixations suffice in face recognition. Psychological
Science, 9(10), 998–1006.
Hultgren, A. K., Owen, N., Shrestha, P., Kuteeva, M., & Mežek, S. (2022). Assessment
and English as a medium of instruction: Challenges and opportunities. Journal of English-Medium
Instruction, 1(1), 105–123.
Johnsen, S. K., Brown, L., & Sherbenou, R. J. (2010). Test
of nonverbal intelligence: Critical reviews and research findings,
1982–2009. Pro-Ed.
Just, M. A., & Carpenter, P. A. (1980). A
theory of reading: From eye fixations to comprehension. Psychological
Review, 87(4), 329–354.
Kane, M., & Bejar, I. (2014). Cognitive
frameworks for assessment, teaching, and learning: A validity perspective. Psicología
Educativa, 201, 117–122.
Keating, G. D. (2014). Eye-tracking
with text. In J. Jegerski & B. VanPatten (Eds.), Research
methods in second language
psycholinguistics (pp. 69–92). Routledge.
Kroll, J. F., van Hell, J. G., Tokowicz, N., & Green, D. W. (2010). The
revised hierarchical model: A critical review and assessment. Bilingualism: Language and
Cognition, 13(3), 373–391.
Lemhöfer, K., & Broersma, M. (2012). Introducing
LexTALE: A quick and valid lexical test for advanced learners of English. Behaviour Research
Methods, 441, 325–343.
Levin, T., & Shohamy, E. (2008). Achievement
of immigrant students in mathematics and academic Herbrew in Israeli school: A large-scale evaluation
study. Studies in Educational
Evaluation, 34(1), 1–14.
Lin, A. M. Y. (2016). Language
across the curriculum and CLIL in English as an Additional Language (EAL) contexts: theory and
practice. Springer.
Lo, Y. Y., & Fung, D. (2020). Assessments
in CLIL: The interplay between cognitive and linguistic demands and their progression in secondary
education. International Journal of Bilingual Education and
Bilingualism, 23(10), 1192–1210.
Lo, Y. Y., Fung, D., & Qiu, X. (2021). Assessing
content knowledge through L2: Mediating role of language of testing on students’
performance. Journal of Multilingual and Multicultural Development.
Macaro, E. (2022). Learner
strategies in an English Medium Instruction context. In B. Di Sabato & B. Hughes (Eds.), Multilingual
perspectives from Europe and beyond on language policy and
practice (pp. 63–81). Routledge.
Macaro, E., Briggs Baffoe-Djan, J., Rose, H., Di Sabato, B., Hughes, B., Cuccurullo, D., Coonan, C. M., Menegale, M., & Bier, A. (2019). Transition
from Secondary School CLIL to EMI at University: Initial Evidence from Research in
Italy. British Council. [URL]
Massler, U., Stotz, D., & Queisser, C. (2014). Assessment
instruments for primary CLIL: The conceptualisation and evaluation of test tasks. The Language
Learning
Journal, 42(2), 137–150.
Morton, T., & Llinares, A. (2017). Content
and Language Integrated Learning: Type of programme or pedagogical
model? In A. Llinares & T. Morton (Eds.), Applied
Linguistics Perspectives on
CLIL (pp. 1–16). John Benjamins.
Otto, A., & Estrada, J. L. (2019). Towards
an Understanding of CLIL in a European Context: Main assessment tools and the role of language in content
subjects. CLIL Journal of Innovation and Research in Plurilingual and Pluricultural
Education, 2(1), 31–42. [URL].
Pavlenko, A. (2009). Conceptual
representation in the bilingual lexicon and L2 vocabulary
learning. In A. Pavlenko (Ed.), The
Bilingual mental lexicon. interdisciplinary
approaches (pp. 125–160). Multilingual Matters.
Pellicer-Sánchez, A. (2016). Incidental
L2 vocabulary acquisition from and while reading. Studies in Second Language
Acquisition, 38(1), 97–130.
Rayner, K. (2009). Eye
movements and attention in reading, scene perception, and visual search. The Quarterly Journal
of Experimental
Psychology, 62(8), 1457–1506.
Shaw, S., & Imam, H. (2013). Assessment
of international students through the medium of English: Ensuring validity and fairness in content-based
examinations. Language Assessment
Quarterly, 10(4), 452–475.
Shohamy, E. (2011). Assessing
multilingual competencies: Adopting construct valid assessment policies. The Modern Language
Journal, 95(3), 418–429.
Soruç, A. & Griffiths, C. (2018). English
as a medium of instruction: students’ strategies. ELT
Journal, 72(1), 38–48.
Cited by (2)
Cited by two other publications
Hamaniuk, Vita A., Iryna A. Selyshcheva & Olena V. Hladka
This list is based on CrossRef data as of 13 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
