In:Audiovisual Input and Second Language Learning
Edited by Carmen Muñoz and Imma Miralpeix
[Language Learning & Language Teaching 61] 2024
► pp. 74–99
Attention allocation in (L1) subtitled
and (L2) captioned video
viewing
Effects of prior vocabulary instruction on input processing and comprehension
Published online: 26 September 2024
https://doi.org/10.1075/lllt.61.04puj
https://doi.org/10.1075/lllt.61.04puj
Abstract
Pre-directing learners’ attention to novel words
facilitates learning through meaning-focused input, but little is known
about the effect that vocabulary-focused activities may have on video
processing and comprehension. This study investigates attention allocation
in (L1) subtitled and (L2) captioned video viewing and explores potential
trade-offs between pre-viewing instruction and comprehension. Eighty-seven
Catalan/Spanish L2-English beginner learners watched an eight-minute video
with either captions or subtitles while their eye-movements were recorded.
Half of the participants in each language condition were pre-taught
vocabulary. Results showed that pre-viewing instruction affected attention
allocation only in the captions group, with participants tending to spend
less time on target captions and comprehension-relevant captions. Allocating
attention to vocabulary, however, did not seem to hinder comprehension in a
significant manner.
Article outline
- 1.Introduction
- 2.Literature review
- 2.1Vocabulary learning through L2 television
- 2.2The importance of attention allocation
- 2.3Pre-viewing instruction as an attention enhancing technique
- 2.4Trade-off effects
- 2.5Rationale and research aims
- 3.Methodology
- 3.1Participants
- 3.2Audiovisual materials
- 3.3Target words
- 3.4Pre- and post-viewing tasks
- 3.5Procedure
- 3.6Scoring and data analysis
- 4.Results
- 4.1Effect of instruction on dwell times and number of fixations on target-vocabulary AOIs
- 4.2Effect of instruction on comprehension rates
- 4.3Effect of instruction on dwell times and number of fixations on question-relevant AOIs
- 5.Discussion
- 6.Conclusion and further research
- Ethical considerations
Acknowledgements Notes References Appendix
References (44)
Avello, D., & Muñoz, C. (2023). The
development of receptive language skills from captioned video
viewing in primary school EFL
learners. Education
Sciences, 13(5), 479.
Ayres, P., & Sweller, J. (2005). The
split-attention principle in multimedia
learning. In R. E. Mayer (Ed.), The
Cambridge handbook of multimedia
learning (pp. 135–146). Cambridge University Press.
Bisson, M. J., Van Heuven, W. J., Conklin, K., & Tunney, R. J. (2014). Processing
of native and foreign language subtitles in films: An eye tracking
study. Applied
Psycholinguistics, 35(2), 399–418.
Chang, A. C. S., & Read, J. (2006). The
effects of listening support on the listening performance of EFL
learners. TESOL
Quarterly, 40(2), 375–397.
Choi, S. (2017). Processing
and learning of enhanced English collocations: An eye movement
study. Language Teaching
Research, 21(3), 403–426.
Chung, J. M. (2002). The
effects of using two advance organizers with video texts for the
teaching of listening in
English. Foreign Language
Annals, 35(2), 231–241.
Cochran, W. G. (1954). Some
methods for strengthening the common χ2
tests. Biometrics, 10(4), 417–451.
Elgort, I., Wetering, R. V. D., Arrow, T., & Beyersmann, E. (2023). Previewing
novel words before reading affects their processing during reading:
An eye-movement study with first and second language
readers. Language
Learning.
Gass, S., Winke, P., Isbell, D. R., & Ahn, J. (2019). How
captions help people learn languages: A working-memory, eye-tracking
study. Language Learning &
Technology, 23(2), 84–104.
Gesa, F., & Miralpeix, I. (2023). Extensive
viewing as additional input for foreign language vocabulary
learning: A longitudinal study in secondary
school. Language Teaching
Research.
Godfroid, A. (2019). Eye
tracking in second language acquisition and bilingualism: A research
synthesis and methodological
guide. Taylor and Francis.
Godfroid, A., Housen, A., & Boers, F. (2010). A
procedure for testing the Noticing Hypothesis in the context of
vocabulary
acquisition. In M. Pütz & L. Sicola (Eds.), Cognitive
processing in second language acquisition: Inside the learner’s
mind (pp. 169–197). John Benjamins.
Khan, N., Kasdar, J., Melvin, M., Blomquist, R., Huang, E., & McEwen, J. (2015). Fresh
off the Boat [TV
series]. ABC.
Laufer, B., & Hulstijn, J. (2001). Incidental
vocabulary acquisition in a second language: The construct of
task-induced involvement. Applied
linguistics, 22(1), 1–26.
Lee, S. K. (2007). Effects
of textual enhancement and topic familiarity on Korean EFL students’
reading comprehension and learning of passive
form. Language
Learning, 57(1), 87–118.
Lindgren, E., & Muñoz, C. (2013). The
influence of exposure, parents, and linguistic distance on young
European learners’ foreign language
comprehension. International Journal
of
Multilingualism, 10(1), 105–129.
Majuddin, E., Siyanova-Chanturia, A., & Boers, F. (2021). Incidental
acquisition of multiword expressions through audiovisual materials:
The role of repetition and typographic
enhancement. Studies in Second
Language
Acquisition, 43(5), 985–1008.
Montero Perez, M. (2019). Pre-learning
vocabulary before viewing captioned video: An eye-tracking
study. The Language Learning
Journal, 47(4), 460–478.
Montero Perez, M., Peters, E., & Desmet, P. (2015). Enhancing
vocabulary learning through captioned video: An eye-tracking
study. Modern Language
Journal, 99(2), 308–328.
(2018). Vocabulary
learning through viewing video: The effect of two enhancement
techniques. Computer Assisted
Language
Learning, 31(1–2), 1–26.
Montero Perez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned
video for L2 listening and vocabulary learning: A
meta-analysis. System, 41(3), 720–739.
Muñoz, C. (2017). The
role of age and proficiency in subtitle reading. An eye-tracking
study. System, 67, 77–86.
Nation, P., & Heatley, A. (2002). Range:
A program for the analysis of vocabulary in texts
[software].
Pellicer-Sánchez, A., Conklin, K., & Vilkaitė-Lozdienė, L. (2021a). The
effect of pre-reading instruction on vocabulary learning: An
investigation of L1 and L2 readers’ eye
movements. Language
Learning, 71(1), 162–203.
(2021b). (Re)
Examining the benefits of pre-reading instruction for vocabulary
learning. TESOL
Quarterly, 56(1), 363–375.
Peters, E. (2019). The
effect of imagery and on-screen text on foreign language vocabulary
learning from audiovisual
input. TESOL
Quarterly, 53(4), 1008–1032.
Peters, E., & Webb, S. (2018). Incidental
vocabulary acquisition through watching a single episode of L2
television. Studies in Second
Language
Acquisition, 40(3), 551–577.
Puimège, E., Montero Perez, M., & Peters, E. (2023). The
effects of typographic enhancement on L2 collocation processing and
learning from reading: An eye-tracking
study. Applied
Linguistics, 45(1), 88–110.
Pujadas, G., & Muñoz, C. (2019). Extensive
viewing of captioned and subtitled TV series: A study of L2
vocabulary learning by
adolescents. The Language Learning
Journal, 47(4), 479–496.
(2020). Examining
adolescent EFL learners’ TV viewing comprehension through captions
and subtitles. Studies in Second
Language
Acquisition, 42(3), 551–575.
(2023). Measuring
the visual in audio-visual input: The effects of imagery in
vocabulary learning through TV
viewing. ITL-International Journal of
Applied
Linguistics 174(2), 263–290.
Robinson, P. (2003). Attention
and memory during
SLA. In C. Doughty & M. Long (Eds.), Handbook
of research in second language
acquisition (pp. 631–678). Blackwell.
Rodgers, M. P. (2018). The
images in television programs and the potential for learning unknown
words: The relationship between on-screen imagery and
vocabulary. ITL-International Journal
of Applied
Linguistics, 169(1), 191–211.
Rodgers, M. P. H., & Webb, S. (2011). Narrow
viewing: The vocabulary in related television
programs. TESOL
Quarterly, 45(4), 689–717.
(2020). Incidental
vocabulary learning through watching
television. ITL – International
Journal of Applied
Linguistics, 171(2), 191–220.
Schmidt, R. W. (1990). The
role of consciousness in second language
learning. Applied
Linguistics, 11(2), 129–158.
Schmitt, N. (2008). Instructed
second language vocabulary
learning. Language Teaching
Research, 12(3), 329–363.
Teng, F. (2022). Vocabulary
learning through videos: Captions, advance-organizer strategy, and
their combination. Computer Assisted
Language
Learning, 35(3), 518–550.
Webb, S. (2015). Extensive
viewing: Language learning through watching
television. In D. Nunan & J. C. Richards (Eds.), Language
learning beyond the
classroom (pp. 159–168). Routledge.
