Article published In: Corpus-based Approaches to Spoken L2 Production: Evidence from the Trinity Lancaster Corpus
Edited by Vaclav Brezina, Dana Gablasova and Tony McEnery
[International Journal of Learner Corpus Research 5:2] 2019
► pp. 159–180
Filled pauses across proficiency levels, L1s and learning context variables
A multivariate exploration of the Trinity Lancaster Corpus Sample
Published online: 24 September 2019
https://doi.org/10.1075/ijlcr.17018.got
https://doi.org/10.1075/ijlcr.17018.got
Abstract
The present study investigates the use of filled pauses in the Trinity Lancaster Corpus Sample by 1,244 learners/second-language speakers of English at different proficiency levels (viz. B1-C2) from six different mother-tongue backgrounds, including speech communities in which English is spoken as a Foreign language (Italy, Mexico, Russia and Spain) and two speech communities where English is spoken as a second language (China/Hong Kong, India). Apart from the speakers’ country of origin and their proficiency levels, other learning context variables gathered from the learner profiles of the corpus sample are also taken into consideration. The study revealed that, while the number of filled pauses is indeed significantly different across proficiency levels, other learning context variables, such as the country of origin, the age of acquisition or the examiners’ experience turn out to have a much stronger effect on the learners’/speakers’ use of filled pauses. These findings are discussed with regard to their implications for learner corpus research in general, as well as the relevance of including such performance phenomena in current descriptor scales such as the Common European Framework of Reference for Languages in particular.
Keywords: fluency, filled pauses, learning context, proficiency
Article outline
- 1.Introduction
- 2.Filled pauses
- 2.1Filled pauses in ENL, ESL and EFL
- 2.2Pauses in the Common European Framework of Reference (CEFR): A learner corpus-based perspective
- 2.3Filled pauses and learning context
- 3.Research questions, database and methodology
- 4.Findings and discussion
- 4.1Filled pauses at different proficiency levels, across L1s and learning context variables
- 4.2Discussion
- 5.Conclusion and outlook
- Notes
References
References (69)
Alderson, J. C. 2007. “The CEFR and the need for more research”. The Modern Language Journal 91(4), 659–663.
Biber, D., Johannson, S., Leech, G., Conrad, S., and Finegan, E. 1999. Longman Grammar of Spoken and Written English. Harlow: Pearson Education.
Callies, M. & Götz, S. (Eds.) 2015. “Learner corpora in language testing and assessment: Prospects and challenges”. In M. Callies & S. Götz (Eds.), Learner Corpora in Language Testing and Assessment. Amsterdam: John Benjamins, 1–9.
Capitani, E., Laiacona, M. & Basso, A. 1998. “Phonetically cued word-fluency, gender differences and aging: A reappraisal”. Cortex 34(5), 779–783.
Clark, H. H. & Fox Tree, J. E. 2002. “Using uh and um in spontaneous speaking”. Cognition 841, 73–111.
Council of Europe. 2017. Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Companion Volume with new descriptors. Provisional Version. Avaliable at: <[URL]> (accessed September 2017).
De Jong, N., Steinel, M. P., Florijn, A., Schoonen, R. & Hulstijn, J. H. 2013. “Linguistic skills and speaking fluency in a second language”. Applied Psycholinguistics 34(5), 893–916.
De Jong, N., Groenhout, R., Schoonen, R. & Hulstijn, J. H. 2015. “Second language fluency: Speaking style or proficiency? Correcting measures of second language fluency for first language behavior”. Applied Psycholinguistics 36(2), 223–243.
Derwing, T. M., Munro, M. J., Thomson, R. I. & Rossiter, M. J. 2009. “The relationship between L1 fluency and L2 fluency development”. Studies in Second Language Acquisition 31(4), 533–557.
Díez-Bedmar, M. B. 2012. “The use of the Common European Framework of Reference for Languages to evaluate compositions in the English exam section of the university admission examination”. Revista de Educación 3571, 55–80.
2015. “Article use and criterial features in Spanish EFL writing: A pilot study from CEFRR A2 to B2 levels”. In M. Callies & S. Götz (Eds.), Learner Corpora in Language Testing and Assessment. Amsterdam: John Benjamins, 163–190.
2018. “Fine-tuning descriptors for CEFRR B1 level: Insights from learner corpora”. English Language Teaching Journal 72(2), 199–209.
Dumont, A. 2017a. “The contribution of learner corpora to the substantiation of fluency levels”. In P. De Haan, R. De Vries & S. Van Vuuren (Eds.), Language, Learners and Levels: Progression and Variation. Louvain-la-neuve: Presses Universitaires de Louvain, 281–308.
2017b. The effects of speaking task on L2 fluency. Paper presented at the 3rd Learner Corpus Research Conference
, EURAC Research Bolzano/Italy, 5–7 October 2017.
Freed, B., Segalowitz, N. & Dewy, D. P. 2004. “Context of learning and second language fluency in French: Comparing regular classroom, study abroad, and intensive domestic immersion programs”. Studies in Second Language Acquisition 26(2), 275–301.
Gilquin, G. 2008. “Hesitation markers among EFL learners: Pragmatic deficiency or difference?”. In J. Romero-Trillo (Ed.), Pragmatics and Corpus Linguistics: A Mutualistic Entente. Berlin: Mouton de Gruyter, 119–149.
Götz, S. 2013. Fluency in Native and Nonnative English Speech. Amsterdam: John Benjamins.
2015a. “Tense and aspect errors in spoken learner language: Implications for language testing and assessment”. In M. Callies & S. Götz (Eds.), Learner Corpora in Language Testing and Assessment. Amsterdam: John Benjamins, 191–215.
2015b. “Fluency in ENL, ESL and EFL: A corpus-based pilot study”. In R. Lickley (Ed.), Proceedings of Disfluency in Spontaneous Speech 2015. An ICPhS Satellite Meeting. University of Edinburgh.
2019. “Do learning context variables have an effect on learners’ (dis)fluency? Language-specific vs. universal patterns in advanced learners’ use of filled pauses”. In L. Degand, G. Gilquin, L. Meurant, A. C. Simon (Eds.), Fluency and Disfluency across Languages and Language Varieties. Louvain-la-neuve: Presses Universitaires de Louvain. 177–196.
Götz, S. & Mukherjee, J. 2012.
Er, erm, uh and uhm: Filled pauses in ENL, ESL and EFL. Paper presented at the 33rd Annual Conference of the International Computer Archive of Modern and Medieval English (ICAME 33), University of Leuven/Belgium, 30 May – 3 June, 2012.
2018. “The effect of the study abroad variable in spoken learner language: A pseudo-longitudinal study on spoken German learner English”. In V. Brezina & L. Flowerdew (Eds.), Learner Corpus Research: New Perspectives and Applications. London: Bloomsbury, 47–65.
Gráf, T. 2019. “Speech rate revisited: The effect of task design on speech rate”. In S. Götz & J. Mukherjee (Eds.), Learner Corpora and Language Teaching. Amsterdam: John Benjamins, 175–189.
Granger, S. 2015. “The contribution of learner corpora to reference and instructional materials design”. In S. Granger, G. Gilquin & F. Meunier (Eds.), Cambridge Handbook of Learner Corpus Research. Cambridge: Cambridge University Press, 485–510.
Grosjean, F. & Deschamps, A. 1975. “Analyse des variables temporelles de l’anglais et du français: Vitesse de parole et variables composantes, phénomènes d’hésitation”. Phonetica 31(3–4), 144–184.
Gries, S. Th. 2013a. Statistics for Linguistics with R: A Practical Introduction, 2nd rev. and ext. ed. Berlin: De Gruyter Mouton.
2013b. “Statistical tests for the analysis of learner corpus data”. In A. Díaz-Negrillo, N. Ballier & P. Thompson (Eds.), Automatic Treatment and Analysis of Learner Corpus Data. Amsterdam: John Benjamins, 287–309.
2015a. “Statistics for learner corpus research”. In G. Gilquin, S. Granger & F. Meunier (Eds.), The Cambridge Handbook of Learner Corpus Research. Cambridge: Cambridge University Press, 159–181.
Gut, U. & Fuchs, R. 2017. “Exploring speaker fluency with phonologically annotated ICE corpora”. World Englishes 36(3), 387–403.
Hasselgren, A. 2002. “Learner Corpora and language testing. Smallwords as markers of learner fluency”. In S. Granger, J. Hung & S. Petch-Tyson (Eds.), Computer Learner Corpora, Second Language Acquisition and Foreign Language Teaching. Amsterdam: John Benjamins, 143–174.
Hawkins, J. A. & Buttery, P. 2010. “Criterial features in learner corpora: Theory and illustrations”. English Profile Journal 1(1), 1–23.
Hawkins, J. A. & Filipović, L. 2012. Criterial Features in L2 English. Cambridge: Cambridge University Press.
Hulstijn, J. H. 2007. “The shaky ground beneath the CEFR: Quantitative and qualitative dimensions of language proficiency”. The Modern Language Journal 91(4), 663–667.
Iwashita, N., Brown, A., McNamara, T. & O’Hagan, S. 2008. “Assessed levels of second language speaking proficiency: How distinct?”. Applied Linguistics 29(1), 24–49.
Kilgarriff, A., Baisa, V., Bušta, J., Jakubíček, M., Kovář, V., Michelfeit, J., Rychly, P. & Suchomel, V. 2014. “The Sketch Engine: Ten years on”. Lexicography 1(1), 7–36.
Kormos, J. 1999. “Simulating conversations in oral-proficiency assessment: A conversation analysis of role plays and non-scripted interviews in language exams”. Language Testing 16(2), 163–188.
Leńko-Szymańska, A. 2015. “
The English Vocabulary Profile as a benchmark for assigning proficiency levels to learner corpus data”. In M. Callies & S. Götz (Eds.), Learner Corpora in Language Testing and Assessment. Amsterdam: John Benjamins, 115–140.
Lennon, P. 1990. “Investigating fluency in EFL: A quantitative approach”. Language Learning 40(3), 387–417.
2016. “Putting the CEFRR to good use: Designing grammars based on learner-corpus evidence”. Language Teaching 49(1), 99–115.
Mora, J. C. 2006. “Age effects on oral fluency development”. In C. Muñoz (Ed.), Age and the Rate of Foreign Language Learning. Clevedon: Multilingual Matters, 65–88.
Mukherjee, J. & Götz, S. 2015. “Learner corpora and learning context”. In S. Granger, G. Gilquin & F. Meunier (Eds.), Cambridge Handbook of Learner Corpus Research. Cambridge: Cambridge University Press, 423–442.
Norris, J. M. & Ortega, L. 2001. “Does type of instruction make a difference? Substantive findings from a meta-analytic review”. Language Learning 51(s1), 157–213.
North, B. 2000. The Development of a Common Framework Scale of Language Proficiency. Bern: Peter Lang.
2014. “Putting the Common European Framework of Reference to good use
”. Language Teaching 47(2), 228–249.
O’Connell, D. C. & Kowal, S. 2004. “The history of research on the filled pause as evidence of the written language bias in linguistics”. Journal of Psycholinguistic Research 33(4), 459–474.
O’Sullivan, B. 2000. “Exploring gender and oral proficiency interview performance”. System 28(3), 373–386.
Osborne, J. 2011. “Oral learner corpora and the assessment of fluency in the Common European Framework”. In A. Frankenberg-Garcia, L. Flowerdew & G. Aston (Eds.), New Trends in Corpora and Language Learning. London: Continuum, 251–256.
Paquot, M. & Plonsky, L. 2017. “Quantitative research methods and study quality in learner corpus research”. International Journal of Learner Corpus Research 3(1), 61–94.
Park, K. 2014. “Corpora and language assessment: The state of the art”. Language Assessment Quarterly 11(1), 27–42.
Peltonen, P. 2018. “Exploring connections between first and second language fluency: A mixed methods approach”. The Modern Language Journal 102(4), 676–692.
Porter, D. 1991. “Affective factors in language testing”. In J. C. Alderson & B. North (Eds.), Language Testing in the 1990s. London: Macmillan, 32–40.
Préfontaine, Y., Kormos, J., & Johnson, D. E. 2016. “How do utterance measures predict raters’ perceptions of fluency in French as a second language?”. Language Testing 33(1), 53–73.
R Development Core Team. 2017. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. <[URL]> (last accessed March 2018).
Rose, R. 2008. “Filled pauses in language teaching: why and how”. Bulletin of Gunma Prefectural Women’s University 291, 47–64.
Rühlemann, C. 2006. “Coming to terms with conversational grammar: ‘Dislocation’ and ‘dysfluency’”. International Journal of Corpus Linguistics 11(4), 385–409.
Safa, A. E., Roy, E. A. & Sharratt, M. T. 2011. “Age and verbal fluency: The mediating effect of speed of processing”. Canadian Geriatrics Journal 14(3), 65–72.
Schneider, G. & North, B. 2000. Fremdsprachen können – was heisst das? Skalen zur Beschreibung, Beurteilung und Selbsteinschätzung der fremdsprachlichen Kommunikationsfähigkeit. Zürich: Rüegger.
Thewissen, J. 2011. “Capturing L2 accuracy developmental patterns: Insights from an error-tagged EFL learner corpus”. Modern Language Journal 97(S1), 77–101.
2016. Accuracy across Proficiency Levels. A Learner Corpus Approach. Louvain-la-Neuve: Presses Universitaires de Louvain.
Timofeev, R. 2007. Classification and Regression Trees (CART): Theory and Applications. Master Thesis, Humboldt University Berlin.
Tottie, G. 2011. “
Uh and Um as sociolinguistic markers in British English”. International Journal of Corpus Linguistics 16(2), 173–197.
Wisniewski, K. 2014. Die Validität der Skalen des Gemeinsamen europäischen Referenzrahmens für Sprachen. Eine empirische Untersuchung der Flüssigkeits- und Wortschatzskalen des GeRS am Beispiel des Italienischen und des Deutschen. Frankfurt: Peter Lang.
Cited by (16)
Cited by 16 other publications
Peltonen, Pauliina, Sandra Götz & Pekka Lintunen
Yan, Xun, Ping-Lin Chuang, Yulin Pan, Huiying Cai, Shelley Staples & Mariana Centanin Bertho
Gilquin, Gaëtanelle
Granger, Sylviane
2024. From early to future learner corpus research. International Journal of Learner Corpus Research 10:2 ► pp. 247 ff.
Götz, Sandra & Sylviane Granger
2024. Learner corpus research for pedagogical purposes. International Journal of Learner Corpus Research 10:1 ► pp. 1 ff.
Szyszka, Magdalena, Pauliina Peltonen & Pekka Lintunen
Belz, Malte
Souza, Lívia Maria Santos de, Vanessa de Oliveira Martins-Reis, Pâmela Jesus dos Santos, Dianete Ângela do Valle Gomes, Aveliny Mantovan Lima & Letícia Correa Celeste
Belz, Malte & Carolin Odebrecht
Eren, Ömer, Mehmet Kılıç & Erdoğan Bada
Götz, Sandra, Christoph Wolk & Katja Jäschke
2022. Contextualizing fluency in advanced spoken learner language. In Complexity, Accuracy and Fluency in Learner Corpus Research [Studies in Corpus Linguistics, 104], ► pp. 273 ff.
Larsson, Tove, Luke Plonsky & Gregory R. Hancock
2022. On learner characteristics and why we should model them as latent variables. International Journal of Learner Corpus Research 8:2 ► pp. 237 ff.
Staples, Shelley & Karin Puga
2022. Integrating fluency and prosody into multidimensional analysis. International Journal of Learner Corpus Research 8:2 ► pp. 190 ff.
Williams, Simon
Staley, Larssyn & Andreas H. Jucker
[no author supplied]
This list is based on CrossRef data as of 12 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
