In:Complexity, Accuracy and Fluency in Learner Corpus Research
Edited by Agnieszka Leńko-Szymańska and Sandra Götz
[Studies in Corpus Linguistics 104] 2022
► pp. 137–158
Persistent errors in spoken English among Taiwanese and Czech learners at CEFR B2 and C1
Published online: 1 December 2022
https://doi.org/10.1075/scl.104.06gra
https://doi.org/10.1075/scl.104.06gra
Abstract
The study provides empirical evidence illustrating the development of grammatical accuracy in spoken learner English from CEFR’s B2 to C1 levels of accuracy. It uses the CEFR-rated and error-tagged Taiwanese and Czech sub-corpora of LINDSEI containing altogether 54 B2 and 36 C1 speakers. The analysis of the 5,120 identified errors revealed a threefold increase in accuracy at the C1 level. However, some errors which might be labelled persistent were identified, namely errors in some aspects of the use of articles and errors in the use of some verb tenses. The study contributes to the discussion of criterial features for proficiency levels.
Keywords: learner corpus, computer-aided error analysis, speaking accuracy, LINDSEI, CEFR
Article outline
- 1.Introduction
- 2.Accuracy in spoken learner language
- 3.Data and methods
- 4.Results
- 4.1Overall comparison of errors produced by the B2 and C1 learners
- 4.2Error types made by the B2 and C1 learners
- 4.3Grammatical errors
- 5.Discussion
- 6.Conclusions
Notes References
References (56)
Alderson, Charles J. 2007. The CEFR and the need for more research. The Modern Language Journal 91(4): 659–663.
Balgová, Šárka. 2018. Errors in Expressing the Past in Advanced EFL Learners with Spanish as L1. BA dissertation, Charles University.
Barrett, Neil Edward & Chen, Li-mei. 2011. English article errors in Taiwanese college students’ EFL writing. Computational Linguistics and Chinese Language Processing 16(3–4): 1–20.
Biber, Douglas, Finegan, Edward, Johansson, Stig, Conrad, Susan & Leech, Geoffrey. 1999. Longman Grammar of Spoken and Written English. Harlow: Pearson Education.
Biber, Douglas, Johansson, Stig, Leech, Geoffrey, Conrad, Susan, & Finegan, Edward. 2021. Grammar of Spoken and Written English. Amsterdam: John Benjamins.
Cohen, Jacob. 1988. Statistical Power Analysis for the Behavioral Sciences (2nd edn). Hillsdale NJ: Lawrence Earlbaum Associates.
Corder, Stephen Pit. 1967. The significance of learner’s errors. International Journal of Applied Linguistics 5(4): 161–170.
Council of Europe. 2001. Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Cambridge: CUP.
. 2018. Common European Framework of Reference for Languages: Learning, Teaching, Assessment Companion Volume with New Descriptors. Strasbourg: Council of Europe.
Dagneaux, Estelle, Denness, Sharon, Granger, Sylviane, Meunier, Fanny, Neff, JoAnne & Thewissen, Jennifer. 2008. The Louvain Error Tagging Manual Version 1.3. Louvain-la-neuve: Centre for English Corpus Linguistics, Université catholique de Louvain.
Davydova, Julia. 2011. The Present Perfect in Non-Native Englishes: A Corpus-Based Study of Variation. Berlin: De Gruyter Mouton.
Deygers, Bart. 2019. The CEFR companion volume: Between research-based policy and policy-based research. Applied Linguistics 42(1): 186–191.
Díez-Bedmar, María Belén. 2015. Article use and criterial features in Spanish EFL writing. In Learner Corpora in Language Testing and Assessment, Marcus Callies & Sandra Götz (eds), 163–190. Amsterdam: John Benjamins.
. 2021. Error analysis. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 90–104. New York NY: Routledge.
Díez-Bedmar, María Belén & Byram, Michael. 2019. The current influence of the CEFR in secondary education: teachers’ perceptions. Language, Culture and Curriculum 32(1): 1–15.
Foster, Pauline & Skehan, Peter. 1996. The influence of planning and task type on second language performance. Studies in Second Language Acquisition 18(3): 299–323.
Fox Tree, Jean E. 1995. The effects of false starts and repetitions on the processing of subsequent words in spontaneous speech. Journal of Memory and Language 34(6): 709–738.
Fuchs, Robert, Götz, Sandra & Werner, Valentin. 2016. The present perfect in learner Englishes: A corpus-based case study on L1 German intermediate and advanced speech and writing. In Re-Assessing the Present Perfect, Valentin Werner, Elena Seoane & Cristina Suárez-Gómez (eds), 297–338. Berlin: De Gruyter.
Gennaro, Kristen di & Ekiert, Monika. 2021. The impact of corrective feedback on English articles. ELT Journal 75(3): 290–299.
Gillová, Lucie. 2014. Tagging a Spoken Learner Corpus. MA dissertation, Charles University.
Gilquin, Gaëtanelle, De Cock, Sylvie & Granger, Sylviane. 2010. LINDSEI Louvain International Database of Spoken English Interlanguage. Handbook and CD-ROM. Louvain-la-neuve: Presses universitaires de Louvain.
Gilquin, Gaëtanelle & De Cock, Sylvie. 2011. Errors and disfluencies in spoken corpora: Setting the scene. International Journal of Corpus Linguistics 16(2): 141–172.
Glaboniat, Manuela, Müller, Martin, Rusch, Paul, Schmitz, Helen and Wertenschlag, Lukas. 2005. Profile deutsch: Gemeinsamer europäischer Referenzrahmen; Lernzielbestimmungen; Kannbeschreibungen; kommunikative Mittel; Niveau A1-A2, B1-B2; C1-C2. Berlin: Langenscheidt.
Götz, Sandra. 2015. Tense and aspect errors in spoken learner English: Implications for language testing and assessment. In Learner Corpora in Language Testing and Assessment [Studies in Corpus Linguistics 70], Marcus Callies & Sandra Götz (eds), 191–215. Amsterdam: John Benjamins.
Granger, Sylviane, Dagneaux, Estelle, Meunier, Fanny & Paquot, Magali. 2009. The International Corpus of Learner English. Handbook and CD-ROM (2nd edn). Louvain-la-neuve: Presses Universitaires de Louvain.
Gráf, Tomáš. 2015. Accuracy and Fluency in the Speech of the Advanced Learner of English. PhD dissertation, Charles University.
. 2017. Verb errors in advanced spoken English. Philologica 1 / Prague Studies in English 2017(1): 131–149.
Gráf, Tomáš & Huang, Lan-fen. 2019. Repeats in advanced spoken English. In Fluency and Disfluency across Languages and Language Varieties, Liesbeth Degand, Gaëtanelle Gilquin, Laurence Meurant & Anne Catherine Simon (eds), 219–241. Louvain-la-neuve: Presses Universitaires de Louvain.
Hawkins, John A., & Buttery, Paula. 2010. Criterial features in learner corpora: Theory and illustrations. English Profile Journal 1(1): 1–23.
Hawkins, John A. & Filipović, Luna. 2012. Criterial Features in L2 English: Sepficying the Reference Levels of the Common European Framework. Cambridge: CUP.
Huang, Lan-fen. 2014. Constructing the Taiwanese component of the Louvain International Database of Spoken English Interlanguage (LINDSEI). Taiwan Journal of TESOL 11(1): 31–74.
Huang, Lan-fen, Kubelec, Simon, Keng, Nicole & Hsu, Lung-hsun. 2018. Evaluating CEFR rater performance through the analysis of spoken learner corpora. Language Testing in Asia 8(14): 1–17.
Hubáčková, Iva. 2018. Errors in the Usage of Article in Advanced EFL Learners with Spanish as L1. BA dissertation, Charles University.
Hulstijn, Jan H. 2007. The shaky ground beneath the CEFR: Quantitative and qualitative dimensions of language proficiency. The Modern Language Journal 91(4): 663–667.
Ionin, Tania & Díez-Bedmar, María B. 2021. Article use in Russian and Spanish learner writing at CEFR B1 and B2 levels: Effects of proficiency, native language, and specificity. In Learner Corpus Research Meets Second Language Acquisition, Bert Le Bruyn & Magali Paquot (eds), 10–38. Cambridge: CUP.
Kämmerer, Susanne. 2009. Error-tagging spoken features of (learner) language: The UCL Error Editor ‘revised’. Paper presented at the 30th Annual Conference of the International Computer Archive of Modern and Medieval English (ICAME30), Lancaster, UK.
Kormos, Judit & Dénes, Mariann. 2004. Exploring measures and perceptions of fluency in the speech of second language learners. System 32(2): 145–164.
Lennon, Paul. 1991. Error: Some problems of definition, identification and distinction. Applied Linguistics 12(2): 180–196.
Lüdeling, Anke & Hirschmann, Hagen. 2015. Error annotation systems. In The Cambridge Handbook of Learner Corpus Research, Sylviane Granger, Gaëtanelle Gilquin & Fanny Meunier (eds), 135–157. Cambridge: CUP.
Master, Peter. 1997. The English article system: Acquisition, function and pedagogy. System 25(2): 215–232.
McCarthy, Michael, McCarten, Jeanne & Sandiford, Helen. 2014. Touchstone Student’s Book 3. Cambridge: CUP.
Milton, James. 2009. Measuring Second Language Vocabulary Acquisition. Bristol: Multilingual Matters.
Nation, Paul. 1999. Fluency and accuracy. In Consice Encyclopedia of Educational Linguistics, Bernard Spolsky (ed.), 611–612. Amsterdam: Elsevier.
Ortega, Lourdes & Byrnes, Heidi (eds). 2008. The Longitudinal Study of Advanced L2 Capacities. New York NY: Routledge.
Pazderová, Tereza. 2019. Errors in the Use of Articles in Czech Advanced Learner English. BA dissertation. Charles University.
Rayson, Paul, Damon, Berridge & Brian, Francis. 2004. Extending the Cochran rule for the comparison of word frequencies between corpora. In Le Poids des Mots: Proceedings of the 7th International Conference on Statistical Analysis of Textual Data (JADT 2004) Louvain-la-neuve, Belgium, March 10–12, 2004 Vol. II, Gérald Purnelle, Cédrick Fairon & Anne Dister (eds), 926–936. Louvain-la-neuve: Presses universitaires de Louvain.
Skehan, Peter. 1996. Second language acquisition research and task-based instruction. In Challenge and Change in Language Teaching, Dave Willis & Jane Willis (eds), 17–30. Oxford: Heinemann.
