Cover not available

In:Complexity, Accuracy and Fluency in Learner Corpus Research
Edited by Agnieszka Leńko-Szymańska and Sandra Götz
[Studies in Corpus Linguistics 104] 2022
► pp. 209–240

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Interaction between grammatical accuracy and syntactic complexity at different proficiency levels

Insights from a learner corpus

 | University of Antwerp | Université Saint-Louis
 | University of Antwerp
Published online: 1 December 2022
DOI logo with link
https://doi.org/10.1075/scl.104.09the
Abstract
This learner corpus study tracks the development and interactional dynamics between grammatical accuracy (GrA) and syntactic complexity (SC) at four Common European Framework proficiency levels (intermediate and advanced levels B1/B2/C1/C2). Data from the International Corpus of Learner English (Granger et al. 2020) were error-tagged and submitted to the automatic L2 Syntactic Complexity Analyzer (Lu 2010). Interaction between B1 and B2 is characterised by a competitive relationship between GrA and SC, with the most marked improvement displayed in accuracy. Development between B2 and C1 displays subtle shifts, with GrA improving slightly and SC showing mild signs of reorganisation. Between C1 and C2, a more supportive relationship appears: SC shows the most marked signs of development, with GrA continuing to subtly improve.
Article outline
  • 1.Introduction and study rationale
  • 2.Construct definitions: Grammatical accuracy and syntactic complexity
  • 3.The dynamic relationship between L2 accuracy and complexity
  • 4.Is more syntactically complex better?
  • 5.Data and methodology
    • 5.1Learner corpus data
    • 5.2Grammatical accuracy and syntactic complexity indices
    • 5.3Study design
  • 6.Results
    • 6.1Mapping the grammatical accuracy and syntactic complexity constructs
    • 6.2Capturing dynamic developmental patterns
  • 7.Conclusion and avenues for further research
  • Notes
  • References
  • Appendix
References (69)
References
Abdel Latif, Muhammad M. Mahmoud. 2013. What do we mean by writing fluency and how can it be validly measured? Applied Linguistics 34(1): 99–105. Google Scholar logo with link to Google Scholar
Alexopoulou, Theodora, Michel, Marije, Murakami, Akira & Meurers, Detmar. 2017. Task effects on linguistic complexity and accuracy. A large-scale learner corpus analysis employing natural language processing techniques. Language Learning 67(1): 180–208. Google Scholar logo with link to Google Scholar
Biber, Douglas & Conrad, Lauren. 2009. Register, Genre, and Style. Cambridge: CUP. Google Scholar logo with link to Google Scholar
Biber, Douglas, Gray, Bethany & Poonpon, Kornwipa. 2011. Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly 45(1): 5–35. Google Scholar logo with link to Google Scholar
Brand, Christiane & Götz, Sandra. 2011. Fluency versus accuracy in advanced spoken learner language: A multi-method approach. International Journal of Corpus Linguistics 16(2): 255–275. Google Scholar logo with link to Google Scholar
Bulté, Bram & Housen, Alex. 2014. Conceptualizing and measuring short-term changes in L2 writing complexity. Journal of Second Language Writing 26(4): 42–65. Google Scholar logo with link to Google Scholar
. 2012. Defining and operationalizing L2 complexity. In Dimensions of L2 Performance and Proficiency [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 21–46. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Chan, HuiPing, Verspoor, Marjolijn & Vahtrick, Louisa. 2015. Dynamic development in speaking vs. writing in identical twins. Language Learning 65(2): 298–325. Google Scholar logo with link to Google Scholar
Chen, Xiaobin & Meurers, Detmar. 2016. CTAP: A web-based tool supporting automatic complexity analysis. In Proceedings of The Workshop on Computational Linguistics for Linguistic Complexity, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi, Thomas François & Philippe Blache (eds), 113–119. Osaka: The COLING 2016 Organizing Committee.Google Scholar logo with link to Google Scholar
Council of Europe. 2001. Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Strasbourg: Council of Europe.Google Scholar logo with link to Google Scholar
Crossley, Scott & McNamara, Danielle. 2014. Does writing development equal writing quality? A computational investigation of syntactic complexity in L2 learners. Journal of Second Language Writing 26: 66–79. Google Scholar logo with link to Google Scholar
Dagneaux, Estelle, Denness, Sharon & Granger Sylviane. 1998. Computer-aided error analysis. System: An International Journal of Educational Technology and Applied Linguistics 26(2): 163–174. Google Scholar logo with link to Google Scholar
Dagneaux, Estelle, Denness, Sharon, Granger, Sylviane, Meunier, Fanny, Neff, JoAnne, & Thewissen, Jennifer. 2008. Error Tagging Manual Version 1.3. Centre for English Corpus Linguistics. Université catholique de Louvain, Louvain-la-Neuve. Unpublished manual.Google Scholar logo with link to Google Scholar
de Bot, Kees & Larsen-Freeman, Diane. 2011. Researching second language development from a dynamic systems theory perspective. In A Dynamic Approach to Second Language Development: Methods and Techniques [Language Learning and Language Teaching 29], Marjolijn Verspoor, Kees de Bot & Wander Lowie (eds), 5–24. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
De Clercq, Bastien & Housen, Alex. 2019. The development of morphological complexity: A cross-linguistic study of L2 French and English. Second Language Research 35(1): 71–98. Google Scholar logo with link to Google Scholar
de Graaff, Rick. 2019. You’ve got to crack a few eggs to make an omelette. Linguistic complexity and instruction in SLA: What’s in it for SLA? Instructed Second Language Acquisition 3(2): 249–258. Google Scholar logo with link to Google Scholar
de Leeuw, Jan & Mair, Patrick. 2009. Multidimensional Scaling Using Majorization: SMACOF in R. Journal of Statistical Software 31(3): 1–30. Google Scholar logo with link to Google Scholar
Díez-Bedmar, María Belén. 2021. Error analysis. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 90–104. New York NY: Routledge.Google Scholar logo with link to Google Scholar
Ellis, Rod & Yuan, Fangyuan. 2004. The effects of planning on fluency, complexity and accuracy in second language narrative writing. Studies in Second Language Acquisition 26(1): 59–84. Google Scholar logo with link to Google Scholar
Fogel, Alan. 2011. Theoretical and applied dynamic systems research in developmental science. Child Developmental Perspectives 5: 267–272. Google Scholar logo with link to Google Scholar
Foster, Pauline & Skehan, Peter. 1996. The influence of planning and task type on second language performance. Studies in Second Language Acquisition 18(3): 299–324. Google Scholar logo with link to Google Scholar
Garside, Roger & Smith, Nicholas. 1997. A hybrid grammatical tagger: CLAWS4. In Corpus Annotation: Linguistic Information from Computer Text Corpora, Roger Garside, Geoffrey Leech & Anthony McEnery (eds), 102–121. London: Longman. Google Scholar logo with link to Google Scholar
Götz, Sandra. 2013. Fluency in Native and Nonnative English Speech [Studies in Corpus Linguistics 53]. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Granger, Sylviane, Dupont, Maïté, Meunier, Fanny, Naets, Hubert & Paquot, Magali. 2020. The International Corpus of Learner English, Version 3. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar logo with link to Google Scholar
Hasko, Victoria. 2013. Capturing the dynamics of second language development via learner corpus research: A very long engagement. The Modern Language Journal 97(1): 1–10. Google Scholar logo with link to Google Scholar
Housen, Alex, De Clercq, Bastien, Kuiken, Folkert & Vedder, Ineke. 2019. Multiple approaches to complexity in second language research. Second Language Research 35(1): 3–21. Google Scholar logo with link to Google Scholar
Housen, Alex, Kuiken Folkert & Vedder, Ineke. 2012. Complexity, accuracy, fluency. International Journal of Applied Linguistics 23(2): 1–20. Google Scholar logo with link to Google Scholar
Housen, Alex & Kuiken, Folkert. 2009. Complexity, accuracy, and fluency in Second Language Acquisition. Applied Linguistics 30(4): 461–473. Google Scholar logo with link to Google Scholar
Jin, Tan, Lu, Xiaofei & Ni, Jing. 2020. Syntactic complexity in adapted teaching materials: Differences among grade levels and implications for benchmarking. The Modern Language Journal 104(1): 192–208. Google Scholar logo with link to Google Scholar
Kuiken, Folkert, Housen, Alex, Vedder, Ineke & De Clercq, Bastien. 2019. Variation in syntactic complexity: Introduction. International Journal of Applied Linguistics 29(2): 161–170. Google Scholar logo with link to Google Scholar
Kuiken, Folkert & Vedder, Ineke. 2019. Investigating teachers’ perceptions of syntactic complexity in L2 academic writing. Instructed Second Language Acquisition 3(2): 228–248. Google Scholar logo with link to Google Scholar
Kyle, Kristopher. 2016. Measuring Syntactic Development in L2 Writing: Fine Grained Indices of Syntactic Complexity and Usage-based Indices of Syntactic Sophistication. PhD Dissertation, Georgia State University.
Kyle, Kristopher & Crossley, Scott. 2018. Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices. The Modern Language Journal 102(2): 333–349. Google Scholar logo with link to Google Scholar
Lambert, Craig & Kormos, Judit. 2014. Complexity, accuracy and fluency in task-based L2 research: Toward more developmentally based measures of second language acquisition. Applied Linguistics 35(5): 607–614. Google Scholar logo with link to Google Scholar
Larsen-Freeman, Diane. 2018. Second Language Acquisition, WE, and language as a complex adaptive system (CAS). World Englishes 37(1): 80–92. Google Scholar logo with link to Google Scholar
. 2009. Adjusting expectations: The study of complexity, accuracy and fluency in second language acquisition. Applied Linguistics 30(4): 579–589. Google Scholar logo with link to Google Scholar
. 2006. The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics 27(4): 590–619. Google Scholar logo with link to Google Scholar
Lennon, Paul. 1991. Error: Some problems of definition, identification, and distinction. Applied Linguistics 12(2): 180–196. Google Scholar logo with link to Google Scholar
Lowie, Wander, Michel, Marije, Keijzer, Merel & Steinkrauss, Rasmus. 2020. Usage-Based Dynamics in Second Language Development. Bristol: Multilingual Matters. Google Scholar logo with link to Google Scholar
Lowie, Wander & Verspoor, Marjolijn. 2007. A Dynamic Systems Theory approach to second language acquisition. Bilingualism: Language and Cognition 10(1): 7–21. Google Scholar logo with link to Google Scholar
Lu, Xiaofei. 2017. Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment. Language Testing 34(4): 493–511. Google Scholar logo with link to Google Scholar
. 2012. The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal 96(2): 190–208. Google Scholar logo with link to Google Scholar
. 2011. A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development. TESOL Quarterly 45(1): 36–62. Google Scholar logo with link to Google Scholar
. 2010. Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics 15(4): 36–62. Google Scholar logo with link to Google Scholar
Mair, Patrick, Groenen, Patrick J. F. & de Leeuw, Jan. 2021. More on multidimensional scaling in R: Smacof version 2. Journal of Statistical Software. <[URL]> (12 February 2022)
McNamara, Danielle, Graesser, Arthur, McCarthy, Philip & Cai, Zhiqiang. 2014. Automated Evaluation of Text and Discourse with Coh-Metrix. Cambridge: CUP. Google Scholar logo with link to Google Scholar
Meunier, Fanny. 2016. Introduction to the LONGDALE project. In Studies in Learner Corpus Linguistics: Research and Applications for Foreign Language Teaching and Assessment, Erik Castello, Katherine Ackerley & Francesca Coccetta (eds), 123–126. Berlin: Peter Lang.Google Scholar logo with link to Google Scholar
Michel, Marije, Murakami, Akira, Alexopoulou, Theodora & Meurers, Detmar. 2019. Effects of task type on morphosyntactic complexity: Evidence from a large learner corpus of A1 to C2 writings. Instructed Second Language Acquisition 3(2): 124–152. Google Scholar logo with link to Google Scholar
Norris, John & Ortega, Lourdes. 2009. Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics 30(4): 555–578. Google Scholar logo with link to Google Scholar
Ortega, Lourdes. 2015. Syntactic complexity in L2 writing: Progress and expansion. Journal of Second Language Writing 29: 82–94. Google Scholar logo with link to Google Scholar
Pallotti, Gabriele. 2015. A simple view of linguistic complexity. Second Language Research 31(1): 117–134. Google Scholar logo with link to Google Scholar
. 2009. CAF: Defining, refining and differentiating constructs. Applied Linguistics 30(4): 590–601. Google Scholar logo with link to Google Scholar
Paquot, Magali. 2019. The phraseological dimension in interlanguage complexity research. Second Language Research 35(1): 121–145. Google Scholar logo with link to Google Scholar
Plakans, Lia, Gebril, Ata & Bilki, Zeynep. 2019. Shaping a score: Complexity, accuracy, and fluency in integrated writing performances. Language Testing 36(2): 161–179. Google Scholar logo with link to Google Scholar
Polio, Charlene & Shea, Mark. 2014. An investigation into current measures of linguistic accuracy in second language writing research. Journal of Second Language Writing 26(1): 10–27. Google Scholar logo with link to Google Scholar
Polio, Charlene & Yoon, Hyung-Jo. 2018. The reliability and validity of automated tools for examining variation in syntactic complexity across genres. International Journal of Applied Linguistics 28(1): 165–188. Google Scholar logo with link to Google Scholar
Skehan, Peter. 2009. Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics 30(4): 510–532. Google Scholar logo with link to Google Scholar
Skehan, Peter & Foster, Pauline. 2012. Complexity, accuracy, fluency and lexis in task-based performance: A synthesis of the Ealing research In Dimensions of L2 performance and Proficiency [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 199–220. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Spoelman, Marianne & Verspoor, Marjolijn. 2010. Dynamic patterns in development of accuracy and complexity: A longitudinal case study in the acquisition of Finnish. Applied Linguistics 31(4): 532–553. Google Scholar logo with link to Google Scholar
Thelen, Esther & Smith, Linda B. 1994. A Dynamic Systems Approach to the Development of Cognition and Action. Cambridge MA: The MIT Press.Google Scholar logo with link to Google Scholar
Thewissen, Jennifer. 2021. Accuracy. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 305–317. New York NY: Routledge.Google Scholar logo with link to Google Scholar
. 2015. Accuracy across Proficiency Levels: A Learner Corpus Approach. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar logo with link to Google Scholar
Thewissen, Jennifer & Anishchanka, Alena. 2019. An integrative approach to L2 accuracy and complexity development. Paper presented at the 5th Learner Corpus Research Conference. 12–14 September 2019. University of Warsaw, Poland.
Verspoor, Marjolijn, Schmid, Monika & Xu, Xiaoyan. 2012. A dynamic usage based perspective on L2 writing. Journal of Second Language Writing 21: 239–263. Google Scholar logo with link to Google Scholar
Van Waes, Luuk & Leijten, Mariëlle. 2015. Fluency in writing: A multidimensional perspective on writing fluency applied to L1 and L2. Computers and Composition 38: 79–95. Google Scholar logo with link to Google Scholar
Vyatkina, Nina & Housen, Alex. 2021. Complexity. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 318–330. New York NY: Routledge.Google Scholar logo with link to Google Scholar
Yang, Weiwei, Lu, Xiaofei, Cushing Weigle, Sarah. 2015. Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgements of writing quality. Journal of Second Language Writing 28: 53–67. Google Scholar logo with link to Google Scholar
Yu, Hanjing & Lowie, Wander. 2020. Dynamic paths of complexity and accuracy in second language speech: A longitudinal case study of Chinese learners. Applied Linguistics 41(6): 855–877. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue