Cover not available

Article published In: Register Studies
Vol. 4:1 (2022) ► pp.55–90

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Assessing linguistic complexity and register flexibility in advanced second language learners

Evidence from group- and individual-level analyses

ORCiD logo with link | RWTH Aachen University
ORCiD logo with link | RWTH Aachen University
ORCiD logo with link | RWTH Aachen University
Published online: 14 June 2022
DOI logo with link
https://doi.org/10.1075/rs.20014.ker
Abstract
The aim of the present study is twofold: (1) to assess the degree of register flexibility in advanced second language (L2) learners of English and (2) to determine whether and to what extent this flexibility is impacted by inter-individual variability in experiential factors and personality traits. Register flexibility is quantitatively measured as the degree of differentiation in the use of linguistic complexity – gauged by a range of lexical, syntactic, and information-theoretic complexity measures – across three writing tasks. At the methodological level, we aim to demonstrate how a corpus-based approach combined with natural language processing (NLP) techniques and a within-subjects design can be a valuable complement to experimental approaches to language adaptation.
Article outline
  • 1.Introduction
    • 1.1Related work on register flexibility and L2 writing complexity
    • 1.2Inter-individual variability in L2 learning
    • 1.3The present study
  • 2.Method
    • 2.1Participants
    • 2.2L2 writing samples
    • 2.3Automated assessment of linguistic complexity
    • 2.4Individual differences factors
      • 2.4.1Experiential factors
      • 2.4.2Personality
    • 2.5Statistical modeling
  • 3.Results
  • 4.Discussion
  • 5.Conclusion and future directions
  • Note
  • References
References (90)
References
Acheson, D. J., Wells, J. B., & Macdonald, M. C. (2008). New and updated tests of print exposure and reading abilities in college students. Behavior Research Methods, 401, 278–289. Google Scholar logo with link to Google Scholar
Alexopoulou, T., Michel, M., Murakami, A., & Meurers, D. (2017). Task effects on linguistic complexity and accuracy: A large-scale learner corpus analysis employing natural language processing techniques. Language Learning, 67(S1), 180–208. Google Scholar logo with link to Google Scholar
Allport, G. W. (1961). Pattern and Growth in Personality. Fort Worth TX: Harcourt College Publisher.Google Scholar logo with link to Google Scholar
Biber, D. (1988). Variation across speech and writing. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
(1995). Dimensions of register variation: A cross-linguistic comparison. Cambridge University Press. Google Scholar logo with link to Google Scholar
(2006). University language (Vol. 101). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Biber, D., Johansson, S., Leech, G., Conrad, S., Finegan, E., & Quirk, R. (1999). Longman grammar of spoken and written English (Vol. 2). MIT Press.Google Scholar logo with link to Google Scholar
Biber, D., & Conrad, S. (2009). Register, genre, and style. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development?. Tesol Quarterly, 45(1), 5–35. Google Scholar logo with link to Google Scholar
Biber, D., Gray, B., & Staples, S. (2016). Predicting patterns of grammatical complexity across language exam task types and proficiency levels. Applied Linguistics, 37(5), 639–668. Google Scholar logo with link to Google Scholar
Biber, D., & Egbert, J. (2018). Register variation online. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Biber, D., Reppen, R., Staples, S., & Egbert, J. (2020). Exploring the longitudinal development of grammatical complexity in the disciplinary writing of L2-English university students. International Journal of Learner Corpus Research, 6(1), 38–71. Google Scholar logo with link to Google Scholar
Bosker, H., Pinget, A., Quené, H., Sanders, T. & de Jong, N. (2013). What makes speech sound fluent? The contributions of pauses, speed and repairs. Language Testing, 301, 159–75. Google Scholar logo with link to Google Scholar
Bouwer, R., Béguin, A., Sanders, T., & van den Bergh, H. (2015). Effect of genre on the generalizability of writing scores. Language Testing, 32(1), 83–100. Google Scholar logo with link to Google Scholar
Browne, C. (2013). The new general service list: Celebrating 60 years of vocabulary learning. The Language Teacher, 37(4), 13–16.Google Scholar logo with link to Google Scholar
Brown, R. (1973). Development of the first language in the human species. American Psychologist, 28(2), 97. Google Scholar logo with link to Google Scholar
Cacioppo, J. T., Petty, R. E., & Feng Kao, C. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48(3), 306–307. Google Scholar logo with link to Google Scholar
Carrell, P. L., Prince, M. S., & Astika, G. G. (1996). Personality types and language learning in an EFL context. Language Learning, 46(1), 75–99. Google Scholar logo with link to Google Scholar
Cervone, D., & Pervin, L. A. (2010). Personality psychology. Wiley.Google Scholar logo with link to Google Scholar
Coxhead, A. (2000). A new academic word list. TESOL quarterly, 34(2), 213–238. Google Scholar logo with link to Google Scholar
Crossley, S. (2020). Linguistic features in writing quality and development: An overview. Journal of Writing Research, 11(3). Google Scholar logo with link to Google Scholar
Dąbrowska, E. (2018). Experience, aptitude and individual differences in native language ultimate attainment. Cognition, 1781, 222–235. Google Scholar logo with link to Google Scholar
(2019). Experience, aptitude, and individual differences in linguistic attainment: a comparison of native and nonnative speakers. Language Learning, 691, 72–100. Google Scholar logo with link to Google Scholar
Deutsch, P. (1996). RFC1951: DEFLATE compressed data format specification version 1.3. Google Scholar logo with link to Google Scholar
Dewaele, J. M. (2009). Individual differences in second language acquisition. In W. Ritchie & T. Bhatia (Eds.), The new handbook of second language acquisition (pp. 623–646). Bingley, UK: Emerald Insight.Google Scholar logo with link to Google Scholar
(2012). Personality: Personality traits as independent and dependent variables. In Psychology for language learning (pp. 42–57). Palgrave Macmillan, London. Google Scholar logo with link to Google Scholar
Dewaele, J. M., & Furnham, A. (1999). Extraversion: The unloved variable in applied linguistic research. Language Learning, 49(3), 509–544. Google Scholar logo with link to Google Scholar
Dörnyei, Z., & Skehan, P. (2008). Individual differences in second language learning. In C. J. Doughty & M. H. Long (Eds.), The handbook of second language acquisition (pp. 589–630). Malden, MA: Wiley-Blackwell.Google Scholar logo with link to Google Scholar
Dörnyei, Z., & Ryan, S. (2015). The psychology of the language learner revisited. London: Routledge. Google Scholar logo with link to Google Scholar
Ehret, K., & Szmrecsanyi, B. (2016). An information-theoretic approach to assess linguistic complexity. In R. Baechler & G. Seiler (Eds.), Complexity, isolation, and variation (pp. 71–94). Berlin, Germany: De Gruyter. Google Scholar logo with link to Google Scholar
Ellis, R. (2004). Individual differences in second language learning. In A. Davies & C. Elder (Eds.), The handbook of applied linguistics (pp. 525–551). Malden, MA: Blackwell Publishing. Google Scholar logo with link to Google Scholar
Ellis, N. C. (2019). Essentials of a theory of language cognition. The Modern Language Journal, 1031, 39–60. Google Scholar logo with link to Google Scholar
Farmer, T. A., Fine, A. B., Misyak, J. B., & Christiansen, M. H. (2017). Reading span task performance, linguistic experience, and the processing of unexpected syntactic events. Quarterly Journal of Experimental Psychology, 70(3), 413–433. Google Scholar logo with link to Google Scholar
Ferrer-i-Cancho, R., Bentz, C., & Seguin, C. (2020). Optimal coding and the origins of Zipfian laws. Journal of Quantitative Linguistics, 1–30. Google Scholar logo with link to Google Scholar
Garner, J., Crossley, S., & Kyle, K. (2019). N-gram measures and L2 writing proficiency. System, 801, 176–187. Google Scholar logo with link to Google Scholar
Gray, B., & Egbert, J. (2019). Register and register variation. Register Studies, 1(1), 1–9. Google Scholar logo with link to Google Scholar
Halliday, M. A. K. (2009). Methods – techniques – problems. In M. A. K. Halliday and J. J. Webster (Eds.), Continuum companion to systemic functional linguistics (pp. 59–86). London and New York: Continuum.Google Scholar logo with link to Google Scholar
Halliday, M. A. K., & Hasan, R. (1989). Language, context, and text: Aspects of language in a social-semiotic perspective. Oxford: Oxford University Press.Google Scholar logo with link to Google Scholar
Housen, A., & Kuiken, F. (2009). Complexity, accuracy and fluency in second language acquisition. Applied Linguistics, 30(4), 461–473. Google Scholar logo with link to Google Scholar
Housen, A., Kuiken, F., & Vedder, I. (Eds.). (2012). Dimensions of L2 performance and proficiency. Complexity, accuracy, and fluency in SLA. Amsterdam/ Philadelphia: John Benjamins. Google Scholar logo with link to Google Scholar
Jagaiah, T., Olinghouse, N. G., & Kearns, D. M. (2020). Syntactic complexity measures: variation by genre, grade-level, students’ writing abilities, and writing quality. Reading and Writing, 331, 2577–2638. Google Scholar logo with link to Google Scholar
John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. In O. P. John, R. W. Robins, & L. A. Pervin (Eds.), Handbook of personality: Theory and research (p. 114–158). The Guilford Press.Google Scholar logo with link to Google Scholar
Kaan, E., Futch, C., Fuertes, R. F., Mujcinovic, S., & de la Fuente, E. Á. (2019). Adaptation to syntactic structures in native and nonnative sentence comprehension. Applied Psycholinguistics, 40(1), 3–27. Google Scholar logo with link to Google Scholar
Kaushanskaya, M., Blumenfeld, H. K., & Marian, V. (2019). The Language Experience and Proficiency Questionnaire (LEAP-Q): Ten years later. Bilingualism: Language and Cognition, 1–6.Google Scholar logo with link to Google Scholar
Kerz, E., & Wiechmann, D. (2017). Individual differences in L2 processing of multi-word phrases: Effects of working memory and personality. In International Conference on Computational and Corpus-Based Phraseology (pp. 306–321). Springer, Cham. Google Scholar logo with link to Google Scholar
Kerz, E. & Wiechmann, D. (2020). Individual Differences. In N. Tracy-Ventura & M. Paquot (Eds.) Handbook of second language acquisition and corpora (pp. 396–408). London: Routledge. Google Scholar logo with link to Google Scholar
Kerz, E., Qiao, Y., Wiechmann, D., & Ströbel, M. (2020). Becoming linguistically mature: Modeling English and German children’s writing development across school grades. In Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications (pp. 65–74). Google Scholar logo with link to Google Scholar
Kidd, E., Bidgood, A., Donnelly, S., Durrant, S., Peter, M. S., & Rowland, C. F. (2020). Individual differences in first language acquisition and their theoretical implications. Trends in Language Acquisition Research (TiLAR), (27), 189–219. Google Scholar logo with link to Google Scholar
Kidd, E., Donnelly, S., & Christiansen, M. H. (2018). Individual differences in language acquisition and processing. Trends in Cognitive Sciences, 22(2), 154–169. Google Scholar logo with link to Google Scholar
KMK. (2014). Bildungsstandards für die fortgeführte Fremdsprache (Englisch/Französisch) für die Allgemeine Hochschulehre. Sekretariat der Ständigen Konferenz der Kultusminister der Länder in der Bundesrepublik Deutschland (KMK), Wolters Kluwer Deutschland.Google Scholar logo with link to Google Scholar
Kuhl, P. K. (2007). Cracking the speech code: How infants learn language. Acoustical Science and echnology, 28(2), 71–83. Google Scholar logo with link to Google Scholar
Kyle, K., Crossley, S., & Berger, C. (2018). The tool for the automatic analysis of lexical sophistication (TAALES): version 2.0. Behavior research methods, 50(3), 1030–1046. Google Scholar logo with link to Google Scholar
Kyle, K., & Crossley, S. A. (2015). Automatically assessing lexical sophistication: Indices, tools, findings, and application TESOL. Quarterly, 49(4), 757–786. Google Scholar logo with link to Google Scholar
Lambert, C., & Kormos, J. (2014). Complexity, accuracy, and fluency in task-based L2 research: Toward more developmentally based measures of second language acquisition. Applied Linguistics, 35(5), 607–614. Google Scholar logo with link to Google Scholar
Larsen-Freeman, D. (1978). An ESL index of development. TESOL Quarterly, 12(4), 439–448. Google Scholar logo with link to Google Scholar
Laufer, B., & Nation, P. (1995). Vocabulary size and use: Lexical richness in L2 written production. Applied linguistics, 16(3), 307–322. Google Scholar logo with link to Google Scholar
Leech, G., Rayson, P., & Wilson, A. (2001). Word frequencies in written and spoken English: Based on the British National Corpus. London: Longman.Google Scholar logo with link to Google Scholar
Lemhöfer, K., & Broersma, M. (2012). Introducing LexTALE: A quick and valid lexical test for advanced learners of English. Behavior research methods, 44(2), 325–343. Google Scholar logo with link to Google Scholar
Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474–496. Google Scholar logo with link to Google Scholar
(2011). A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development. TESOL quarterly, 45(1), 36–62. Google Scholar logo with link to Google Scholar
(2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal, 961, 190–208. Google Scholar logo with link to Google Scholar
Malvern, D., Richards, B., Chipere, N., & Durán, P. (2004). Lexical diversity and language development. New York: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014). Automated evaluation of text and discourse with Coh-Metrix. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Michel, M. (2017). Complexity, accuracy, and fluency in L2 production. In S. Loewen & M. Sato (Eds.), The Routledge handbook of instructed second language acquisition, (pp. 50–68). London: Routledge. Google Scholar logo with link to Google Scholar
Michel, M., Murakami, A., Alexopoulou, T., & Meurers, D. (2019). Effects of task type on morphosyntactic complexity across proficiency: evidence from a large learner corpus of A1 to C2 writings. Instructed Second Language Acquisition, 3(2), 124–152. Google Scholar logo with link to Google Scholar
Misyak, J. B., & Christiansen, M. H. (2012). Statistical learning and language: An individual differences study. Language Learning, 62(1), 302–331. Google Scholar logo with link to Google Scholar
Naiman, N., Fröhlich, M., Stern, H. H. and Todesco, A. (1978). The Good Language Learner (Vol. 41). Toronta: Ontario Institute for Language and Education.Google Scholar logo with link to Google Scholar
Neumann, S. (2014). Contrastive register variation: A quantitative approach to the comparison of English and German. Berlin/Boston: de Gruyter.Google Scholar logo with link to Google Scholar
Neumann, S. & Evert, S. (submitted). A register variation perspective on varieties of English.
Norris, J. M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics, 30(4), 555–578. Google Scholar logo with link to Google Scholar
Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics, 241, 492–518. Google Scholar logo with link to Google Scholar
Polio, C. G., & Shea, M. C. (2014). An investigation into current measures of linguistic accuracy in second language writing research. Journal of Second Language Writing, 261, 10–27. Google Scholar logo with link to Google Scholar
Qin, W., & Uccelli, P. (2016). Same language, different functions: A cross-genre analysis of Chinese EFL learners’ writing performance. Journal of Second Language Writing, 331, 3–17. Google Scholar logo with link to Google Scholar
(2020). Beyond linguistic complexity: Assessing register flexibility in EFL writing across contexts. Assessing Writing, 451, 100465. Google Scholar logo with link to Google Scholar
Ströbel, M., Kerz, E., & Wiechmann, D. (2020). The relationship between first and second language writing: Investigating the effects of first language complexity on second language complexity in advanced stages of learning. Language Learning, 70(3), 732–767. Google Scholar logo with link to Google Scholar
Roberts, L., & Meyer, A. (2012). Individual differences in second language learning: Introduction. Language Learning, 621, 1–4. Google Scholar logo with link to Google Scholar
Robinson, D., Gabriel, N., & Katchan, O. (1994). Personality and second language learning. Personality and Individual Differences, 16(1), 143–157. Google Scholar logo with link to Google Scholar
Simpson-Vlach, R., & Ellis, N. C. (2010). An academic formulas list: New methods in phraseology research. Applied Linguistics, 31(4), 487–512. Google Scholar logo with link to Google Scholar
Stanovich, K. E., & Cunningham, A. E. (1992). Studying the consequences of literacy within a literate society: The cognitive correlates of print exposure. Memory & Cognition, 201, 51–68. Google Scholar logo with link to Google Scholar
Staples, S., Egbert, J., Biber, D., & Gray, B. (2016). Academic writing development at the university level: Phrasal and clausal complexity across level of study, discipline, and genre. Written Communication, 33(2), 149–183. Google Scholar logo with link to Google Scholar
Ströbel, M. (2014). Tracking complexity of L2 academic texts: A sliding-window approach. Unpublished master’s thesis). RWTH Aachen University, Germany.
The Council of Europe. (2020). CEFR Companion Volume with new descriptors. Council of Europe, Strasbourg. [URL]
Tracy-Ventura, N., & Myles, F. (2015). The importance of task variability in the design of learner corpora for SLA research. International Journal of Learner Corpus Research, 11, 58–95. Google Scholar logo with link to Google Scholar
Ure, J. (1971). Lexical density: A computational technique and some findings. Talking about text, 27–48.Google Scholar logo with link to Google Scholar
Verhoeven, L., & Vermeer, A. (2002). Communicative competence and personality dimensions in first and second language learners. Applied Psycholinguistics, 23(3), 361–374. 4. Google Scholar logo with link to Google Scholar
Williams, M., Mercer, S., & Ryan, S. (2016). Exploring psychology in language learning and teaching. Oxford University Press.Google Scholar logo with link to Google Scholar
Yoon, H.-J., & Polio, C. (2016). The linguistic development of students of English as a second language in two written genres. TESOL Quarterly, 51(2), 275–301. Google Scholar logo with link to Google Scholar
Zipf, G. K. (1949). Human behaviour and the principle of least effort. Cambridge (MA), USA: Addison-Wesley.Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Pauls, Tobias
2025. SEEFLEX. International Journal of Learner Corpus Research DOI logo

This list is based on CrossRef data as of 30 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue