Article published In: Trends in Second Language Pragmatics Research Part 2
[Applied Pragmatics 6:2] 2024
► pp. 117–130
Thematic article
Assessment and L2 pragmatics
Published online: 7 February 2025
https://doi.org/10.1075/ap.00022.roe
https://doi.org/10.1075/ap.00022.roe
Abstract
Pragmatic and interactional abilities are represented in major models of second language (L2) communicative competence (Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language tests and justifying their use in the real world. Oxford University Press.; Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 11, 1–47. ), which provide the framework for L2 assessment. However, pragmatics and interaction are only rarely tested in major operational tests. This is despite a significant amount of work in the testing of L2 pragmatics and interaction since the mid-1990s. This paper outlines current work on testing of L2 pragmatics, which broadly follows two traditions, one informed by speech act theory, politeness theory and philosophical pragmatics, and the other by conversation analysis and sociology. It also discusses reasons for the limited uptake of pragmatics assessment by large-scale tests, including low practicality, limited stakeholder test literacy, and broader challenges in testing pragmatics. It concludes by suggesting ways of overcoming these obstacles and thereby achieving better construct representation in L2 tests.
Article outline
- 1.Introduction
- 2.Survey of current literature
- 2.1Justification for testing of L2 pragmatics
- 2.2L2 pragmatics constructs and associated tests
- 3.Critical insights and future directions
References
References (67)
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language tests and justifying their use in the real world. Oxford University Press.
Bardovi-Harlig, K. (2009). Conventional expressions as a pragmalinguistic resource: Recognition and production of conventional expressions in L2 pragmatics. Language Learning, 591, 755–795.
Bouton, L. F. (1999). Developing non-native speaker skills in interpreting conversational Implicatures in English: Explicit teaching can ease the process. In E. Hinkel (Ed.), Culture in second language teaching and learning (pp. 47–70). Cambridge University Press.
Brown, J. D., & Ahn, R. C. (2011). Variables that affect the dependability of L2 pragmatics tests. Journal of Pragmatics, 43(1), 198–217.
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge University Press.
Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 11, 1–47.
Chinese Testing International. (2018). About test. [URL]
Cogo, A., & House, J. (2017). The pragmatics of ELF. In J. Jenkins, W. Baker, & M. Dewey (Eds.), The Routledge handbook of English as a lingua franca (pp. 210–223). Routledge.
Cook, H. M. (2001). Why can’t learners of Japanese as a foreign language distinguish polite from impolite speech styles? In K. Rose & G. Kasper (Eds.), Pragmatics in language teaching (pp. 80–102). Cambridge University Press.
Coulmas, F. (1981). Conventional routine: Exploration in standardized communication situations and prepatterned speech. Mouton.
Council of Europe. (2020). Common European framework of reference for languages: Learning, teaching, assessment. Companion volume with new descriptors. Council of Europe. [URL]
Dai, D. W. (2024). Assessing interactional competence. Peter Lang.
Educational Testing Service. (2020). TOEFL iBT speaking section. [URL]
. (2021). The TOEIC tests. [URL]
Ellis, R., & Roever, C. (2021). The measurement of implicit and explicit knowledge. The Language Learning Journal, 49(2), 160–175.
Ellis, R., Zhu, Y., Shintani, N., & Roever, C. (2021). A study of Chinese learners’ ability to comprehend irony. Journal of Pragmatics, 1721, 7–20.
Félix-Brasdefer, J. C. (2019). Speech acts in interaction: Negotiating joint action in a second language. In N. Taguchi (Ed.), The Routledge handbook of second language acquisition and pragmatics (pp. 17–30). Routledge.
Galaczi, E. D. (2014). Interactional competence across proficiency levels: How do learners manage interaction in paired speaking tests? Applied Linguistics, 35(5), 553–574.
Galaczi, E., & Taylor, L. (2018). Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly, 15(3), 219–236.
Golato, A. (2003). Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90–121.
Grabowski, K. (2009). Investigating the construct validity of a test designed to measure grammatical and pragmatic knowledge in the context of speaking [Unpublished doctoral dissertation]. Teachers College, Columbia University.
(2013). Investigating the construct validity of a role-play test designed to measure grammatical and pragmatic knowledge at multiple proficiency levels. In S. Ross & G. Kasper (Eds.), Assessing second language pragmatics (pp. 149–171). Palgrave Macmillan.
Grice, H. P. (1975). Logic and conversation. In P. Cole & J. L. Morgan (Eds.), Syntax and semantics 3: Speech acts (pp. 41–58). Academic Press.
Hall, J. K., & Pekarek Doehler, S. (2011). L2 interactional competence and development. In J. K. Hall, J. Hellermann, & S. Pekarek Doehler (Eds.), L2 interactional competence and development (pp. 1–15). Multilingual Matters.
Harding, L. W., & McNamara, T. (2018). Language assessment: The challenge of ELF. In J. Jenkins, W. Baker, & M. Dewey (Eds.), The Routledge handbook of English as a lingua franca (pp. 570–582). Routledge.
Hepburn, A., & Potter, J. (2021). Essentials of conversation analysis. American Psychological Association.
Hudson, T., Detmer, E., & Brown, J. D. (1995). Developing prototypic measures of cross-cultural pragmatics (Technical report #7). University of Hawai’i, Second Language Teaching and Curriculum Center.
Hymes, D. (1972). On communicative competence. In J. Pride & J. Holmes (Eds.), Sociolinguistics: Selected readings (pp. 269–293). Penguin.
Ikeda, N. (2017). Measuring L2 oral pragmatic abilities for use in social contexts: Development and validation of an assessment instrument for L2 pragmatics performance in university settings [Unpublished doctoral dissertation]. The University of Melbourne.
(2021). Assessing L2 learners’ pragmatic ability in problem-solving situations at English-medium university. Applied Pragmatics, 3(1), 51–83.
Itomitsu, M. (2009). Developing a test of pragmatics of Japanese as a foreign language (Publication No. osu1250512327) [Doctoral dissertation, Ohio State University]. OhioLINK ETD Center. [URL]
Jacoby, S., & McNamara, T. (1999). Locating competence. English for Specific Purposes, 18(3), 213–241.
Kasper, G. (2006). Speech acts in interaction: Towards discursive pragmatics. In K. Bardovi-Harlig, J. C. Félix-Brasdefer, & A. S. Omar (Eds.), Pragmatics & language learning (Vol. 111, pp. 281–314). National Foreign Language Resource Center.
Lam, D. M. K. (2018). What counts as “responding”? Contingency on previous speaker contribution as a feature of interactional competence. Language Testing, 35(3), 377–401.
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). American Council on Education/Macmillan.
Ockey, G. J., & Chukharev-Hudilainen, E. (2021). Human versus computer partner in the paired oral discussion test. Applied Linguistics, 1–21.
OET (2018). Speaking assessment criteria and level descriptors. [URL]
Pekarek Doehler, S. (2019). On the nature and the development of L2 interactional competence: State of the art and implications for praxis. In M. R. Salaberry & S. Kunitz (Eds.), Teaching and testing L2 interactional competence: Bridging theory and practice (pp. 25–59). Routledge.
Pill, J. (2016). Drawing on indigenous criteria for more authentic assessment in a specific-purpose language test: Health professionals interacting with patients. Language Testing, 33(2), 175–193.
(2013). Testing implicature under operational conditions. In G. Kasper & S. Ross (Eds.), Assessing second language pragmatics (pp. 43–64). Palgrave Macmillan.
Roever, C., & Dai, W. (2021). Interactional competence and language testing. In M. R. Salaberry & R. Burch (Eds.), Assessing speaking (pp. 23–49). Palgrave Macmillan.
Roever, C., & Ellis, R. (2021). Testing implicit pragmatic knowledge. In C. Félix-Brasdefer, R. Shively, & J. Sykes (Eds.), New directions in researching, teaching, and assessing L2 pragmatics (pp. 142–155). Mouton de Gruyter.
Roever, C., Fraser, C., & Elder, C. (2014). Testing ESL sociopragmatics: Development and validation of a web-based test battery. Peter Lang.
Roever, C., Higuchi, Y., Sasaki, M., Yashima, T., & Nakamuro, M. (2023). Validating a test of L2 routine formulae to detect pragmatics learning in stays abroad. Applied Pragmatics, 5(1), 41–63.
Roever, C., & Ikeda, N. (2022). What scores from monologic speaking tests can (not) tell us about interactional competence. Language Testing, 39(1), 7–29.
Ross, S., & Zheng, Q. (2021). Strategic competence and pragmatic proficiency in L2 role plays. In J. C. Félix-Brasdefer & R. L. Shively (Eds.), New directions in second language pragmatics (pp. 179–194). De Gruyter.
Saito, J. (2018). “Sarariiman” and the performance of masculinities at work: An analysis of interactions at business meetings at a multinational corporation in Japan. In H. Cook & J. Shibamoto-Smith (Eds.), Japanese at work (pp. 97–121). Springer.
Sato, T., & McNamara, T. (2019). What counts in second language oral communication ability? The perspective of linguistic laypersons. Applied Linguistics, 40(6), 894–916.
Searle, J. R. (1969). Speech acts: An essay in the philosophy of language. Cambridge University Press.
Tada, M. (2005). Assessment of ESL pragmatic production and perception using video prompts [Unpublished doctoral dissertation]. Temple University.
Tajeddin, Z., Alemi, M., & Khanlarzadeh, N. (2021). Rating criteria and norms for pragmatic assessment in the context of EIL. In Z. Tajeddin & M. Alemi (Eds.), Pragmatics pedagogy in English as an international language (pp. 212–231). Routledge.
Timpe-Laughlin, V., & Choi, I. (2017). Exploring the validity of a second intercultural pragmatics assessment tool. Language Assessment Quarterly, 14(1), 19–35.
Timpe-Laughlin, V., & Dombi, J. (2020). Exploring L2 learners’ request behavior in a multi-turn conversation with a fully automated agent. Intercultural Pragmatics, 17(2), 221–257.
Trinity College (2021). Our qualifications: English language. [URL]
UCLES (2011). Assessing speaking performance — level C1. [URL]
(2021). Cambridge English qualifications. [URL]
Walters, F. S. (2007). A conversation-analytic hermeneutic rating protocol to assess L2 oral pragmatic competence. Language Testing, 27(2), 155–183.
(2009). A Conversation Analysis-informed test of L2 aural pragmatic comprehension. TESOL Quarterly, 43(1), 29–54.
Yamashita, S. O. (1996). Six measures of JSL pragmatics (Technical Report #14). University of Hawai’i, Second Language Teaching and Curriculum Center.
Yoshitake, S. (1997). Interlanguage competence of Japanese students of English: A multi-test framework evaluation [Unpublished doctoral dissertation]. Columbia Pacific University.
Youn, S. J. (2013). Validating task-based assessment of L2 pragmatics in interaction using mixed methods [Unpublished doctoral dissertation]. University of Hawai’i at Manoa.
Cited by (1)
Cited by one other publication
This list is based on CrossRef data as of 19 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.