Cover not available

Article published In: Chinese as a Second Language (漢語教學研究—美國中文教師學會學報)
Vol. 57:3 (2022) ► pp.270–297

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Does text entry method make a difference on Chinese writing test scores?

 | Brigham Young University
ORCiD logo with link | Brigham Young University
 | Brigham Young University
Published online: 7 February 2023
DOI logo with link
https://doi.org/10.1075/csl.22012.bou
Abstract
Should the writing construct be assessed through handwriting or keyboarding? As the only major language entirely without a syllabary or alphabet, the Chinese writing system is unique among modern languages, thus the question of writing proficiency is complicated by character recall. Most of the testing research comparing text entry methods has been conducted in English and has found that keyboarding and handwriting can be used interchangeably. This paper reports the outcome of a study comparing the results of handwritten and typed versions of the Chinese ACTFL Writing Proficiency Test (WPT). L2 Chinese students (n = 25) with Intermediate to Superior speaking skills were randomly divided into two groups and took both WPT versions in a counterbalanced design. Keyboarding resulted in significantly higher test scores [repeated measures ANOVA F(1, 23) = 62.7, p < .001, effect size partial eta squared = .73]. Keyboarding was on average 1.69 ACTFL sublevels higher than handwriting. Finally, this paper will discuss the writing construct in Chinese along with pedagogical implications around curricular decisions on teaching and assessing handwriting vs. keyboarding.
Article outline
  • 1.Introduction
  • 2.Background and literature
    • 2.1Assessing writing
    • 2.2Roles of handwriting and keyboarding in writing
    • 2.3Effects of text entry with Chinese as first language (L1) Writing
    • 2.4Effects of text entry with Chinese as second language (L2) writing
    • 2.5Assessing writing proficiency
    • 2.6Effect of text entry on ESL writing assessments
    • 2.7Validating writing proficiency tests (WPT) for world languages
    • 2.8Assessing writing proficiency for Chinese
    • 2.9Research questions
  • 3.Method
    • 3.1Participants
    • 3.2Instruments
      • 3.2.1WPT
      • 3.2.2H-WPT
      • 3.2.3T-WPT
    • 3.3Procedures
    • 3.4Settings
    • 3.5Data analysis
  • 4.Results
    • 4.1RQ1: Predictive keyboarding versus handwriting
    • 4.2RQ2: Speaking ability on convergent and divergent scores
      • 4.2.1Convergent ratings
      • 4.2.2Divergent ratings
  • 5.Discussion
  • 6.Implications and limitations
  • Notes
  • References
References (34)
References
ACTFL (n.d.-b). Writing Proficiency Test (WPT) Description, Alexandria, VA. Retrieved 10/19/2021 from [URL]
Allen, J. R. (2008). Why Learning to Write Chinese is a Waste of Time: A Modest Proposal. Foreign Language Annals, 41(2), 14. Google Scholar logo with link to Google Scholar
Almog, G. (2018). Getting out of Hand? Examining the discourse of ‘character amnesia’. Modern Asian Studies, 53(2), 27. Retrieved from [URL]
Barkaoui, K. (2014). Examining the impact of L2 proficiency and keyboarding vs kills on scores on TOEFL-iBT writing tasks. Language Testing, 31(2), 241–259. Google Scholar logo with link to Google Scholar
Berninger, V. W. (2000). Development of language by hand and its connections with language by ear, mouth, and eye. Topics in Language Disorders. Google Scholar logo with link to Google Scholar
Blackhust, A. (2005). Listening, reading and writing on computer-based and paper-based versions of IELTS. Research Notes, 211, 14–17.Google Scholar logo with link to Google Scholar
Cameron, D. (1995). Verbal hygiene. London; New York: Routledge.Google Scholar logo with link to Google Scholar
Chin, T. (1973). Is it necessary to require writing in learning characters? Journal of the Chinese Language Teachers Association, 8(3), 3.Google Scholar logo with link to Google Scholar
Du, Y. 杜洋洋, & Zhang, W. 杜洋洋. (2013). ‘Tibiwangzi’ cheng tongbing hanzi shuxie weiji gai ruhe pojie’ [‘提笔忘字’成通病 汉字书写危机该如何破解’]. Shenghuo jiaoyu 生活教育, 11(11), 5–8.Google Scholar logo with link to Google Scholar
Feng, L., Lindner, A., Ji, X. R. et al. The roles of handwriting and keyboarding in writing: a meta-analytic review. Read Writ 321, 33–63 (2019). Google Scholar logo with link to Google Scholar
Gottlieb, N. (2012). Language policy in Japan: the challenge of change. Cambridge, UK: Cambridge University Press.Google Scholar logo with link to Google Scholar
Guan, C. Q., Perfetti, C. A., & Meng, W. (2015). Writing Qualy predicts Chinese learning. Reading and Writing: an interdisciplinary journal 281, 32.Google Scholar logo with link to Google Scholar
Kang, H. (2011). Computer-based Writing and Paper-based Writing: A Study of Beginning-level and Intermediate-level Chinese Learners’ Writing. (Ph.D. Dissertation). Ohio State University, Columbus, Ohio.
Ke, C. (1996). An Empirical Study on the Relationship between Chinese Character Recognition and Production. Modern Language Journal, 80(3), 8. Google Scholar logo with link to Google Scholar
Kelly, J., Renn, J., & Norton, J. (2018). Addressing consequences and validity during test design and development. Georgetown University Round Table on Languages and Linguistics, 185–2503. Google Scholar logo with link to Google Scholar
Lee, J. (2001, February 1, 2001). In China, Computer Use Erodes Traditional Handwriting, Stirring a Cultural Debate. New York Times.Google Scholar logo with link to Google Scholar
Ling, Z. V. (2007). Studies on L2 Acquistion of the Chinese Script Published in America. In A. Gruder, X. Jiang, & Y. Wan (Eds.), 汉字的认知与教学––西方学习者汉字认知国际研讨会论文集 The Cognition, Learning and Teaching of Chinese Characters (pp. 51–85). Beijing: Beijing Language and Culture University University Press.Google Scholar logo with link to Google Scholar
Mair, V. (2010). Character Amnesia. Retrieved from [URL]
Mickel, S. (1980). Teaching the Chinese writing system. Journal of the Chinese Language Teachers Association, 15(1), 7.Google Scholar logo with link to Google Scholar
Mislevy, R. J., Almond, R. G., & Lukas, J. F. (2004). A Brief Introduction to Evidence-Centered Design. CSE Report 632. US Department of Education. Google Scholar logo with link to Google Scholar
Shapiro, F. R. (2006). The Yale Book of Quotations. Yale University Press.Google Scholar logo with link to Google Scholar
Qi, Z., & Lu, Z. (2014). The writing of Chinese characters by CFL learners: Can writing on Facebook and using machine translation help? Journal of the European Confederation of Language Centres in Higher Education, 4(2), 26.Google Scholar logo with link to Google Scholar
Santangelo, T., & Graham, S. (2015). A comprehensive meta-analysis of handwriting instruction. Educational Psychology Review, 271, 1–41. Google Scholar logo with link to Google Scholar
Surface, E. A., & Dierdorff, E. C. (2004). Preliminary reliability and validity findings for the ACTFL writing proficiency test. SWA Technical Report 2004-C04-R01.Google Scholar logo with link to Google Scholar
Tan, T. H., Xu, M., Chang, C. Q., & Siok, W. T. (2013). China’s language input system in the digital age affects children’s reading development. PNAS, 110(3), 4. Retrieved from [URL].
Walker, G. (1984). Literacy and reading in a Chinese language program. Journal of the Chinese Language Teachers Association, 19(1), 67–84.Google Scholar logo with link to Google Scholar
Wang, J. (2012). Illiteracy in the digital age [E 时代新文盲]. Lectures on society [社会讲义] , pp. 12–13.Google Scholar logo with link to Google Scholar
Weir, C. J., Sullivan, B., & Jin, Y. (2007). Does the computer make a difference? The reaction of candidates to a computer-based versus a traditional hand-written form of the IELTS writing component: Effects and impact. IELTS Research Report, 71, 311–347.Google Scholar logo with link to Google Scholar
Wolfe, E. W., & Manalo, J. R. (2005). An Investigation of the Impact of Composition Medium on the Quality of TOEFL Writing Scores. Retrieved from Princeton, New Jersey,:Google Scholar logo with link to Google Scholar
Xu, C. (2010). ‘Tibiwangzi‘ wenhua de jinbu haishi daotui ‘提笔忘字’文化的进步还是倒步. Shenzhou, 91, 29–31.Google Scholar logo with link to Google Scholar
Xu, P., & Jen, T. (2005). “Penless” Chinese Language Learning: A Computer-Assisted Approach. Journal of the Chinese Language Teachers Association, 40(2), 25–42.Google Scholar logo with link to Google Scholar
Yan, C., McBride-Chang, C., Wagner, R. K., Zhang, J., Wong, A., & Shu, H. (2012). Writing quality in Chinese children: Speed and fluency matter. Reading and Writing: An Interdisciplinary Journal, 251, 1499–1521. Google Scholar logo with link to Google Scholar
Yan, W. (1957). Yige waihang de yijian 一个外行的意见. Wenzi gaige 文字改革, 81, 10–11.Google Scholar logo with link to Google Scholar
Zhu, Y., Shum, S.-K. M., Tse, S.-K. B., & Liu, J. J. (2016). Word-processor or pencil-and-paper? A comparison of students’ writing in Chinese as a foreign language. Computer Assisted Language Learning, 29(3), 21. Google Scholar logo with link to Google Scholar
Cited by (2)

Cited by two other publications

Harvey, Robin E. & Patricia J. Brooks
2025. Relationships between writing, reading, and proficiency in Chinese immersion. Foreign Language Annals 58:2 ► pp. 392 ff. DOI logo
Coss, Matthew D.
2024. The E-writing Approach to L2 Chinese Pedagogy: Educational Imperative and Empirical Evidence. In Teaching Chinese Characters in the Digital Age [Palgrave Studies on Chinese Education in a Global Perspective, ], ► pp. 81 ff. DOI logo

This list is based on CrossRef data as of 8 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue