Cover not available

In:Approaches to Learning, Testing and Researching L2 Vocabulary
Edited by Stuart Webb
[Benjamins Current Topics 109] 2020
► pp. 117–142

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

The guessing from context test

 | Kyoto University, Japan
 | The University of Western Ontario, Canada
Published online: 6 August 2020
DOI logo with link
https://doi.org/10.1075/bct.109.itl.00009.sas
Abstract
This study aims to develop two equivalent forms of the Guessing from Context Test (GCT) and provide its preliminary validity evidence. The GCT is a diagnostic test of the guessing skill and measures the following three important steps in guessing: identifying the part of speech of an unknown word, finding its discourse clue, and deriving its meaning. The test was administered to 428 Japanese learners of English. The results indicate that the two forms each with 20 question sets are equivalent in terms of item difficulty distribution and representativeness of the construct being measured. A wide range of validity evidence was provided using Messick’s validation framework, the Rasch model, qualitative investigations into the relationships to actual guessing, and proposals for score interpretation.
Article outline
  • 1.Introduction
  • 2.Features of the GCT
    • 2.1What clues are included?
    • 2.2How is the guessing skill measured?
  • 3.Development of two equivalent forms
    • 3.1Materials preparation
    • 3.2Participants
    • 3.3Materials
    • 3.4Item analysis
    • 3.5Creating equivalent forms
  • 4.Test evaluation
    • 4.1Content aspect of construct validity
    • 4.2Substantive aspect of construct validity
    • 4.3Structural aspect of construct validity
    • 4.4Generalizability aspect of construct validity
    • 4.5External aspect of construct validity
    • 4.6Qualitative investigation
    • 4.7Score interpretation
  • 5.Conclusion
  • Acknowledgements
  • Notes
  • References
References (68)
References
Ames, W. S. (1966). The development of a classification scheme of contextual aids. Reading Research Quarterly, 2(1), 57–82. Google Scholar logo with link to Google Scholar
Andrich, D. (1988). Rasch models for measurement. Beverly Hills, CA: Sage. Google Scholar logo with link to Google Scholar
Artley, A. S. (1943). Teaching word-meaning through context. Elementary English Review, 20(1), 68–74.Google Scholar logo with link to Google Scholar
Beck, I. L., McKeown, M. G., & McCaslin, E. S. (1983). Vocabulary development: All contexts are not created equal. Elementary School Journal, 83(3), 177–181. Google Scholar logo with link to Google Scholar
Bensoussan, M., & Laufer, B. (1984). Lexical guessing in context in EFL reading comprehension. Journal of Research in Reading, 7(1), 15–32. Google Scholar logo with link to Google Scholar
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences. New York, NY: Routledge. Google Scholar logo with link to Google Scholar
Brown, R., Waring, R., & Donkaewbua, S. (2008). Incidental vocabulary acquisition from reading, reading-while-listening, and listening to stories. Reading in a Foreign Language, 20(2), 136–163.Google Scholar logo with link to Google Scholar
Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296–322.Google Scholar logo with link to Google Scholar
Bruton, A., & Samuda, V. (1981). Guessing words. Modern English Teacher, 8(3), 18–21.Google Scholar logo with link to Google Scholar
Carnine, D., Kameenui, E. J., & Coyle, G. (1984). Utilization of contextual information in determining the meaning of unfamiliar words. Reading Research Quarterly, 19(2), 188–204. Google Scholar logo with link to Google Scholar
Clarke, D. F., & Nation, I. S. P. (1980). Guessing the meanings of words from context: Strategy and techniques. System, 8(3), 211–220. Google Scholar logo with link to Google Scholar
Cohen, J. (1988). Statistical power analysis for the behavioral science (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
(1992). A power primer. Psychological Bulletin, 112(1), 155–159. Google Scholar logo with link to Google Scholar
Cooper, T. C. (1999). Processing of idioms by L2 learners of English. TESOL Quarterly, 33(2), 233–262. Google Scholar logo with link to Google Scholar
de Bot, K., Paribakht, T. S., & Wesche, M. (1997). Towards a lexical processing model for the study of second language vocabulary acquisition: Evidence from ESL reading. Studies in Second Language Acquisition, 19(3), 309–329. Google Scholar logo with link to Google Scholar
Deighton, L. C. (1959). Vocabulary development in the classroom. New York, NY: Columbia University Press.Google Scholar logo with link to Google Scholar
Dulin, K. L. (1970). Using context clues in word recognition and comprehension. Reading Teacher, 23(5), 440–445.Google Scholar logo with link to Google Scholar
Ellis, R. (1994). Factors in the incidental acquisition of second language vocabulary from oral input: A review essay. Applied Language Learning, 5(1), 1–32.Google Scholar logo with link to Google Scholar
Fraser, C. A. (1999). Lexical processing strategy use and vocabulary learning through reading. Studies in Second Language Acquisition, 21(2), 225–241. Google Scholar logo with link to Google Scholar
Fukkink, R. G., & de Glopper, K. (1998). Effects of instruction in deriving word meaning from context: A meta-analysis. Review of Educational Research, 68(4), 450–469. Google Scholar logo with link to Google Scholar
Haastrup, K. (1985). Lexical inferencing – a study of procedures in reception. Scandinavian Working Papers on Bilingualism, 5, 63–87.Google Scholar logo with link to Google Scholar
(1987). Using thinking aloud and retrospection to uncover learners’ lexical inferencing procedures. In C. Faerch & G. Kasper (Eds.), Introspection in second language research (pp. 197–212). Clevedon: Multilingual Matters.Google Scholar logo with link to Google Scholar
(1991). Lexical inferencing procedures or talking about words. Tubingen: Gunter Narr.Google Scholar logo with link to Google Scholar
Haynes, M. (1993). Patterns and perils of guessing in second language reading. In T. Huckin, M. Haynes & J. Coady (Eds.), Second Language Reading and Vocabulary (pp. 46–64). Norwood, NJ: Ablex.Google Scholar logo with link to Google Scholar
Horst, M., Cobb, T., & Meara, P. (1998). Beyond a Clockwork Orange: Acquiring second language vocabulary through reading. Reading in a Foreign Language, 11(2), 207–223.Google Scholar logo with link to Google Scholar
Hu, M., & Nation, I. S. P. (2000). Vocabulary density and reading comprehension. Reading in a Foreign Language, 13(1), 403–430.Google Scholar logo with link to Google Scholar
Johnson, D., & Pearson, P. D. (1984). Teaching reading vocabulary. New York, NY: Holt, Rinehart & Winston.Google Scholar logo with link to Google Scholar
Kuhn, M. R., & Stahl, S. A. (1998). Teaching children to learn word meanings from context. Journal of Literacy Research, 30(1), 119–138. Google Scholar logo with link to Google Scholar
Laufer, B. (1997). The lexical plight in second language reading: Words you don’t know, words you think you know and words you can’t guess. In J. Coady & T. Huckin (Eds.), Second language vocabulary acquisition (pp. 20–34). Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
Laufer, B., & Ravenhorst-Kalovski, G. C. (2010). Lexical threshold revisited: Lexical text coverage, learners’ vocabulary size and reading comprehension. Reading in a Foreign Language, 22(1), 15–30.Google Scholar logo with link to Google Scholar
Laufer, B., & Sim, D. D. (1985). Taking the easy way out: Non-use and misuse of clues in EFL reading. English Teaching Forum, 23(2), 7–10, 20.Google Scholar logo with link to Google Scholar
Leech, G., Rayson, P., & Wilson, A. (2001). Word frequencies in written and spoken English. Harlow: Longman.Google Scholar logo with link to Google Scholar
Linacre, J. M. (1995). Prioritizing misfit indicators. Rasch Measurement Transactions, 9(2), 422–423.Google Scholar logo with link to Google Scholar
(2016a). WINSTEPS® Rasch measurement computer program. Beaverton, OR: Winsteps.com.Google Scholar logo with link to Google Scholar
(2016b). WINSTEPS® Rasch measurement computer programs User’s Guide. Beaverton, OR: Winsteps.com.Google Scholar logo with link to Google Scholar
Linacre, J. M., & Tennant, A. (2009). More about critical eigenvalue sizes (variences) in standardized-residual principal components analysis (PCA). Rasch Measurement Transactions, 23(3), 1228.Google Scholar logo with link to Google Scholar
McCullough, C. M. (1943). Learning to use context clues. Elementary English Review, 20, 140–143.Google Scholar logo with link to Google Scholar
(1945). The recognition of context clues in reading. Elementary English Review, 22(1), 1–5.Google Scholar logo with link to Google Scholar
Meng, X. -L., Rosenthal, R., & Rubin, D. B. (1992). Comparing correlated correlation coefficients. Psychological Bulletin, 111(1), 172–175. Google Scholar logo with link to Google Scholar
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York, NY: Macmillan.Google Scholar logo with link to Google Scholar
(1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. Google Scholar logo with link to Google Scholar
Morrison, L. (1996). Talking about words: A study of French as a second language learners’ lexical inferencing procedures. Canadian Modern Language Review, 53(1), 41–75. Google Scholar logo with link to Google Scholar
Nagy, W. E., Anderson, R. C., & Herman, P. A. (1987). Learning word meanings from context during normal reading. American Educational Research Journal, 24(2), 237–270. Google Scholar logo with link to Google Scholar
Nagy, W. E., Herman, P., & Anderson, R. C. (1985). Learning words from context. Reading Research Quarterly, 20(2), 233–253. Google Scholar logo with link to Google Scholar
Nassaji, H. (2003). L2 vocabulary learning from context: strategies, knowledge sources, and their relationship with success in L2 lexical inferencing. TESOL Quarterly, 37(4), 645–670. Google Scholar logo with link to Google Scholar
Nation, I. S. P. (2006). How large a vocabulary is needed for reading and listening? Canadian Modern Language Review, 63(1), 59–82. Google Scholar logo with link to Google Scholar
Nation, I. S. P., & Coady, J. (1988). Vocabulary and reading. In R. Carter & M. McCarthy (Eds.), Vocabulary and language teaching (pp. 97–110). London: Longman.Google Scholar logo with link to Google Scholar
Paribakht, T. S., & Wesche, M. (1999). Reading and “incidental” L2 vocabulary acquisition: An introspective study of lexical inferencing. Studies in Second Language Acquisition, 21(2), 195–224. Google Scholar logo with link to Google Scholar
Parry, K. (1991). Building a vocabulary through academic reading. TESOL Quarterly, 25(4), 629–653. Google Scholar logo with link to Google Scholar
Raîche, G. (2005). Critical eigenvalue sizes in standardized residual principal components analysis. Rasch Measurement Transactions, 19(1), 1012.Google Scholar logo with link to Google Scholar
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut.Google Scholar logo with link to Google Scholar
Sasao, Y., & Webb, S. (2017). The Word Part Levels Test. Language Teaching Research, 21(1), 12–30. Google Scholar logo with link to Google Scholar
Schatz, E. K., & Baldwin, R. S. (1986). Context clues are unreliable predictors of word meaning. Reading Research Quarterly, 21(4), 439–453. Google Scholar logo with link to Google Scholar
Schouten-van Parreren, C. (1996). Vocabulary learning and metacognition. In K. Sajavaara & C. Fairweather (Eds.), Approaches to second language acquisition (pp. 63–69). Jyvaskyla: University of Jyvaskyla.Google Scholar logo with link to Google Scholar
Seibert, L. C. (1945). A study on the practice of guessing word meanings from a context. Modern Language Journal, 29(4), 296–323. Google Scholar logo with link to Google Scholar
Smith Jr., E. V. (2004). Evidence for the reliability of measures and validity of measure interpretation: a Rasch measurement perspective. In E. V. Smith Jr. & R. M. Smith (Eds.), Introduction to Rasch measurement: Theory, models and applications (pp. 93–122). Maple Grove, MN: JAM Press.Google Scholar logo with link to Google Scholar
(2005). Effect of item redundancy on Rasch item and person estimates. Journal of Applied Measurement, 6, 147–163.Google Scholar logo with link to Google Scholar
Spache, G., & Berg, P. (1955). The art of efficient reading. New York, NY: Macmillan.Google Scholar logo with link to Google Scholar
Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3(3), 271–295.Google Scholar logo with link to Google Scholar
Stevens, J. (2002). Applied multivariate statistics for the social sciences (4th ed.). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Strang, R. M. (1944). How students attack unfamiliar words. The English Journal, 33(2), 88–93. Google Scholar logo with link to Google Scholar
van Parreren, C. F. (1975). First and second-language learning compared. In A. J. van Essen & J. P. Menting (Eds.), The context of foreign-language learning (pp. 100–116). Assen: Van Gorcum.Google Scholar logo with link to Google Scholar
Walters, J. (2006). Methods of teaching inferring meaning from context. RELC Journal, 37(2), 176–190. Google Scholar logo with link to Google Scholar
Waring, R., & Takaki, M. (2003). At what rate do learners learn and retain new vocabulary from reading a graded reader? Reading in a Foreign Language, 15(2), 130–163.Google Scholar logo with link to Google Scholar
Williams, R. (1985). Teaching vocabulary recognition strategies in ESP reading. ESP Journal, 4(2), 121–131. Google Scholar logo with link to Google Scholar
Wolfe, E. W., & Smith Jr., E. V. (2007). Instrument development tools and activities for measure validation using Rasch models: Part 2 – Validation activities. Journal of Applied Measurement, 8, 204–234.Google Scholar logo with link to Google Scholar
Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: MESA Press.Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue