Cover not available

In:Visually Situated Language Comprehension
Edited by Pia Knoeferle, Pirita Pyykkönen-Klauck and Matthew W. Crocker
[Advances in Consciousness Research 93] 2016
► pp. 205–226

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
authorization required

The role of affordances in visually situated language comprehension

Published online: 10 March 2016
DOI logo with link
https://doi.org/10.1075/aicr.93.08cha
Affordances are potentiations for bodily action that are routinely evaluated in the course of perception. For example, the physical features of bricks, lamps, and pillows provide salient cues about the actions a perceiver could likely perform with those objects. In visually situated contexts, affordances can provide a potentially useful source of information for aspects of language comprehension. This chapter begins by reviewing various perspectives on affordances as well as issues regarding their computation. Of particular relevance is how the information provided by affordances differs from linguistically- or conceptually-encoded links between objects and actions, such as selectional restrictions or semantic associations. The chapter then describes various ways in which affordances influence visually situated language comprehension, using examples from different levels of linguistic processing. The remainder of the chapter considers whether language comprehension reflects the influence of “genuine” affordances or instead a system in which information about the idiosyncratic features of perceptible objects is combined with (and often controlled by) linguistic and cognitive constraints.
References (44)
References
Altmann, G.T.M., & Kamide, Y. (1999). Incremental interpretation at verbs: Restricting the domain of subsequent reference. Cognition, 73, 247-264. Google Scholar logo with link to Google Scholar
. (2009). Discourse mediation of the mapping between language and the visual world: Eye movements and mental representation. Cognition, 111, 55-71. Google Scholar logo with link to Google Scholar
Ballmer, T. (1981). Context change and its consequences for a theory of natural language. In H. Parret, M. Sbisà, & J. Verschueren (Eds.), Studies in language companion series: Vol. 7. Possibilities and limitations of pragmatics (pp. 17-55). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Chambers, C.G., & Cooke, H. (2009). Lexical competition during second-language listening: Sentence context, but not proficiency, constrains interference from the native lexicon. Journal of Experimental Psychology: Learning, Memory & Cognition, 35, 1029-1040. Google Scholar logo with link to Google Scholar
Chambers, C.G., & San Juan, V. (2008). Perception and presupposition in real-time language comprehension: Insights from anticipatory processing. Cognition, 108, 26-50. Google Scholar logo with link to Google Scholar
Chambers, C.G., Tanenhaus, M.K., Eberhard, K.M., Filip, H., & Carlson, G.N. (2002). Circumscribing referential domains during real-time language comprehension. Journal of Memory and Language, 47, 30-49. Google Scholar logo with link to Google Scholar
Chambers, C.G., Tanenhaus, M.K., & Magnuson, J.S. (2004). Actions and affordances in syntactic ambiguity resolution. Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 687-696. Google Scholar logo with link to Google Scholar
Collins, S.J., Graham, S.A., & Chambers, C.G. (2012). Preschoolers’ sensitivity to speaker action constraints to refer referential intent. Journal of Experimental Child Psychology, 112, 389-402. Google Scholar logo with link to Google Scholar
Crain, S., & Steedman, M. (1985). On not being led up the garden path: The use of context by the psychological parser. In D. Dowty, L. Karttunen, & A. Zwicky (Eds.), Natural language parsing: Psychological, computational, and theoretical perspectives (pp. 320-358). Cambridge, UK: Cambridge University Press. Google Scholar logo with link to Google Scholar
Dahan, D., & Tanenhaus, M.K. (2004). Continuous mapping form sound to meaning in spoken-language comprehension: Immediate effects of verb-based thematic constraints. Journal of Experimental Psychology: Learning, Memory and Cognition, 30, 498-513. Google Scholar logo with link to Google Scholar
Ellis, R., & Tucker, M. (2000). Micro-affordance: The potentiation of components of action by seen objects. British Journal of Psychology, 91, 451-471. Google Scholar logo with link to Google Scholar
Garnham, A., & Oakhill, J.V. (1996). The mental models theory of language comprehension. In B.K. Britton & A.C. Graesser (Eds.), Models of understanding text (pp. 313-339). Hillsdale, NJ: Erlbaum.Google Scholar logo with link to Google Scholar
Gibson, J.J. (1977). The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67-82). Hillsdale, NJ: Erlbaum.Google Scholar logo with link to Google Scholar
. (1979). The ecological approach to visual perception. New York: Houghton Mifflin.Google Scholar logo with link to Google Scholar
Glenberg, A.M., Becker, R., Klötzer, S., Kolano, L., Müller, S., & Rinck, M., (2009). Episodic affordances contribute to language comprehension. Language and Cognition, 1, 113-135. Google Scholar logo with link to Google Scholar
Glenberg, A.M., & Robertson, D.A. (1999). Indexical understanding of instructions. Discourse Processes, 28, 1-26. Google Scholar logo with link to Google Scholar
. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43, 379-401. Google Scholar logo with link to Google Scholar
Greeno, J.G. (1994). Gibson's affordances. Psychological Review, 101, 336-342. Google Scholar logo with link to Google Scholar
Hanna, J.E. & Tanenhaus, M.K. (2004). Pragmatic effects on reference resolution in a collaborative task: Evidence from eye movements. Cognitive Science, 28, 105-115. Google Scholar logo with link to Google Scholar
Humphreys, G. (2001). Objects, affordances, action! The Psychologist, 14, 408-412.Google Scholar logo with link to Google Scholar
Johnson-Laird, P.N. (1983). Mental models: Towards a cognitive science of language, inference and consciousness. Cambridge, UK: Cambridge University Press.Google Scholar logo with link to Google Scholar
Jones, K.S. (2003). What is an affordance? Ecological Psychology, 15, 107-114. Google Scholar logo with link to Google Scholar
Kako, E., & Trueswell, J.C. (2000). Verb meanings, object affordances, and the incremental restriction of reference. Proceedings of the 22nd Annual Conference of the Cognitive Science Society (pp. 256-261). Hillsdale, NJ: Erlbaum.
Kamp, H., & Reyle, U. (1993). From discourse to logic. Dordrecht, NL: Kluwer. Google Scholar logo with link to Google Scholar
Kaschak, M.P., & Glenberg, A.M. (2000). Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language, 43, 508-529. Google Scholar logo with link to Google Scholar
Knoeferle, P., & Crocker, M.W. (2007). The influence of recent scene events on spoken comprehension: Evidence from eye movements. Journal of Memory and Language, 57, 519-543. Google Scholar logo with link to Google Scholar
Kraljic, T., Samuel, A.G., & Brennan, S.E. (2008). First impressions and last resorts: How listeners adjust to speaker variability. Psychological Science, 19, 332-338. Google Scholar logo with link to Google Scholar
Magnuson, J.S., Dixon, J., Tanenhaus, M.K., & Aslin, R.N. (2007). The dynamics of lexical competition during spoken word recognition. Cognitive Science, 31, 133-156. Google Scholar logo with link to Google Scholar
Magnuson, J.S., Tanenhaus, M.K., Aslin, R.N., & Dahan, D. (2003). The time course of spoken word recognition and learning: Studies with artificial lexicons. Journal of Experimental Psychology: General, 132, 202-227. Google Scholar logo with link to Google Scholar
Myung, J.-J., Blumstein, S.E., & Sedivy, J.C. (2006). Playing on the typewriter, typing on the piano: Manipulation knowledge of objects. Cognition, 98, 223-243. Google Scholar logo with link to Google Scholar
Revill, K.P., Tanenhaus, M.K., & Aslin, R.N. (2008). Context and spoken word recognition in a novel lexicon. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1207-1223. Google Scholar logo with link to Google Scholar
Riddoch, M.J., & Humphreys, G.W. (1987). Visual object processing in a case of optic aphasia: A case of semantic access agnosia. Cognitive Neuropsychology, 4, 131-185. Google Scholar logo with link to Google Scholar
Riddoch, M.J., Humphreys, G.W., & Price, C.J. (1989). Routes to action: Evidence from apraxia. Cognitive Neuropsychology, 6, 437-454. Google Scholar logo with link to Google Scholar
Sedivy, J.C., Tanenhaus, M.K., Chambers, C.G., & Carlson, G.N. (1999). Achieving incremental interpretation through contextual representation. Cognition, 71, 109-147. Google Scholar logo with link to Google Scholar
Shaw, R., & Turvey, M.T. (1981). Coalitions as models for ecosystems: A realist perspective on perceptual organization. In M. Kubovy & J. Pomerantz (Eds.), Perceptual organization (pp. 343-415). Hillsdale, NJ: Erlbaum.Google Scholar logo with link to Google Scholar
Spivey, M. & Richardson, D. (2009). Language embedded in the environment. In P. Robbins & M. Aydede (Eds.), The Cambridge handbook of situated cognition (pp. 382-400). Cambridge, UK: Cambridge University Press.Google Scholar logo with link to Google Scholar
van Gelder, T., & Port, R. (Eds.). (1995). Mind as motion: Explorations in the dynamics of cognition. Cambridge, MA: MIT Press.Google Scholar logo with link to Google Scholar
van Leeuwen, L., Smitsman, A., & van Leeuwen, C. (1994). Affordances, perceptual complexity, and the development of tool use. Journal of Experimental Psychology: Human Perception and Performance, 20, 174-191. Google Scholar logo with link to Google Scholar
Vingerhoets, G., Vandamme, K., & Vercammen, A. (2009). Conceptual and physical object qualities contribute differently to motor affordances. Brain and Cognition, 69, 481-489. Google Scholar logo with link to Google Scholar
Wolter, L., Skovbroten Gorman, K., & Tanenhaus, M.K. (2011). Scalar reference, contrast and discourse: Separating effects of linguistic discourse from availability of the referent. Journal of Memory and Language, 65, 299-317. Google Scholar logo with link to Google Scholar
Ye, L., Cardwell, W., & Mark, L. (2009). Perceiving multiple affordances for objects. Ecological Psychology, 21, 185-217. Google Scholar logo with link to Google Scholar
Yee, E., Huffstetler, S., & Thompson-Schill, S.L. (2011). Function follows form: Activation of shape and function features during object identification. Journal of Experimental Psychology: General, 140, 348-363. Google Scholar logo with link to Google Scholar
Zwaan, R.A., & Kaschak, M.P. (2009). Language in the brain, body, and world. In P. Robbins & M. Aydede (Eds.), The Cambridge handbook of situated cognition (pp. 368-381). Cambridge, UK: Cambridge University Press.Google Scholar logo with link to Google Scholar
Zwaan, R.A., & Radvansky, G.A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123, 162-185. Google Scholar logo with link to Google Scholar
Cited by (2)

Cited by two other publications

Hafri, Alon & John C. Trueswell
2025. Apprehending relational events: The visual world paradigm and the interplay of event perception and language. Brain Research 1869 ► pp. 150000 ff. DOI logo
Wan, Yingjia, Yipu Wei, Baorui Xu, Liqi Zhu & Michael K. Tanenhaus
2023. Musical coordination affects children's perspective‐taking, but musical synchrony does not. Developmental Science 26:5 DOI logo

This list is based on CrossRef data as of 10 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue