Cover not available

Article published In: Interaction Studies
Vol. 15:1 (2014) ► pp.1–37

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Verb concepts from affordances

Published online: 10 June 2014
DOI logo with link
https://doi.org/10.1075/is.15.1.01kal
In this paper, we investigate how the interactions of a robot with its environment can be used to create concepts that are typically represented by verbs in language. Towards this end, we utilize the notion of affordances to argue that verbs typically refer to the generation of a specific type of effect rather than a specific type of action. Then, we show how a robot can form these concepts through interactions with the environment and how humans can use these concepts to ease their communication with the robots. We demonstrate that iCub, a humanoid robot, can use the concepts, which it has developed, to to understand what a human performs, perform multi-step planning for reaching a goal state as well as to specify a goal to the robot using symbolic descriptions.
References (66)
Akgun, B., Dag, N., Bilal, T., Atil, I., & Sahin, E. (2009). Unsupervised learning of affordance relations on a humanoid robot. 24th International Symposium on Computer and Information Sciences (ISCIS), 254–259.Google Scholar logo with link to Google Scholar
Akgun, B., Tunaoglu, D., & Sahin, E. (2010). Action recognition through an action generation mechanism. International Conference on Epigenetic Robotics.Google Scholar logo with link to Google Scholar
Alissandrakis, A., Nehaniv, C., & Dautenhahn, K. (2003). Syn-chrony and perception in robotic imitation across embodiments. In Computational intelligence in robotics and automation, 2003. proceedings. 2003. ieee international symposium on (Vol. 21, pp. 923–930).
Ashby, F.G., & Maddox, W.T. (1993). Relations between prototype, exemplar, and decision bound models of categorization. Journal of Mathematical Psychology, 37(3), 372–400. Google Scholar logo with link to Google Scholar
Barsalou, L. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660.. Google Scholar logo with link to Google Scholar
Bergquist, T., Schenck, C., Ohiri, U., Sinapov, J., Griffith, S., & Stoytchev, A. (2009). Interactive object recognition using pro-prioceptive feedback. IROS Workshop: Semantic Perception for Mobile Manipulation .
Borghi, A.M. (2007). Object concepts and embodiment: Why sensorimotor and cognitive processes cannot be separated. La nuova Critica, 15(4), 447–472.Google Scholar logo with link to Google Scholar
2012). Action language comprehension, affordances and goals. InY. Coello & A. Bartolo(Eds.), Language and action in cognitive neuroscience. contemporary topics in cognitive neuroscience series (pp. 125–143). Psychology Press.Google Scholar logo with link to Google Scholar
Borghi, A.M., & Riggio, L. (2009). Sentence comprehension and simulation of object temporary, canonical and stable affordances. Brain Research, 12531, 117–128. Google Scholar logo with link to Google Scholar
Bruner, J., Goodnow, J., & Austin, G. (1986). A study of thinking. Transaction Publishers. Google Scholar logo with link to Google Scholar
Cangelosi, A. (2001). Evolution of communication and language using signals, symbols, and words. IEEE Transactions on Evolutionary Computation, 5(2), 93–101. Google Scholar logo with link to Google Scholar
2010). Grounding language in action and perception: From cognitive agents to humanoid robots. Physics of Life Reviews, 7(2), 139–151. Google Scholar logo with link to Google Scholar
Cangelosi, A., Hourdakis, E., & Tikhanoff, V. (2006). Language acquisition and symbol grounding transfer with neural networks and cognitive robots. International Joint Conference on Neural Networks (IJCNN), 1576–1582.Google Scholar logo with link to Google Scholar
Cangelosi, A., Metta, G., Sagerer, G., Nolfi, S., Nehaniv, C., Fischer, K., & Zeschel, A. (2010). Integration of action and language knowledge: A roadmap for developmental robotics. IEEE Transactions on Autonomous Mental Development, 2(3), 167–195. Google Scholar logo with link to Google Scholar
Cangelosi, A., & Parisi, D. (2004). The processing of verbs and nouns in neural networks: Insights from synthetic brain imaging. Brain and Language, 89(2), 401–408. Google Scholar logo with link to Google Scholar
Cangelosi, A., & Riga, T. (2006). An embodied model for sensorimotor grounding and grounding transfer: Experiments with epigenetic robots. Cognitive Science, 30(4), 673–689. Google Scholar logo with link to Google Scholar
Christiansen, M., & Kirby, S. (2003). Language evolution: Consensus and controversies. Trends in Cognitive Sciences, 7(7), 300–307. Google Scholar logo with link to Google Scholar
Cohen, P., Morrison, C., & Cannon, E. (2005). Maps for verbs: The relation between interaction dynamics and verb use. Proceedings of the 9th International Conference on Artificial Intelligence (ijcai).Google Scholar logo with link to Google Scholar
Elsner, B. (2007). Infants’ imitation of goaldirected actions: The role of movements and action effects. Acta Psychologica, 124(1), 44–59. Google Scholar logo with link to Google Scholar
Fischer, M., & Zwaan, R. (2008). Embodied language: A review of the role of the motor system in language comprehension. The Quarterly Journal of Experimental Psychology, 61(6), 825–850. Google Scholar logo with link to Google Scholar
Gabora, L., Rosch, E., & Aerts, D. (2008). Toward an ecological theory of concepts. Ecological Psychology, 20(1), 84–116. Google Scholar logo with link to Google Scholar
Gallese, V., & Lakoff, G. (2005). The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22(3), 455–479. Google Scholar logo with link to Google Scholar
Gärdenfors, P. (2004). Conceptual spaces: The geometry of thought. The MIT Press.Google Scholar logo with link to Google Scholar
Gibson, J.J. (1986). The ecologial approach to visual perception. Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Glenberg, A., & Kaschak, M. (2002). Grounding language in action. Psychonomic Bulletin and Review, 9(3), 558. Google Scholar logo with link to Google Scholar
Glenberg, A., & Robertson, D. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43(3), 379–401. Google Scholar logo with link to Google Scholar
Glenberg, A., Sato, M., Cattaneo, L., Riggio, L., Palumbo, D., & Buccino, G. (2008). Processing abstract language modulates motor system activity. The Quarterly Journal of Experimental Psychology, 61(6), 905–919. Google Scholar logo with link to Google Scholar
Hamilton, A., Grafton, S., & Hamilton, A. (2007). The motor hierarchy: from kinematics to goals and intentions. InP. Haggard, Y. Rossetti, & M. Kawato(Eds.), Sensorimotor foundations of higher cognition, attention and performance (pp. 381–408). Oxford University Press.
Harnad, S. (1990). The symbol grounding problem. Physica, D(42), 335–346.Google Scholar logo with link to Google Scholar
Hashimoto, T., & Masumi, A. (2007). Learning and transition of symbols: Towards a dynamical model of a symbolic individual. InC.N.C. Lyon & A. Cangelos(Eds.), Emergence of communication and language (pp. 223–236). Springer. Google Scholar logo with link to Google Scholar
Hommel, B., Musseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (tec): A framework for perception and action planning. Behavioral and Brain Sciences, 24(05), 849–878. Google Scholar logo with link to Google Scholar
Jebara, T. (2004). Machine learning: Discriminative and generative (Vol. 7551). Springer.. Google Scholar logo with link to Google Scholar
Johansen, M., & Kruschke, J. (2005). Category representation for classification and feature inference. Learning Memory, 31(6), 1433–1458. Google Scholar logo with link to Google Scholar
Kozima, H., Nakagawa, C., & Yano, H. (2002). Emergence of imitation mediated by objects. Lund University Cognitive Studies, 59–61.Google Scholar logo with link to Google Scholar
Krunic, V., Salvi, G., Bernardino, A., Montesano, L., & Santos-Victor, J. (2009). Affordance based word-to-meaning association. IEEE Int. Conference on Robotics and Automation (ICRA), 4138–4143.
Kruschke, J. (2005). Category learning. In:K. Lamberts, & R.L. Goldstone(Eds.), The handbook of cognition, 183–201.. Google Scholar logo with link to Google Scholar
Leopold, D., O’Toole, A., Vetter, T., & Blanz, V. (2001). Prototypereferenced shape encoding revealed by high-level aftereffects. Nature Neuroscience, 4(1), 89–94. Google Scholar logo with link to Google Scholar
Lyon, C., Nehaniv, C., & Cangelosi, A. (2007). Emergence of communication and language. Springer-VerlagNew York Inc. Google Scholar logo with link to Google Scholar
Mahalanobis, P. (1936). On the generalized distance in statistics. In Proceedings of the National Institute of Sciences of India (Vol. 21, pp. 49–55).
Marocco, D., Cangelosi, A., Fischer, K., & Belpaeme, T. (2010). Grounding action words in the sensorimotor interaction with the world: Experiments with a simulated iCub humanoid robot. Frontiers in Neurorobotics, 4(7), 1–15.Google Scholar logo with link to Google Scholar
Metta, G., & Fitzpatrick, P. (2003). Better vision through manipulation. Adaptive Behavior, 11(2), 109–128. Google Scholar logo with link to Google Scholar
Metta, G., Sandini, G., Vernon, D., Natale, L., & Nori, F. (2008). The iCub humanoid robot: An open platform for research in embodied cognition. In Proceedings ofthe 8th workshop on performance metrics for intelligent systems (pp. 50–56).
Minda, J., & Smith, J. (2001). Prototypes in category learning: The effects of category size, category structure, and stimulus com-plexity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27(3), 775–799. Google Scholar logo with link to Google Scholar
Montesano, L., Lopes, M., Bernardino, A., & Santos-Victor, J. (2008). Learning object affordances: From sensory-motor co-ordination to imitation. IEEE Transactions on Robotics, 24(1), 15–26. Google Scholar logo with link to Google Scholar
Montesano, L., Lopes, M., Melo, F., Bernardino, A., & Santos-Victor, J. (2009). A computational model of object affordances. Advances in Cognitive Systems.Google Scholar logo with link to Google Scholar
Nehaniv, C.L., Lyon, C., & Cangelosi, A. (2007). Current work and open problems: A road-map for research into the emergence of communication and language. InC.L.N.C. Lyon, & A. Cangelosi(Eds.), Emergence of communication and language (pp. 1–27). Springer. Google Scholar logo with link to Google Scholar
Nosofsky, R., Kruschke, J., & McKinley, S. (1992). Combining exemplar-based category representations and connectionist learning rules. Learning, Memory, 18(2), 211–233. Google Scholar logo with link to Google Scholar
Nosofsky, R., & Zaki, S. (2002). Exemplar and prototype models revisited: Response strategies, selective attention, and stimulus generalization. Learning Memory, 28(5), 924–940. Google Scholar logo with link to Google Scholar
Qin, A., & Suganthan, P. (2004). Robust growing neural gas algorithm with application in cluster analysis. Neural Networks, 17(8–9), 1135–1148. Google Scholar logo with link to Google Scholar
Rosch, E. (1973). Natural categories. Cognitive Psychology, 4(3), 328–350. Google Scholar logo with link to Google Scholar
Rosseel, Y. (2002). Mixture models of categorization. Journal of Mathematical Psychology, 46(2), 178–210. Google Scholar logo with link to Google Scholar
Rouder, J., & Ratcliff, R. (2006). Comparing exemplar-and rule-based theories of categorization. Current Directions in Psychological Science, 15(1), 9–13. Google Scholar logo with link to Google Scholar
Rudolph, M., Muhlig, M., Gienger, M., & Bohme, H.-J. (2010). Learning the consequences of actions: Representing effects as feature changes. Int. Symposium on Learning and Adaptive Behavior in Robotic Systems .
Rusu, R.B., & Cousins, S. (2011). 3d is here: Point cloud library (pcl). Library, 26(2), 1–4.Google Scholar logo with link to Google Scholar
Sahin, E., Cakmak, M., Dogar, M., Ugur, E., & Ucoluk, G. (2007). To afford or not to afford: A new formalization of affordances toward affordance-based robot control. Adaptive Behavior, 15(4), 447–472. Google Scholar logo with link to Google Scholar
Steels, L. (2003). Evolving grounded communication for robots. Trends in Cognitive Science, 7(7), 308–312. Google Scholar logo with link to Google Scholar
2007). The recruitment theory of language origins. InC.L.N.C. Lyon, & A. Cangelosi(Eds.), Emergence of communication and language (pp. 129–150). Springer. Google Scholar logo with link to Google Scholar
Ug̃ur, E., Sahin, E., & Oztop, E. (2009). Affordance learning from range data for multi-step planning. 9th International Conference on Epigenetic Robotics (Epirob) , 1461, 177–184.
Uğur, E., & Şahin, E. (2010). Traversability: A case study for learning and perceiving affordances in robots. Adaptive Behavior, 18(3–4), 258–284. Google Scholar logo with link to Google Scholar
Umilta, M., Intskirveli, I., Grammont, F., Rochat, M., Caruana, F., Jezzini, A., & Rizzolatti, G. (2008). When pliers become fingers in the monkey motor system. Proceedings of the National Academy of Sciences, 105(6), 2209. Google Scholar logo with link to Google Scholar
Umilta, M., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C., & Rizzolatti, G. (2001). I know what you are doing: A neurophysiological study. Neuron, 31(1), 155–165. Google Scholar logo with link to Google Scholar
Verguts, T., Ameel, E., & Storms, G. (2004). Measures of similarity in models of categorization. Memory and Cognition, 32(3), 379. Google Scholar logo with link to Google Scholar
Want, S.C., & Harris, P.L. (2002). How do children ape? Applying concepts from the study of non-human primates to the developmental study of imitation in children. Developmental Science, 5(1), 1–13. Google Scholar logo with link to Google Scholar
Zwaan, R., & Taylor, L. (2006). Seeing, acting, understanding: Motor resonance in language comprehension. Journal of Experimental Psychology-General, 135(1), 1–11. Google Scholar logo with link to Google Scholar
Cited by (22)

Cited by 22 other publications

Tamosiunaite, Minija, Tomas Kulvicius & Florentin Wörgötter
2023. Bootstrapping Concept Formation in Small Neural Networks. IEEE Transactions on Cognitive and Developmental Systems 15:2 ► pp. 566 ff. DOI logo
Gardenfors, Peter
2020. An Epigenetic Approach to Semantic Categories. IEEE Transactions on Cognitive and Developmental Systems 12:2 ► pp. 139 ff. DOI logo
Gärdenfors, Peter
2019. Using Event Representations to Generate Robot Semantics. ACM Transactions on Human-Robot Interaction 8:4 ► pp. 1 ff. DOI logo
Gärdenfors, Peter
2020. Primary Cognitive Categories Are Determined by Their Invariances. Frontiers in Psychology 11 DOI logo
Gärdenfors, Peter
2025. Conceptual Engineering for Engineers (and for Philosophers): Conceptual Spaces as a Tool. In New Perspectives on Conceptual Engineering - Volume 1 [Synthese Library, 513], ► pp. 159 ff. DOI logo
Bozcan, İlker & Sinan Kalkan
2019. COSMO: Contextualized scene modeling with Boltzmann Machines. Robotics and Autonomous Systems 113 ► pp. 132 ff. DOI logo
Zhong, Junpei, Tetsuya Ogata, Angelo Cangelosi & Chenguang Yang
2019. Disentanglement in conceptual space during sensorimotor interaction. Cognitive Computation and Systems 1:4 ► pp. 103 ff. DOI logo
Jamone, Lorenzo, Emre Ugur, Angelo Cangelosi, Luciano Fadiga, Alexandre Bernardino, Justus Piater & Jose Santos-Victor
2018. Affordances in Psychology, Neuroscience, and Robotics: A Survey. IEEE Transactions on Cognitive and Developmental Systems 10:1 ► pp. 4 ff. DOI logo
Olier, Juan Sebastian, Emilia Barakova, Carlo Regazzoni & Matthias Rauterberg
2017. Re-framing the characteristics of concepts and their relation to learning and cognition in artificial agents. Cognitive Systems Research 44 ► pp. 50 ff. DOI logo
Gharaee, Zahra, Peter Gardenfors & Magnus Johnsson
2016. 2016 12th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), ► pp. 538 ff. DOI logo
Gharaee, Zahra, Peter Gärdenfors & Magnus Johnsson
2017. Online recognition of actions involving objects. Biologically Inspired Cognitive Architectures 22 ► pp. 10 ff. DOI logo
Gharaee, Zahra, Peter Gärdenfors & Magnus Johnsson
2017. First and second order dynamics in a hierarchical SOM system for action recognition. Applied Soft Computing 59 ► pp. 574 ff. DOI logo
Min, Huaqing, Chang'an Yi, Ronghua Luo, Jinhui Zhu & Sheng Bi
2016. Affordance Research in Developmental Robotics: A Survey. IEEE Transactions on Cognitive and Developmental Systems 8:4 ► pp. 237 ff. DOI logo
Petit, Maxime, Grégoire Pointeau & Peter Ford Dominey
2016. Reasoning based on consolidated real world experience acquired by a humanoid robot. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 17:2 ► pp. 248 ff. DOI logo
Stramandinoli, Francesca, Vadim Tikhanoff, Ugo Pattacini & Francesco Nori
2016. 2016 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), ► pp. 79 ff. DOI logo
Yi, Chang'an, Huaqing Min, Jinhui Zhu & Pengshuai Yin
2016. 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), ► pp. 88 ff. DOI logo
Celikkanat, Hande, Guner Orhan & Sinan Kalkan
2015. A Probabilistic Concept Web on a Humanoid Robot. IEEE Transactions on Autonomous Mental Development 7:2 ► pp. 92 ff. DOI logo
Celikkanat, Hande, Erol Sahin & Sinan Kalkan
2015. 2015 International Conference on Advanced Robotics (ICAR), ► pp. 259 ff. DOI logo
Pandey, Amit Kumar & Rodolphe Gelin
2015. 2015 International Conference on Advanced Robotics (ICAR), ► pp. 642 ff. DOI logo
Celikkanat, Hande, Guner Orhan, Nicolas Pugeault, Frank Guerin, Erol Sahin & Sinan Kalkan
2014. 4th International Conference on Development and Learning and on Epigenetic Robotics, ► pp. 201 ff. DOI logo
Celikkanat, Hande, Guner Orhan, Nicolas Pugeault, Frank Guerin, Erol Sahin & Sinan Kalkan
2016. Learning Context on a Humanoid Robot using Incremental Latent Dirichlet Allocation. IEEE Transactions on Cognitive and Developmental Systems 8:1 ► pp. 42 ff. DOI logo
Yürüten, Onur, Erol Şahin & Sinan Kalkan
2013. The learning of adjectives and nouns from affordance and appearance features. Adaptive Behavior 21:6 ► pp. 437 ff. DOI logo

This list is based on CrossRef data as of 16 march 2026. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue