Cover not available

In:Mobile Eye Tracking: New avenues for the study of gaze in social interaction
Edited by Elisabeth Zima and Anja Stukenbrock
[Pragmatics & Beyond New Series 351] 2025
► pp. 277–310

Get fulltext
PDF logo with download linkDownload Chapter PDF
EPUB logo with download linkDownload Chapter EPUB

Chapter 10
Joint attention without language?

On intersubjectivity and the joint experience of nature

 | Black Forest National Park
 | University of Freiburg
 | University of Freiburg
 | University of Potsdam
Open Access logo
Available under the Creative Commons Attribution (CC BY) 4.0 license.

For any use beyond this license, please contact the publisher at rights@benjamins.nl.

Published online: 13 May 2025
DOI logo with link
https://doi.org/10.1075/pbns.351.10bot
Abstract
We discuss the question of whether the intersubjective experience of nature requires language or whether it can be achieved by bodily means alone. Based on mobile eye-tracking data and audio recordings from walks in nature, we focus on noticings. We claim that two levels of intersubjectivity are involved in noticings. On the first level, co-participants can establish joint attention without language, by observing each other’s bodily behaviour, such as gaze, body movements and bodily orientation. Following Schütz’s concepts of common sense thinking and typification, we argue that in such cases walkers rely on shared knowledge, for instance based on previous experiences. On the second level, we show that language is necessary to take co-participants from joint attention to joint experience.
Article outline
  • 1.Introduction
  • 2.Joint attention and the experience of nature
  • 3.Data and methods
  • 4.Joint attention without language
    • 4.1Walker B bodily co-orients with walker A and produces a verbal uptake
    • 4.2Walker B bodily co-orients with walker A, walker A produces a verbal account
    • 4.3Walker B bodily co-orients with walker A and initiates repair
  • 5.Discussion and conclusion
  • Acknowledgements
  • Notes
  • References
  • Appendix
References (48)
References
Anna, Marina, and Martin Pfeiffer. 2021. “Die frühkindliche Verwendung des Exklamativformats ‚oh+X‘: Noticings und Problemmitteilungen [Young children’s use of the exclamative format ‘oh+X’: Noticings and reports of trouble].“ Gesprächsforschung — Online-Zeitschrift zur verbalen Interaktion 22: 1–35.Google Scholar logo with link to Google Scholar
Auer, Peter, Barbara Laner, Martin Pfeiffer, and Kerstin Botsch. 2024. “Noticing and assessing nature: A multimodal investigation of the format “perception imperative + exclamative” based on mobile eye-tracking data.” In New Perspectives in Interactional Linguistic Research, ed. by Margret Selting, and Dagmar Barth-Weingarten, 245–275. Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Auer, Peter and Barbara Laner, this volume. “Laughter and gaze among talkers on a walk” in Mobile Eye Tracking: New avenues for the study of gaze in social interaction. ed. by E. Zima and A. Stukenbrock (Amsterdam: John Benjamins).
Bühler, Karl. 1934. Sprachtheorie: die Darstellungsfunktion der Sprache [Language theory: the representational function of language]. Jena: Gustav Fischer.Google Scholar logo with link to Google Scholar
Cao, Liyu, and Barbara Händel. 2019. “Walking enhances peripheral visual processing in humans.” PLoS Biology 17(10): e3000511. Google Scholar logo with link to Google Scholar
Clark, Eve V. 2015. “Common ground.” In The Handbook of Language Emergence, ed. by Brian MacWhinney, and William O’Grady, 328–353. John Wiley & Sons. Google Scholar logo with link to Google Scholar
Clark, Herbert H. 1996. Using Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Clark, Herbert H., and Catherine R. Marshall. 1981. “Definite reference and mutual knowledge” In Elements of Discourse Understanding, ed. by A. K. Joshi, B. Webber, and I. Sag, 10–63. Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
De Stefani, Elwys. 2010. “Reference as an interactively and multimodally accomplished practice. Organizing spatial reorientation in guided tours.” In Spoken Communication, ed. by Massimo Pettorino, Antonella Giannini, Isabella Chiara, and Francesca Dovetto, 137–170. Newcastle: Cambridge Scholars Publishing.Google Scholar logo with link to Google Scholar
Drew, Paul. 1997. “‘Open’ class repair initiators in response to sequential sources of trouble in conversation.” Journal of Pragmatics 28: 69–101. Google Scholar logo with link to Google Scholar
Flom, Ross, Kang Lee, and Darwin Muir (eds). 2007. Gaze-Following: Its Development and Significance. Mahwah, New Jersey: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Goffman, Erving. 1981. Forms of Talk. Philadelphia: University of Pennsylvania Press.Google Scholar logo with link to Google Scholar
. 2010. Relations in Public. Microstudies of the Public Order. New Brunswick/London: Transaction Publishers.Google Scholar logo with link to Google Scholar
Goodwin, Charles. 2003. “Pointing as situated practice.” In Spoken Communication, ed. by Kita Sotaro, 217–241. Mahwah, New Jersey: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Goodwin, Marjorie, and Charles Goodwin. 2012. “Car talk: integrating texts, bodies, and changing landscapes.” Semiotica 191: 257–286.Google Scholar logo with link to Google Scholar
Hausendorf, Heiko. 2003. “Deixis and speech situation revisited: the mechanism of perceived perception.” In Deictic Conceptualisation of Space, Time and Person, ed. by F. Lenz, 249–269. Benjamins. Google Scholar logo with link to Google Scholar
Kääntä, Leila. 2014. “From noticing to initiating correction: students’ epistemic displays in instructional interaction”. Journal of Pragmatics. 66: 86–105. Google Scholar logo with link to Google Scholar
Kesselheim, Wolfgang, Christina Brandenberger and Christoph Hottiger. 2021. “How to notice a tsunami in a water tank: joint discoveries in a science center.” Gesprächsforschung — Online-Zeitschrift zur verbalen Interaktion 22: 87–113.Google Scholar logo with link to Google Scholar
Küttner, Uwe-A., and Chase Wesley Raymond. 2022. “I was gonna say…: on the doubly reflexive character of a meta-communicative practice.” In Sprachreflexive Praktiken: Empirische Perspektiven auf Metakommunikation, ed. By Florian Busch, Pepe Droste, and Elisa Wessels, 51–73. Berlin: J.B. Metzler/Springer. Google Scholar logo with link to Google Scholar
Keisanen, Tina. 2012. ““Uh-oh, we were going there”: environmentally occasioned noticings of trouble in in-car interaction”. Semiotica, 191, 197–222. Google Scholar logo with link to Google Scholar
Laanesoo, K., and Keevallik, L. 2017. “Noticing breaches with non-polar interrogatives: Estonian Kes ‘who’ ascribing responsibility for problematic conduct”. Research on Language and Social Interaction. 50, 286–306. Google Scholar logo with link to Google Scholar
Laner, Barbara. 2022. “‘Guck mal der Baum’ — Zur Verwendung von Wahrnehmungsimperativen mit und ohne ‚mal‘ [‘Look PTCL (at) that tree’ — On the use of perception imperatives with and without ‘mal’].” Gesprächsforschung — Online-Zeitschrift zur verbalen Interaktion 23: 1–35.Google Scholar logo with link to Google Scholar
Luhmann, Niklas. 1972. “Einfache Sozialsysteme [Simple social systems].“ Zeitschrift für Soziologie 1 (1): 51–65. Google Scholar logo with link to Google Scholar
Merlino, Sara, and Lorenza Mondada. 2019. “Crossing the street: how pedestrians interact with cars”. Language & Communication 65: 131–147. Google Scholar logo with link to Google Scholar
Mondada, Lorenza. 2017. “Walking and talking together: questions/answers and mobile participation in guided visits.” Social Science Information 56 (2): 220–253. Google Scholar logo with link to Google Scholar
Mortensen, Kristian, and Johannes Wagner. 2019. “Inspection sequences — Multisensorial inspections of unfamiliar objects.” Gesprächsforschung — Online-Zeitschrift zur verbalen Interaktion 20: 399–443.Google Scholar logo with link to Google Scholar
Pfeiffer, Martin, and Marina Anna. 2021. “Recruiting assistance in early childhood: longitudinal changes in the use of ‘oh+X’ as a way of reporting trouble in German.” Research on Language and Social Interaction 54 (2): 142–162. Google Scholar logo with link to Google Scholar
Rasmussen, Gitte and Elisabeth Dalby Kristiansen, this volume. “The influence of the specificities of gaze behaviour on emerging and ensuing interaction — A contribution to the discussion of the use of eye-tracking recordings for EMCA analysis” in Mobile Eye Tracking: New avenues for the study of gaze in social interaction. ed. by E. Zima and A. Stukenbrock (Amsterdam: John Benjamins).
Sacks, Harvey. 1992. Lectures on Conversation Oxford: Blackwell.Google Scholar logo with link to Google Scholar
. 1995. Lectures on Conversation. Oxford: Basil Blackwell. Google Scholar logo with link to Google Scholar
Scaife, M., and J. S. Bruner. 1975. “The capacity for joint visual attention in the infant.” Nature 253 (5489): 265–266. Google Scholar logo with link to Google Scholar
Selting, Margret et al. (2009). Gesprächsanalytisches Transkriptionssystem 2 (GAT 2). Gesprächsforschung - Online-Zeitschrift zur verbalen Interaktion 10: 353–402.Google Scholar logo with link to Google Scholar
Schegloff, Emanuel A. 2007. “Retro-sequences.” In Sequence Organization in Interaction. A Primer in Conversation Analysis, 217–219. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
1988. “Presequences and indirection: applying speech act theory to ordinary conversation”, Journal of Pragmatics 12 (1): 55–62.Google Scholar logo with link to Google Scholar
Schütz, Alfred. 1953. “Common-sense and scientific interpretation of human action.” Philosophy and Phenomenological Research 14 (1): 1–38. Google Scholar logo with link to Google Scholar
Schütz, Alfred, and Thomas Luckmann. 1979. Strukturen der Lebenswelt [Structures of the Life-World]. Frankfurt/Main: Suhrkamp.Google Scholar logo with link to Google Scholar
Siitonen, Pauliina, Mirka Rauniomaa, and Tiina Keisanen. “2021. Language and the moving body: directive actions with the Finnish Kato ‘look’ in nature-related activities. Frontiers in Psychology 12: 66178.Google Scholar logo with link to Google Scholar
Stukenbrock, Anja. 2015. Deixis in der face-to-face-Interaktion [Deixis in Face-to-face Interaction]. Berlin: de Gruyter. Google Scholar logo with link to Google Scholar
. 2018. “Blickpraktiken von SprecherInnen und AdressatInnen bei der Lokaldeixis: Mobile Eye Tracking-Analysen zur Herstellung von joint attention [Gaze Practices of Speakers and Addressees in Local Deixis: Mobile Eye Tracking Analyses on the Establishment of Joint Attention]“ Gesprächsforschung — Online-Zeitschrift zur verbalen Interaktion 19: 132–168.Google Scholar logo with link to Google Scholar
. 2020. “Deixis, meta-perceptive gaze practices, and the interactional achievement of joint attention.” Frontiers in Psychology 11 (1779): 1–23. Google Scholar logo with link to Google Scholar
. 2023. “Temporality and the cooperative infrastructure of human communication: noticings to delay and to accelerate onward movement in mobile interaction.” Language & Communication 92: 33–54. Google Scholar logo with link to Google Scholar
Stukenbrock, Anja and Anh Nhi Dao. 2019. “Joint Attention in passing: what dual mobile eye tracking reveals about gaze in coordinating embodied activities at a market.” In Embodied Activities in Face-to-Face and Mediated Settings. Social Encounters in Time and Space, ed. by Elisabeth Reber, and Cornelia Gerhardt, 177–213. Cham: Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Tomasello, Michael. 2005. Constructing a Language: A Usage-based Theory of Language Acquisition. Cambridge: Harvard University Press. Google Scholar logo with link to Google Scholar
. 2008. Origins of Human Communication. MIT Press. Google Scholar logo with link to Google Scholar
Wilkins, David. 2003. “Why pointing with the index finger is not a universal (in sociocultural and semiotic Terms).” In Pointing: Where Language, Culture, and Cognition Meet, ed. by Sotaro Kita, 171–215. Mahwah, New Jersey: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Wittenburg, Peter, Brugman, Hennie, Russel, Albert, Klassmann, Alex and Sloetjes, Han (2006). “ELAN: a professional framework for multimodality research”. In: Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC’06), Genoa, Italy: European Language Resources Association (ELRA).Google Scholar logo with link to Google Scholar
Zhisheng, W., Y. Nagai, D. Zhu, J. Liu, and N. Zou. 2019. “Based on creative thinking to museum lighting design influences to visitors emotional response levels theory Research.” IOP Conference Series: Materials Science and Engineering 573: 1–7.Google Scholar logo with link to Google Scholar
Zima, Elisabeth, Peter Auer and Christoph Rühlemann, this volume. “Why research in gaze in social interaction needs mobile eye tracking” in Mobile Eye Tracking: New avenues for the study of gaze in social interaction. ed. by E. Zima and A. Stukenbrock (Amsterdam: John Benjamins).
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue