Cover not available

Article published In: Gesture
Vol. 21:1 (2022) ► pp.1–27

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
EPUB logo with download linkDownload EPUB
authorization required

Indexing turn-beginnings in Norwegian Sign Language conversation

ORCiD logo with link | NTNU, Norwegian University of Science and Technology
Published online: 20 June 2023
DOI logo with link
https://doi.org/10.1075/gest.21004.fer
Abstract
It is well known that signers and speakers routinely produce finger points during interaction. While the referential functions of such finger points have received great attention from researchers, they are also used to manage interactions between interlocutors. These functions are less understood and have received less research focus. The current study helps to redress this gap in the literature by investigating how finger pointing is used to index and coordinate turn-beginnings in a corpus of 11 semi-naturalistic (Norwegian) signed language conversations, involving between two to five signers (3.4 hours of signing). The data was initially annotated in ELAN and then further qualitative analysis was conducted. This investigation revealed that finger pointing effectively indexes previous and upcoming discourse, thereby binding sequences of conversational moves and guiding their trajectory, helping signers to coordinate turn transitions and interaction as it unfolds.
Article outline
  • Coordinating and collaborating in multimodal conversation
  • Finger points as symbolic indexicals
  • Multimodal turn-beginnings in spoken and signed languages
    • Turn-beginnings, pre-beginnings, and presegments
    • Eye gaze, pointing, and other bodily actions during turn-beginnings
  • Data and analysis for the current study
  • Designing turn-beginnings and indexing meanings across moves in Norwegian Sign Language conversations with finger pointing
    • Responding to a question
    • Responding to a comment by an interlocutor
    • Pointing to coordinate turn trajectory and to collaborate on a joint word search
  • Discussion
  • Conclusion
  • Acknowledgements
  • Notes
  • Abbreviations
  • References
References (85)
References
(2005). Projection in interaction and projection in grammar. Text – Interdisciplinary Journal for the Study of Discourse, 25(1), 7–36. Google Scholar logo with link to Google Scholar
(2018). Gaze, addressee selection and turn-taking in three-party interaction. In G. Brône, & B. Oben (Eds.), Eye-tracking in Interaction: Studies on the role of eye gaze in dialogue (pp. 197–232). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Baker, C. (1977). Regulators and turn-taking in American Sign Language discourse. In L. A. Friedman (Ed.), On the other hand: New perspectives on American Sign Language (pp. 215–236). New York: Academic Press.Google Scholar logo with link to Google Scholar
Bavelas, J. B. (1994). Gestures as part of speech: methodological implications. Research on Language & Social Interaction, 27(3), 201–221. Google Scholar logo with link to Google Scholar
Bavelas, J. B., Coates, L., & Johnson, T. (2002). Listener responses as a collaborative process: The role of gaze. Journal of Communication, 52(3), 566–580. Google Scholar logo with link to Google Scholar
Bavelas, J. B., Chovil, N., Lawrie, D. A., & Wade, A. (1992). Interactive gestures. Discourse Processes, 15(4), 469–489. Google Scholar logo with link to Google Scholar
Beattie, G. W. (1978). Floor apportionment and gaze in conversational dyads. British Journal of Social and Clinical Psychology, 17(1), 7–15. Google Scholar logo with link to Google Scholar
Beukeleers, I. (2020). On the role of eye gaze in Flemish Sign Language: A multifocal eye-tracking study on the phenomena of online turn processing and depicting. Leuven: KU Leuven PhD dissertation.
Brône, G., Oben, B., Jehoul, A., Vranjes, J., & Feyaerts, K. (2017). Eye gaze and viewpoint in multimodal interaction management. Cognitive Linguistics, 28(3), 449–483. Google Scholar logo with link to Google Scholar
Cibulka, P. (2015). When the hands do not go home: A micro-study of the role of gesture phases in sequence suspension and closure. Discourse Studies, 17(1), 3–24. Google Scholar logo with link to Google Scholar
Clark, H. H. (1996). Using language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
(2003). Pointing and placing. In S. Kita (Ed.), Where language, culture, and cognition meet (pp. 243–268). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
(2005). Coordinating with each other in a material world. Discourse Studies, 7(4–5), 507–525. Google Scholar logo with link to Google Scholar
Clark, H. H., & Brennan, S. E. (1991). Grounding in communication. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 127–149). Washington, DC: American Psychological Association. Google Scholar logo with link to Google Scholar
Clark, H. H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition, 221, 1–39. Google Scholar logo with link to Google Scholar
Cormier, K., Schembri, A., & Woll, B. (2013). Pronouns and pointing in sign languages. Lingua, 1371, 230–247. Google Scholar logo with link to Google Scholar
Deppermann, A. (2013). Turn-design at turn-beginnings: Multimodal resources to deal with tasks of turn-construction in German. Journal of Pragmatics, 46(1), 91–121. Google Scholar logo with link to Google Scholar
Deppermann, A., & Streeck, J. (2018). The body in interaction: Its multiple modalities and temporalities. In A. Deppermann, & J. Streeck (Eds.), Time in embodied interaction: Synchronicity and sequentiality of multimodal resources (pp. 1–29). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
de Vos, C., Torreira, F., & Levinson, S. C. (2015). Turn-timing in signed conversations: coordinating stroke-to-stroke turn boundaries. Frontiers in Psychology, 6(268). Google Scholar logo with link to Google Scholar
Dressel, D. (2020). Multimodal word searches in collaborative storytelling: On the local mobilization and negotiation of coparticipation. Journal of Pragmatics, 1701, 37–54. Google Scholar logo with link to Google Scholar
Duncan, S. Jr. (1972). Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology, 23(1), 283–292. Google Scholar logo with link to Google Scholar
Enfield, N. J. (2009). The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Engberg-Pedersen, E. (2003). From pointing to reference and predication: pointing signs, eyegaze, and head and body orientation in Danish Sign Language. In S. Kita (Ed.), Pointing: Where language, culture and cognition meet (pp. 269–292). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar logo with link to Google Scholar
Ferrara, L. (2020). Some interactional functions of finger pointing in signed language conversations. Glossa: A journal of general linguistics, 5(1), 1–26. Google Scholar logo with link to Google Scholar
Ferrara, L. and Bø, V. (2022). Norwegian Sign Language Corpus – Pilot Corpus (Conversations). Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. Available at [URL] (last access 23 April 2023).
Ferrara, L., & Ringsø, T. (2021). Norwegian Sign Language corpus – Depicting Perspective. Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. Available at [URL] (last access 23 April 2023).
Girard-Groeber, S. (2015). The management of turn transition in signed interaction through the lens of overlaps. Frontiers in Psychology, 61, 741. Google Scholar logo with link to Google Scholar
(2018). Participation by hard-of-hearing students in integration classroms: Facets of interactional competence. Berlin: Frank & Timme.Google Scholar logo with link to Google Scholar
Goodwin, C. (1981). Conversational organization: Interaction between speakers and hearers. New York: Academic Press.Google Scholar logo with link to Google Scholar
(1986). Gestures as a resource for the organization of mutual orientation. Semiotica, 62(1–2), 29–49. Google Scholar logo with link to Google Scholar
(2000). Action and embodiment within situated human interaction. Journal of Pragmatics, 321, 1489–1522. Google Scholar logo with link to Google Scholar
(2002). Time in action. Current Anthropology, 43(S4). Google Scholar logo with link to Google Scholar
Goodwin, M. H., & Goodwin, C. (1986). Gesture and coparticipation in the activity of searching for a word. Semiotica, 62(1–2), 51–75. Google Scholar logo with link to Google Scholar
Hayashi, M. (2005). Joint turn construction through language and the body: Notes on embodiment in coordinated participation in situated activities. Semiotica, 156(1–4), 21–53. Google Scholar logo with link to Google Scholar
Heritage, J. (1984a). Garfinkel and ethnomethodology. Cambridge: Polity Press.Google Scholar logo with link to Google Scholar
(1984b). A change-of-state token and aspects of its sequential placement. In J. M. Atkinson, & J. C. Heritage (Eds.), Structures of social action: Studies in conversation analysis (pp. 299–345). Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
Holler, J., Turner, K., & Varcianna, T. (2013). It’s on the tip of my fingers: Co-speech gestures during lexical retrieval in different social contexts. Language and Cognitive Processes, 28(10), 1509–1518. Google Scholar logo with link to Google Scholar
Iwasaki, S. (2009). Initiating interactive turn spaces in Japanese conversation: Local projection and collaborative action. Discourse Processes, 46(2–3), 226–246. Google Scholar logo with link to Google Scholar
(2013b). Formational and functional characteristics of pointing signs in a corpus of Auslan (Australian sign language): Are the data sufficient to posit a grammatical class of ‘pronouns’ in Auslan? Corpus Linguistics and Linguistic Theory, 9(1), 109–159. Google Scholar logo with link to Google Scholar
Kalma, A. (1992). Gazing in triads: A powerful signal in floor apportionment. British Journal of Social Psychology, 311, 21–39. Google Scholar logo with link to Google Scholar
Keevallik, L. (2018). What does embodied interaction tell us about grammar? Research on Language & Social Interaction, 51(1), 1–21. Google Scholar logo with link to Google Scholar
Kendon, A. (1967). Some functions of gaze-direction in social interaction. Acta Psychological, 261, 22–63. Google Scholar logo with link to Google Scholar
(2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Kidwell, M. (2013). Framing, grounding, and coordinating conversational interaction: Posture, gaze, facial expression, and movement in space. In C. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body – Language – Communication (Vol. I1, pp. 100–113). Berlin: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Kita, S. (Ed.) (2003). Pointing: Where language, culture, and cognition meet. Mahwah, NJ: Lawrence Erlbaum Associates. Google Scholar logo with link to Google Scholar
Krauss, R. M., & Fussell, S. R. (1991). Constructed shared communicative environments. In L. B. Resnick, J. M. Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp. 172–200). Washington, DC: American Psychological Association. Google Scholar logo with link to Google Scholar
Kääntä, L. (2012). Teachers’ embodied allocations in instructional interaction. Classroom Discourse, 3(2), 166–186. Google Scholar logo with link to Google Scholar
Lackner, A. (2009). Turn-Taking und Dialogstruktur in der Oesterreichischen Gebärdensprache. Eine Gesprächsanalyse der Salzburger Variante, Vol. 811. Hamburg: Das Zeichen.Google Scholar logo with link to Google Scholar
Lepeut, A. (2020). Framing language through gesture: Palm-up, index finger-extended gestures, and holds in spoken and signed language interactions in French-speaking and signing Belgium. Namur: University of Namur PhD dissertation.
Lerner, G. H. (2003). Selecting Next Speaker: The Context-Sensitive Operation of a Context-Free Organization. Language in society, 32(2), 177–201. Google Scholar logo with link to Google Scholar
Liddell, S. K. (2003). Grammar, gesture, and meaning in American Sign Language. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Lindström, J. (2006). Grammar in the service of interaction: Exploring turn organization in Swedish. Research on Language & Social Interaction, 39(1), 81–117. Google Scholar logo with link to Google Scholar
Linell, P. (2009). Rethinking language, mind, and world dialogically. Charlotte, NC: Information Age Publishing.Google Scholar logo with link to Google Scholar
Local, J. (2004). Getting back to prior talk: and-uh(m) as a back-connecting device in British and American English. In E. Couper-Kuhlen, & C. E. Ford (Eds.), Sound patterns in interaction: Cross-linguistic studies from conversation (pp. 377–400). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Martinez, L. B. (1995). Turn-taking and eye gaze in sign conversations between Deaf Filipinos. In C. Lucas (Ed.), Sociolinguistics in Deaf communities (pp. 272–306). Washington, D.C.: Gallaudet University Press.Google Scholar logo with link to Google Scholar
Mazeland, H., & Huiskes, M. (2001). Dutch ‘but’ as a sequential conjunction: Its use as a resumption marker. In M. Selting, & E. Couper-Kuhlen (Eds.), Studies in interactional linguistics (pp. 141–169). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
McCleary, L., & de Arantes Leite, T. (2013). Turn-taking in Brazilian Sign Language: Evidence from overlap. Journal of Interactional Research in Communication Disorders, 4.11, 123–154. Google Scholar logo with link to Google Scholar
McIlvenny, P. (1995). Seeing conversations: Analyzing sign language talk. In P. Ten Have, & G. Psathas (Eds.), Situated order: Studies in the social organization of talk and embodied activities (pp. 129–150). Washington, DC: International Institute for Ethnomethodology and Conversation Analysis & University Press of America.Google Scholar logo with link to Google Scholar
Mittelberg, I. (2019). Peirce’s universal categories: On their potential for gesture theory and multimodal analysis. Semiotica, 2281, 193–222. Google Scholar logo with link to Google Scholar
Mondada, L. (2007). Multimodal resources for turn-taking: pointing and the emergence of possible next speakers. Discourse Studies, 9(2), 194–225. Google Scholar logo with link to Google Scholar
(2009). Emergent focused interactions in public places: A systematic analysis of the multimodal achievement of a common interactional space. Journal of Pragmatics, 411, 1977–1997. Google Scholar logo with link to Google Scholar
(2013). Embodied and spatial resources for turn-taking in institutional multi-party interactions: Participatory democracy debates. Journal of Pragmatics, 461, 39–68. Google Scholar logo with link to Google Scholar
(2018). Multiple temporalities of language and body in interaction: Challenges for transcribing multimodality. Research on Language & Social Interaction, 51(1), 85–106. Google Scholar logo with link to Google Scholar
Rossano, F. (2013). Gaze in conversation. In J. Sidnell, & T. Stivers (Eds.), The handbook of conversation analysis (pp. 308–329). Hoboken: Blackwell Publishing.Google Scholar logo with link to Google Scholar
Rutter, D. R., Stephenson, G. M., Ayling, K., & White, P. A. (1978). The timing of looks in dyadic conversation. British Journal of Social and Clinical Psychology, 17(1), 17–21. Google Scholar logo with link to Google Scholar
Ryttervik, M. (2015). Gesten PU i svenskt teckenspråk: En studie i dess form och funktion [Palms up gesture in Swedish Sign Language: An investigation of its form and function]. Stockholm: Stockholm University MA thesis. Available at [URL] (last access 23 April 2023).
Sacks, H., Schegloff, E. A., & Jefferson, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50(4), 696–735. Google Scholar logo with link to Google Scholar
Schegloff, E. A. (1984). On some gestures’ relation to talk. In J. M. Atkinson, & J. Heritage (Eds.), Structures of social action: studies in conversation analysis (pp. 266–295). Cambridge: Cambridge University Press.Google Scholar logo with link to Google Scholar
(1996). Turn organization: one intersection of grammar and interaction. In E. A. Schegloff, E. Ochs, & S. A. Thompson (Eds.), Interaction and grammar (pp. 52–133). Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Schober, M. F., & Clark, H. H. (1989). Understanding by addressees and overhearers. Cognitive Psychology, 21(2), 211–232. Google Scholar logo with link to Google Scholar
Shaw, E. (2019). Gesture in multiparty interaction. Washington, D.C.: Gallaudet University Press.Google Scholar logo with link to Google Scholar
Sidnell, J. (2006). Coordinating gesture, talk, and gaze in reenactments. Research on Language & Social Interaction, 39(4), 377–409. Google Scholar logo with link to Google Scholar
Streeck, J. (1995). On projection. In E. N. Goody (Ed.), Social intelligence and interaction: Expressions and implications of the social bias in human intelligence (pp. 87–110). Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
(2009a). Forward-gesturing. Discourse Processes, 46(2–3), 161–179. Google Scholar logo with link to Google Scholar
Streeck, J., & Hartge, U. (1992). Previews: Gestures at the transition place. In A. Di Luzio, & P. Auer (Eds.), The contextualization of language (pp. 135–157). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Streeck, J., & Jordan, J. S. (2009). Projection and anticipation: The forward-looking nature of embodied communication. Discourse Processes, 46(2–3), 93–102. Google Scholar logo with link to Google Scholar
Tiitinen, S., & Ruusuvuori, J. (2012). Engaging parents through gaze: Speaker selection in three-party interactions in maternity clinics. Parent Education and Counseling, 891, 38–43. Google Scholar logo with link to Google Scholar
Van Herreweghe, M. (2002). Turn-taking mechanisms and active participation in meetings with deaf and hearing participants in Flanders. In C. Lucas (Ed.), Turn-taking, fingerspelling, and contact in signed languages (Vol. 81, pp. 73–103). Washington D.C.: Gallaudet University Press.Google Scholar logo with link to Google Scholar
Wilkes-Gibbs, D. (1997). Studying language use as collaboration. In G. Kasper, & E. Kellerman (Eds.), Communication strategies: Psycholinguistic and sociolinguistic perspectives (pp. 238–274). London: Addison Wesley Longman.Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Börstell, Carl
2024. Finding continuers in Swedish Sign Language. Linguistics Vanguard 10:1 ► pp. 537 ff. DOI logo

This list is based on CrossRef data as of 9 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue