Cover not available

Article published In: Gesture
Vol. 19:1 (2020) ► pp.72–96

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

The more you move, the more action you construct

A motion capture study on head and upper-torso movements in constructed action in Finnish Sign Language narratives

 | University of Jyväskylä
 | University of Jyväskylä
 | University of Jyväskylä
 | University of Jyväskylä
Published online: 18 May 2021
DOI logo with link
https://doi.org/10.1075/gest.19042.jan
Abstract
This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed action) in FinSL. Specifically, the paper evaluates the validity of two arguments concerning constructed action: that constructed action forms a continuum with regular narration, and that constructed action divides into three subtypes (i.e., overt, reduced, and subtle). The results presented in the paper support the first argument but not directly the second one. Because of the ambiguous position of reduced constructed action in between subtle and overt constructed action, we argue in the paper that the present three-part typology of constructed action may need revising. As an alternative way of subcategorizing the phenomenon we propose a division between strong and weak constructed action.
Article outline
  • Introduction
  • Constructed action, its degrees and articulation
  • Data and methodology
    • Motion capture data
    • Annotation
    • Sampling, processing, and analysis
  • Results
  • Discussion
  • Conclusion
  • Acknowledgements
  • References
References (26)
References
Burger, Birgitta, Saarikallio, Suvi, Luck, Geoff, Thompson, Marc, & Toiviainen, Petri. (2013). Relationships between perceived emotions in music and music-induced movement. Music Perception, 30 (5), 519–535. Google Scholar logo with link to Google Scholar
Burger, Birgitta & Toiviainen, Petri. (2013). MoCap Toolbox: A Matlab toolbox for computational analysis of movement data. In Roberto Bresin (Ed.), Proceedings of the 10th Sound and Music Computing Conference, Stockholm, Sweden (pp. 172–178). Berlin: Logos.Google Scholar logo with link to Google Scholar
Burger, Birgitta, Puupponen, Anna, & Jantunen, Tommi. (2018). Synchronizing eye tracking and optical motion capture: How to bring them together. Journal of Eye Movement Research, 11 (2), 5. Google Scholar logo with link to Google Scholar
Cormier, Kearsy, Smith, Sandra, & Sevcikova Sehyr, Zed. (2015). Rethinking constructed action. Sign Language & Linguistics, 18 (2), 167–204. Google Scholar logo with link to Google Scholar
Crasborn, Onno & Sloetjes, Han. (2008). Enhanced ELAN functionality for sign language corpora. In Onno Crasborn, Elene Efthimiou, Thomas Hanke, Ernst D. Thoutenhoofd, & Inge Zwitserlood (Eds.), Proceedings of the 3rd Workshop on the Representation and Processing of Sign Languages: Construction and Exploitation of Sign Language Corpora (pp. 39–43). Paris: ELRA.Google Scholar logo with link to Google Scholar
De Beuzeville, Louise, Johnston, Trevor, & Schembri, Adam. (2009). The use of space with indicating verbs in Australian Sign Language: A corpus-based investigation. Sign Language & Linguistics, 12 (1), 52–83. Google Scholar logo with link to Google Scholar
Enfield, Nick. (2009). The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Engberg-Pedersen, Elisabeth. (2015). Perspective in signed discourse: The privileged status of the signer’s locus and gaze. Open Linguistics, 11, 411–431. Google Scholar logo with link to Google Scholar
Ferrara, Lindsay & Johnston, Trevor. (2014). Elaborating who’s what: A study of constructed action and clause structure in Auslan (Australian Sign Language). Australian Journal of Linguistics, 34 (2), 193–215. Google Scholar logo with link to Google Scholar
Ferrara, Lindsay & Hodge, Gabrielle. (2018). Language as description, indication, and depiction. Frontiers in Psychology, 9, 716. Google Scholar logo with link to Google Scholar
Herrmann, Annika & Steinbach, Markus. (2012). Quotation in sign languages: A visible context shift. In Ingrid van Alphen & Isabelle Buchstaller (Eds.), Quotatives: Cross-linguistic and cross-disciplinary perspectives (pp. 203–230). Amsterdam: John Benjamins. Google Scholar logo with link to Google Scholar
Hodge, Gabrielle & Cormier, Kearsy. (2019). Reported speech as enactment. Linguistic Typology, 23 (1), 185–196. Google Scholar logo with link to Google Scholar
Hodge, Gabrielle & Ferrara, Lindsay. (2014). Showing the story: Enactment as performance in Auslan narratives. In Lauren Gawne & Jill Vaughan (Eds.), Selected papers from the 44th Conference of the Australian Linguistic Society, 2013 (pp. 372–397). Melbourne: University of Melbourne.Google Scholar logo with link to Google Scholar
Jantunen, Tommi. (2013). Signs and transitions: Do they differ phonetically and does it matter? Sign Language Studies, 13 (2), 211–237. Google Scholar logo with link to Google Scholar
. (2017). Constructed action, the clause and the nature of syntax in Finnish Sign Language. Open Linguistics, 31, 65–85. Google Scholar logo with link to Google Scholar
. (2018). Viittomakielet hybridisysteemeinä: hämärärajaisuus ja epäkonventionaalisuus osana viittomakielten rakennetta [Sign languages as hybrid systems: Gradience and unconventionality as a part of the structure of sign languages]. Puhe ja kieli, 38 (3), 109–126. Google Scholar logo with link to Google Scholar
Jantunen, Tommi, Burger, Birgitta, & Puupponen, Anna. (2018). Constructed action types and eye behavior in Finnish Sign Language. Paper presented at the 8th Conference of the International Society for Gesture Studies (ISGS 8). Cape Town, South Africa, July 4–8, 2018.
Jantunen, Tommi, Puupponen, Anna, & Burger, Birgitta. (2020). What comes first: Combining motion capture and eye tracking data to study the order of articulators in constructed action in sign language narratives. In Proceedings of the 12th International Conference on Language Resources and Evaluation (LREC 2020) (pp. 6003–6007). Paris: ELRA.Google Scholar logo with link to Google Scholar
Kendon, Adam. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press. Google Scholar logo with link to Google Scholar
Lillo-Martin, Dianne. (2012). Utterance reports and constructed action. In Roland Pfau, Markus Steinbach, & Bencie Woll (Eds.), Sign language: An international handbook (pp. 365–387). Berlin: De Gruyter Mouton. Google Scholar logo with link to Google Scholar
Puupponen, Anna. (2018). The relationship between the movements and positions of the head and the torso in Finnish Sign Language. Sign Language Studies, 18 (2), 175–214. Google Scholar logo with link to Google Scholar
. (2019). Towards understanding nonmanuality: A semiotic treatment of signers’ head movements. Glossa: A Journal of General Linguistics, 4 (1), 39. Google Scholar logo with link to Google Scholar
Salonen, Juhana, Wainio, Tuija, Kronqvist, Antti, & Keränen, Jarkko. (2018). Suomen viittomakielten korpusprojektin (CFINSL) annotointiohjeet. 11. versio. Kielija viestintätieteiden laitos, Jyväskylän yliopisto.Google Scholar logo with link to Google Scholar
Tyrone, Martha & Mauk, Claude. (2010). Sign lowering and phonetic reduction in American Sign Language. Journal of Phonetics, 381, 317–328. Google Scholar logo with link to Google Scholar
Cited by (14)

Cited by 14 other publications

Hernández, Doris, Anna Puupponen, Jarkko Keränen, Sébastien Vandenitte, Benjamin Anible, Gerardo Ortega & Tommi Jantunen
2025. Neuroelectrical and behavioral correlates of constructed action recognition in Finnish Sign language. Neuroscience 575 ► pp. 140 ff. DOI logo
Kanto, Laura, Anna Puupponen & Doris Hernández
2025. The use of constructed action and its relationship with age and sign language development among children acquiring Finnish Sign Language. Sign Language & Linguistics DOI logo
Puupponen, Anna, Gabrielle Hodge, Benjamin Anible, Juhana Salonen, Tuija Wainio, Jarkko Keränen, Doris Hernández & Tommi Jantunen
2025. Opening up Corpus FinSL: enriching corpus analysis with linguistic ethnography in a study of constructed action. Linguistics 63:1 ► pp. 277 ff. DOI logo
Hernández, Doris, Anna Puupponen, Jarkko Keränen, Gerardo Ortega & Tommi Jantunen
2024. Between bodily action and conventionalized structure: The neural mechanisms of constructed action in sign language comprehension. Brain and Language 252 ► pp. 105413 ff. DOI logo
Stamp, Rose, David Cohn, Hagit Hel-Or & Wendy Sandler
2024. Kinect-ing the Dots: Using Motion-Capture Technology to Distinguish Sign Language Linguistic From Gestural Expressions. Language and Speech 67:1 ► pp. 255 ff. DOI logo
Sun, Zhenyi & Yunlong Cui
2024. Exploring the Path of Innovative College Dance Teaching Models with Motion Capture Technology. Applied Mathematics and Nonlinear Sciences 9:1 DOI logo
Mesch, Johanna
2023. Creating a multifaceted corpus of Swedish Sign Language. In Advances in Sign Language Corpus Linguistics [Studies in Corpus Linguistics, 108], ► pp. 242 ff. DOI logo
Napoli, Donna Jo & Rachel Sutton-Spence
2023. The nature of torso articulation in human expression: signing and dancing. Journal of Cultural Cognitive Science 7:3 ► pp. 269 ff. DOI logo
Napoli, Donna Jo & Rachel Sutton-Spence
2024. Torso articulation in sign languages. Sign Language & Linguistics 27:1 ► pp. 1 ff. DOI logo
Martinod, Emmanuella
2022. Role-taking in two micro-community sign languages: Phylogenetic insights. Frontiers in Communication 7 DOI logo
Puupponen, Anna, Laura Kanto, Tuija Wainio & Tommi Jantunen
2022. Variation in the use of constructed action according to discourse type and age in Finnish Sign Language. Language & Communication 83 ► pp. 16 ff. DOI logo
Quinto-Pozos, David, Fey Parrill & Caitie Coons
2022. The interface between grammar and bodily enactment in ASL and English. Languages in Contrast 22:2 ► pp. 195 ff. DOI logo
Vandenitte, Sébastien
2022. Making Referents Seen and Heard Across Signed and Spoken Languages: Documenting and Interpreting Cross-Modal Differences in the Use of Enactment. Frontiers in Psychology 13 DOI logo
Vandenitte, Sébastien
2023. When referents are seen and heard. In Reference [Studies in Language Companion Series, 228], ► pp. 127 ff. DOI logo

This list is based on CrossRef data as of 9 december 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue