Cover not available

Article published In: The Mental Lexicon
Vol. 16:2/3 (2021) ► pp.271–324

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload PDF
authorization required

Verbal reaction times based on tracking lip movement

 | University of California, Santa CruzSanta Cruz | Volkswagen Group of America, Innovation and Engineering Center California
 | University of California, Santa CruzSanta Cruz
 | University of California, Santa CruzSanta Cruz
 | University of California, Santa CruzSanta Cruz | California State University, Channel Islands
Published online: 8 March 2022
DOI logo with link
https://doi.org/10.1075/ml.19018.liu
Abstract
Valid and reliable measurements of response latency are crucial in testing empirical predictions across fields of psychology. In research utilizing verbal responses, acoustic latency is the typical measure of response latency, but its validity has been questioned. We describe a simple and affordable alternative – articulatory latency based on tracking lip position. Using this method, we measured the acoustic and articulatory latencies of syllables beginning with various simple and complex onsets and ending with “uh” using the speeded naming task, where participants were instructed to have their mouths either closed or open before articulating. The initial oral configuration, place of articulation, and voicing all had significant effects on this measure of articulatory latency across segments, factors that researchers must consider in designing experiments and selecting stimuli.
Article outline
  • Response time vs. reaction time
  • Possible measures of reaction time
  • Lip separations in the formation of the oral constriction
  • Instrument resolution, power, and the test of ESD
  • Specific goals
  • Method
    • Participants
    • Stimuli
    • Apparatus
    • Procedure
  • Data preparation and analyses
  • Results
    • Stage 1: Error analysis
    • Stage 2: Overview of the current mixed model approach
      • Random effect structures
      • Parallel to previous research
    • Stage 3: F-test of the equality of standard deviations
    • Stage 4: Overall analysis
      • I.Manner and place of articulation
        • a.Manner of Articulation
        • b.Place of Articulation
      • II.Onset complexity
        • a.Manner of Articulation & Onset complexity
        • b.Place of Articulation & Onset complexity
      • III.Simple onsets
        • a.Manner of Articulation & Voicing
        • b.Place of Articulation & Voicing
    • Stage 5. Most sensitive measures
      • I.Overall analysis
      • II.Onset complexity
        • a.Manner of Articulation & Onset complexity
        • b.Place of Articulation & Onset complexity
      • III.Simple onsets
        • a.Manner & Voicing
        • b.Place & Voicing
  • Discussion
    • Demonstrations of effective acuity
    • The effect of initial mouth position
    • Manner effect dissociation
    • Voicing
    • Onset complexity
  • Conclusion
  • Notes
  • References
References (73)
References
Abercombie, D. (1967). Elements of general phonetics. Aldine Pub. Company.Google Scholar logo with link to Google Scholar
Andrews, S., Woollams, A., & Bond, R. (2005). Spelling–sound typicality only affects words with digraphs: Further qualifications to the generality of the regularity effect on word naming. Journal of Memory and Language, 53 1, 567–593. Google Scholar logo with link to Google Scholar
Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of memory and language, 59 (4), 390–412. Google Scholar logo with link to Google Scholar
Balota, D. A., & Abrams, R. A. (1995). Mental chronometry: beyond onset latencies in the lexical decision task. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21 1, 1289–1302.Google Scholar logo with link to Google Scholar
Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software, 671, 1–48. Google Scholar logo with link to Google Scholar
Bell-Berti, F., & Harris, K. S. (1981). A temporal model of speech production. Phonetica, 38 1, 9–20. Google Scholar logo with link to Google Scholar
Boersma, P., & Weenink, D. (1996). Praat, a system for doing phonetics by computer, version 3.4. Institute of Phonetic Sciences of the University of Amsterdam, Report, 132 1, 182.Google Scholar logo with link to Google Scholar
Boersma, P. (2001). Praat, a system for doing phonetics by computer. Glot International, 5 1, 341–345.Google Scholar logo with link to Google Scholar
Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J. S. S. (2009). Generalized linear mixed models: a practical guide for ecology and evolution. Trends in ecology & evolution, 24 (3), 127–135. Google Scholar logo with link to Google Scholar
Chao, Y.-R. (1936). Types of plosives in Chinese. Proc. 2nd Int. Cong. Phonetic Sciences. Cambridge: Cambridge University Press, 106–110.Google Scholar logo with link to Google Scholar
Cholin, J., Dell, G. S., & Levelt, W. J. M. (2011). Planning and articulation in incremental word production: Syllable-frequency effects in English. Journal of Experimental Psychology: Learning, Memory, and Cognition, 371, 109–122.Google Scholar logo with link to Google Scholar
Chomsky, N., & Halle, M. (1968). The Sound Pattern of English, New York: Harper & Row.Google Scholar logo with link to Google Scholar
Coltheart, M., Rastle, K., Perry, C., Landon, R., & Ziegler, J. (2001). DRC: A dual-route cascade model of visual word recognition and reading aloud. Psychological Review, 108 1, 204–256. Google Scholar logo with link to Google Scholar
Cox, D. R., & Snell, E. J. (1989). Analysis of binary data (Vol. 32). Monographs on Statistics and Applied Probability.Google Scholar logo with link to Google Scholar
Dale, R., Kehoe, C., & Spivey, M. J. (2007). Graded motor responses in the time course of categorizing atypical exemplars. Memory & Cognition, 35 (1), 15–28. Google Scholar logo with link to Google Scholar
Eisenhart, C. (1947). Effects of rounding on grouped data. Selected Techniques of Statistical Analysis (ed. C. Eisenhart, M. Hastay and W. A. Wallis), Chapter 4. New York.Google Scholar logo with link to Google Scholar
Ellis, A. J. (1874). On early English pronunciation, part IV, with especial reference to Shakespeare and Chaucer. London: Trübner & Co.Google Scholar logo with link to Google Scholar
Farnetani, E. (1999). Labial coarticulation. In W. J. Hardcastle & N. Hewlett (Eds.). Coarticulation. Cambridge: University Press, 31–65. Google Scholar logo with link to Google Scholar
Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society, A, 2221, 309–68.Google Scholar logo with link to Google Scholar
Fowler, C. A. (1980). Coarticulation and theories of extrinsic timing. Journal of Phonetics, 8 1, 113–133. Google Scholar logo with link to Google Scholar
Fromkin, V. (1964). Lip position in American English vowels. Language and Speech, 7 1, 215–225. Google Scholar logo with link to Google Scholar
Guisan, A., & Zimmermann, N. E. (2000). Predictive habitat distribution models in ecology. Ecological modelling, 135 1, 147–186. Google Scholar logo with link to Google Scholar
Holbrook, B. B., Kawamoto, A. H., & Liu, Q. (2019). Task demands and segment priming effects in the naming task. Journal of Experimental Psychology: Learning, Memory, and Cognition, 45 (5), 807–821. Google Scholar logo with link to Google Scholar
Jansen, P. A., & Watter, S. (2008). SayWhen: An automated method for high-accuracy speech onset detection. Behavior Research Methods, 40 1, 744–751. Google Scholar logo with link to Google Scholar
Johansson, T. (2011). Hail the impossible: p-values, evidence, and likelihood. Scandinavian Journal of Psychology 52 1, 113–125. Google Scholar logo with link to Google Scholar
Kawamoto, A. (1999). Incremental encoding and incremental articulation in speech production: Evidence based on response latency and initial segment duration. Behavioral and Brain Sciences, 22(1), 48–49. Google Scholar logo with link to Google Scholar
Kawamoto, A. H., Kello, C. T., Jones, R. M., & Bame, K. (1998). Initial phoneme versus whole word criterion to initiate pronunciation: Evidence based on response latency and initial phoneme duration. Journal of Experimental Psychology: Learning, Memory, & Cognition, 24 1, 862–885.Google Scholar logo with link to Google Scholar
Kawamoto, A. H., & Kello, C. T. (1999). Effect of onset cluster complexity in speeded naming: A test of rule-based approaches. Journal of Experimental Psychology: Human Perception and Performance, 25 (2), 361.Google Scholar logo with link to Google Scholar
Kawamoto, A. H., Liu, Q., Lee, R. J., & Grebe, P. R. (2014). The segment as the minimal planning unit in speech production: Evidence based on absolute response latencies. The Quarterly Journal of Experimental Psychology, 67 (12), 2340–2359. Google Scholar logo with link to Google Scholar
Kawamoto, A. H., Liu, Q., Mura, K., & Sanchez, A. (2008). Articulatory preparation in the delayed naming task. Journal of Memory and Language, 58 1, 347–365. Google Scholar logo with link to Google Scholar
Kello, C. T., & Kawamoto, A. H. (1998). Runword: An IBM-PC software package for the collection and acoustic analysis of speeded naming response. Behavior Research Methods, Instruments and Computers, 30 1, 371–383. Google Scholar logo with link to Google Scholar
Kelso, J. A. S., Tuller, B., & Harris, K. S. (1983). A “dynamic pattern” perspective on the control and coordination of movement. In P. F. MacNeilage (Ed.), The production of speech. New York: Springer. Google Scholar logo with link to Google Scholar
Kessler, B., Treiman, R., & Mullenix, J. (2002). Phonetic biases in voice key response time measurements. Journal of Memory and Language, 47 1, 145–171. Google Scholar logo with link to Google Scholar
Krause, P. A., & Kawamoto, A. H. (2019). Anticipatory mechanisms influence articulation in the form preparation task. Journal of Experimental Psychology: Human Perception and Performance. 451, 319–335.Google Scholar logo with link to Google Scholar
Ladefoged, P. & Maddieson, I. (1996). The Sounds of the World’s Languages. Cambridge: Blackwell Publishing.Google Scholar logo with link to Google Scholar
Laver, J. (1994). Principles of phonetics, Oxford University Press., Oxford, UK. Google Scholar logo with link to Google Scholar
(2003). Linguistic Phonetics. In M. Aronoff, & J. Rees-Miller (Ed.). The handbook of linguistics, 150–179. Oxford: Blackwell. Google Scholar logo with link to Google Scholar
Levelt, W. J. M., Roelofs, A., & Meyer, A. S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences, 22 1, 1–38. Google Scholar logo with link to Google Scholar
Liu, Q., Holbrook, B., Kawamoto, A. H., & Krause, P. (2021). Articulatory and acoustic latency data for: Verbal reaction times based on tracking lip movement. , Harvard Dataverse, V1 UNF:6:hFCN4bSdgCAQ0CSleAYAaQ== [fileUNF]Google Scholar logo with link to Google Scholar
Liu, Q., & Kawamoto, A. (2010). Simulating the elimination and enhancement of the plosivity effect in reading aloud. In Proceedings of the Annual Meeting of the Cognitive Science Society (Vol. 32, No. 32).Google Scholar logo with link to Google Scholar
Liu, Q., Kawamoto, A. H., Payne, K. K., & Dorsey, G. N. (2018). Anticipatory coarticulation and the minimal planning unit of speech. Journal of Experimental Psychology: Human Perception and Performance, 44 1, 139–153. Google Scholar logo with link to Google Scholar
McFadden, D. L. (1973). Conditional Logit Analysis of Qualitative Choice Behavior. In: P. Zarembka (Ed.). Frontiers in Econometrics, Wiley, New York.Google Scholar logo with link to Google Scholar
Mooshammer, C., Goldstein, L., Nam, H., McClure, S., Saltzman, E., & Tiede, M. (2012). Bridging planning and execution: Temporal planning of syllables. Journal of phonetics, 40 1, 374–389. Google Scholar logo with link to Google Scholar
Nagelkerke, N. J. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78 1, 691–692. Google Scholar logo with link to Google Scholar
Ohala, J. J. (1983). The origin of sound patterns in vocal tract constraints. In: P. F. MacNeilage (Ed.). The production of speech. New York: Springer-Verlag. 189–216. Google Scholar logo with link to Google Scholar
(1997, August). Aerodynamics of phonology. In Proceedings of the Seoul International Conference on Linguistics, 92–97.Google Scholar logo with link to Google Scholar
(2006). Speech aerodynamics. In Brown, Keith (Ed.), Encyclopedia of language & linguistics, 21, 684–689. Oxford: Elsevier. Google Scholar logo with link to Google Scholar
(2011, August). Accommodation to the Aerodynamic Voicing Constraint and its Phonological Relevance. In Proceedings of the International Congress of Phonetic Sciences, 64–67.Google Scholar logo with link to Google Scholar
Palo, P., Schaeffler, S., & Scobbie, J. M. (2015, August). Effect of phonetic onset on acoustic and articulatory speech reaction times studied with tongue ultrasound. In Proceedings of the 18th International Congress of Phonetic Sciences (ICPhS), Glasgow, 10–14 August 2015. International Phonetic Association.Google Scholar logo with link to Google Scholar
Palo, P. (2019). Measuring pre-speech articulation (Doctoral dissertation, Queen Margaret University, Edinburgh).
Passy, P. (1890). Étude sur les changements phonétiques Firmin-Didot. Firmin-Didot.Google Scholar logo with link to Google Scholar
Perry, C., Ziegler, J. C., & Zorzi, M. (2007). Nested incremental modeling in the development of computational theories: The CDP+ model of reading aloud. Psychological Review, 114 1, 273–315. Google Scholar logo with link to Google Scholar
Pickett, J. M. (1980). The sounds of speech communication. Baltimore: University Park Press.Google Scholar logo with link to Google Scholar
Pinheiro, J. C., & Bates, D. M. (2000). Linear mixed-effects models: basic concepts and examples. Mixed-effects models in S and S-Plus, 3–56. Google Scholar logo with link to Google Scholar
Plaut, D., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996). Understanding normal and impaired word reading: Computational principles in quasi-regular domains. Psychological Review, 103 1, 56–115. Google Scholar logo with link to Google Scholar
R Core Team (2016). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL [URL]
Rastle, K., Croot, K. P., Harrington, J. M., & Coltheart, M. (2005). Characterizing the motor execution stage of speech production: Consonantal effects on delayed naming latency and onset duration. Journal of Experimental Psychology: Human Perception & Performance, 31 1, 1083–1095.Google Scholar logo with link to Google Scholar
Rastle, K., & Davis, M. H. (2002). On the complexities of measuring naming. Journal of Experimental Psychology: Human Perception and Performance, 28 1, 307–314.Google Scholar logo with link to Google Scholar
Revelle, W. (2019). psych: Procedures for Personality and Psychological Research, Northwestern University, Evanston, Illinois, USA, [URL] Version = 1.9.12.
Saltzman, E. (1986). Task dynamic coordination of the speech articulators: A preliminary model. Experimental brain research series, 151, 129–144. Google Scholar logo with link to Google Scholar
Saltzman, E., & Kelso, J. A. (1987). Skilled actions: A task-dynamic approach. Psychological review, 941, 84–106. Google Scholar logo with link to Google Scholar
Saltzman, E. L., & Munhall, K. G. (1989). A dynamical approach to gestural patterning in speech production. Ecological psychology, 11, 333–382. Google Scholar logo with link to Google Scholar
Schaeffler, S., Scobbie, J. M., & Schaeffler, F. (2014, May). Measuring reaction times: vocalisation vs. articulation. In Proceedings of the 10th International Seminar in Speech Production (ISSP 10). [make sure we cite this for no advantage between lip and tongue]Google Scholar logo with link to Google Scholar
Schmidt, R. A. (1988). Motor control and learning: A behavioral emphasis (2nd ed.). Champaign, IL, England: Human Kinetics Publishers.Google Scholar logo with link to Google Scholar
Spieler, D. H. & Balota, D. A. (1997). Bringing computational models of word naming down to the item level. Psychological Science, 8 1, 411–416. Google Scholar logo with link to Google Scholar
Sternberg, S., Monsell, S., Knoll, R. L., & Wright, C. E. (1978). The latency and duration of rapid movement sequences: Comparisons of speech and typewriting, in G. E. Stelmach (Ed.), Information Processing in Motor Control and Learning. New York: Academic Press. Google Scholar logo with link to Google Scholar
Stevens, K. N. (1998). Acoustic Phonetics. Cambridge: MIT.Google Scholar logo with link to Google Scholar
(2002). Toward a model for lexical access based on acoustic landmarks and distinctive features. Journal of the Acoustical Society of America, 111 1, 1872–1891. Google Scholar logo with link to Google Scholar
Sweet, H. (1877). A handbook of phonetics (Vol. 2). Clarendon Press.Google Scholar logo with link to Google Scholar
Tilsen, S., Spincemaille, P., Xu, B., Doerschuk, P., Luh, W. M., Feldman, E., & Wang, Y. (2016). Anticipatory posturing of the vocal tract reveals dissociation of speech movement plans from linguistic units. PLoS ONE, 11 (1), e0146813. Google Scholar logo with link to Google Scholar
Tricker, A. R. (1984). Effects of rounding on the moments of a probability distribution. Journal of the Royal Statistical Society: Series D (The Statistician), 33 (4), 381–390.Google Scholar logo with link to Google Scholar
Tyler, M. D., Tyler, L., & Burnham, D. K. (2005). The delayed trigger voice key: An improved analogue voice key for psycholinguistic research. Behavior Research Methods, 37 1, 139–147. Google Scholar logo with link to Google Scholar
van der Linden, L., Riès, S. K., Legou, T., Burle, B., Malfait, N., & Alario, F. (2014). A comparison of two procedures for verbal response time fractionation. Frontiers in psychology, 5 1, 1213. Google Scholar logo with link to Google Scholar
Cited by (1)

Cited by one other publication

Krause, Peter A., Ryan James Pili & Erik Hunt
2024. A Process for Measuring Lip Kinematics Using Participants’ Webcams during Linguistic Experiments Conducted Online. Laboratory Phonology 15:1 DOI logo

This list is based on CrossRef data as of 27 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.

Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue