Cover not available

In:Handbook of Pragmatics: Manual
Edited by Jef Verschueren and Jan-Ola Östman
[Handbook of Pragmatics M2] 2022
► pp. 1578–1617

Get fulltext from our e-platform
JBE logo with link
PDF logo with download linkDownload Book PDF
EPUB logo with download linkDownload Book EPUB
authorization required

Experimentation

Published online: 3 October 2022
DOI logo with link
https://doi.org/10.1075/hop.m2.exp1
Article outline
  • 1.Theoretical approaches to science
  • 2.Empirical approaches to science
  • 3.Experimentation
    • 3.1Issues in experimental design
      • 3.1.1Operationalization of the experimental hypothesis
      • 3.1.2Independent and dependent variables
      • 3.1.3Choosing the dependent variable: how to best tap into the targeted process
      • 3.1.4The orthogonal experimental design
      • 3.1.5The concept of matching and the necessity of a control condition
      • 3.1.6Manipulations within or between participants (or items)
      • 3.1.7The counterbalancing technique
    • 3.2The rationale behind statistical significance testing
      • 3.2.1Basic assumption: the observed difference is due to chance
      • 3.2.2Calling a result statistically significant is taking a calculated risk
      • 3.2.3Main effects and interaction effects
    • 3.3Statistical tests
      • 3.3.1Types of measurement scales
      • 3.3.2Non-parametric statistics
        • 3.3.2.1The chi-square test
        • 3.3.2.2The Wilcoxon and Mann-Whitney test
      • 3.3.3Parametric statistics
        • 3.3.3.1Some general remarks
        • 3.3.3.2The student’s t-test
          • General aspects
          • Paired versus independent observations
          • One-tailed versus two-tailed t-tests
        • 3.3.3.3Analysis of Variance (ANOVA)
        • 3.3.3.4Measuring the associative strength between variables
          • Correlation analysis
          • Regression analysis
  • 4.Conclusion
  • References
References (32)
References
Baayen, R. H. (in press) Analyzing Linguistic Data. A Practical Introduction to Statistics Using R. Cambridge University Press.
Berkum, J. J. A. Van, D. Van Den Brink, C. M. J.Y Tesink, M. Kos & P. Hagoort. 2008. The neural integration of speaker and message. Journal of Cognitive Neuroscience 20: 580–591. Google Scholar logo with link to Google Scholar
Clifton Jr., C. & A. Staub. 2008. Parallelism and competition in syntactic ambiguity resolution. Language and Linguistics Compass 2: 234–250. Google Scholar logo with link to Google Scholar
Cohen, J. 1983. The cost of dichotomization. Applied Psychological Measurement 7: 249–254. Google Scholar logo with link to Google Scholar
Diependaele, K., D. Sandra & J. Grainger. 2005. Masked cross-modal morphological priming: Unravelling morpho-orthographic and morpho-semantic influences in early word recognition. Language and Cognitive Processes 20: 75–114. Google Scholar logo with link to Google Scholar
Ferreira, F. & J. M. Henderson. 1990. Use of Verb Information in Syntactic Parsing: Evidence From Eye Movements and Word-by-Word Self-Paced Reading. Journal of Experimental Psychology: Learning, Memory, and Cognition 16: 555–568. Google Scholar logo with link to Google Scholar
Fischer, M. H., W. S. Murray & R. L. Hill (eds) 2007. Eye movements: A window on mind and brain. Elsevier. Google Scholar logo with link to Google Scholar
Forster, K. I. & C. Davis. 1984. Repetition priming and frequency attenuation in lexical access. Journal of Experimental Psychology: Learning, Memory, and Cognition 10: 680–698. Google Scholar logo with link to Google Scholar
Forbach, G. B., R. F. Stanners & L. Hochaus. 1974. Repetition and practice effects in a lexical decision task. Memory and Cognition 2: 337–339. Google Scholar logo with link to Google Scholar
Fromkin Victoria A. Ed 1973. Speech errors as linguistic evidence. The Hague, Mouton. Google Scholar logo with link to Google Scholar
Garrett, M. F. 1975. The analysis of sentence production. In G. H. Bower (ed.), The Psychology of Learning and Motivation (Volume 9). New York: Academic Press. Google Scholar logo with link to Google Scholar
Grainger, J. & P. J. Holcomb. 2009. An ERP investigation of orthographic priming with relative-position and absolute-position primes. Brain Research 1270: 45–53. Google Scholar logo with link to Google Scholar
Hagoort, P. 2008. The fractionation of spoken language understanding by measuring electrical and magnetic brain signals. Philosophical Transactions of the Royal Society B-Biological Sciences 363: 1055–1070. Google Scholar logo with link to Google Scholar
Holcomb, P. J. & J. Grainger. 2009. ERP effects of short interval masked associative and repetition priming. Journal of Neurolinguistics 22: 301–312. Google Scholar logo with link to Google Scholar
Kirk, R. E. 1982. Experimental Design: Procedures for the Behavioral Sciences (2nd ed.). Brooks/Cole. Google Scholar logo with link to Google Scholar
Koornneef, A. W. & J. J. A. Van Berkum. 2006. On the use of verb-based implicit causality in sentence comprehension: Evidence from self-paced reading and eye tracking. Journal of Memory and Language 54: 445–465. Google Scholar logo with link to Google Scholar
Longtin, C. M., J. Segui & P. A. Hallé. 2003. Morphological priming without morphological relationship. Language and Cognitive Processes 18: 313–334. Google Scholar logo with link to Google Scholar
Mccall, R. B. 1970. Fundamental Statistics for Behavioral Sciences. (5th ed.) Harcourt Brace Jovanovich. Google Scholar logo with link to Google Scholar
Midgley, K. J., P. J. Holcomb & J. Grainger. 2009. Masked repetition and translation priming in second language learners: A window on the time-course of form and meaning activation using ERPs. Psychophysiology 46: 551–565. Google Scholar logo with link to Google Scholar
Pollatsek, A., B. J. Juhasz, E. D. Reichle, D. Machacek & K. Rayner. 2008. Immediate and delayed effects of word frequency and word length on eye movements during reading: A reversed delayed effect of word length. Journal of Experimental Psychology: Human Perception and Peformance 34: 726–750. Google Scholar logo with link to Google Scholar
Pollatsek, A., K. Rayner & E. Reichle (in press). The E-Z Reader model of silent reading. In K. Rayner, D. Shen, X. Bai & G. Yan (eds.), Cognitive and Cultural Influences on Eye Movements. Psychology Press.
Rayner, K., K. Chace, T. Slattery & J. Ashby. 2006. Eye movements as reflections of comprehension processes in reading. Scientific Studies of Reading 10: 241–255. Google Scholar logo with link to Google Scholar
Rayner, K. & A. Pollatsek (in press). Eye movements during reading. In B. Goldstein (Ed.), Sage Encyclopedia of Perception. Sage Press.
Rayner, K., A. Pollatsek, D. Drieghe, T. J. Slattery & E. D. Reichle. 2007. Tracking the mind during reading via eye movements: Comments on Kliegl, Nuthmann, and Engbert (2006). Journal of Experimental Psychology: General 136: 520–529. Google Scholar logo with link to Google Scholar
Scarborough, D. L., C. Cortese & H. S. Scarborough. 1977. Frequency and repetition effects in lexical memory. Journal of Experimental Psychology: Human Perception and Performance 3: 1–17. Google Scholar logo with link to Google Scholar
Schreuder R. & R. H. Baayen. 1997. How Complex Simplex Words Can Be. Journal of Memory and Language 37: 118–139. Google Scholar logo with link to Google Scholar
Siegel, S. 1956. Nonparametric Statistics for the Behavioral Sciences. McGraw-Hill. Google Scholar logo with link to Google Scholar
Staub, A. & K. Rayner. 2007. Eye movements and on-line comprehension processes. In G. Gaskell (ed.), The Oxford Handbook of Psycholinguistics: 327–342. Oxford University Press. Google Scholar logo with link to Google Scholar
Trueswell, J. C. 1996. The Role of Lexical Frequency in Syntactic Ambiguity Resolution. Journal of Memory and Language 35: 566–585. Google Scholar logo with link to Google Scholar
Van Berkum, J. J. A., D. Van Den Brink, C. M. J. Y. Tesink, M. Kos & P. Hagoort. 2008. The neural integration of speaker and message. Journal of Cognitive Neuroscience, 20(4): 580–591. Google Scholar logo with link to Google Scholar
Willems, R. M., A. Zyürek & P. Hagoort. 2008. Seeing and hearing meaning: event-related potential and functional magnetic resonance imaging evidence of word versus picture integration into a sentence context. Journal of Cognitive Neuroscience 20: 1235–1249. Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 prag Twitter_Logo_Blue