Summary

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published: June 30, 2020
doi:

Summary

Presented here is a protocol introducing a set of child-friendly statistical learning tasks geared towards examining children’s learning of temporal statistical patterns across domains and sensory modalities. The developed tasks collect behavioral data using the web-based platform and task-based functional magnetic resonance imaging (fMRI) data for examining neural engagement during statistical learning.

Abstract

Statistical learning, a fundamental skill to extract regularities in the environment, is often considered a core supporting mechanism of the first language development. While many studies of statistical learning are conducted within a single domain or modality, recent evidence suggests that this skill may differ based on the context in which the stimuli are presented. In addition, few studies investigate learning as it unfolds in real-time, rather focusing on the outcome of learning. In this protocol, we describe an approach for identifying the cognitive and neural basis of statistical learning, within an individual, across domains (linguistic vs. non-linguistic) and sensory modalities (visual and auditory). The tasks are designed to cast as little cognitive demand as possible on participants, making it ideal for young school-aged children and special populations. The web-based nature of the behavioral tasks offers a unique opportunity for us to reach more representative populations nationwide, to estimate effect sizes with greater precision, and to contribute to open and reproducible research. The neural measures provided by the functional magnetic resonance imaging (fMRI) task can inform researchers about the neural mechanisms engaged during statistical learning, and how these may differ across individuals on the basis of domain or modality. Finally, both tasks allow for the measurement of real-time learning, as changes in reaction time to a target stimulus is tracked across the exposure period. The main limitation of using this protocol relates to the hour-long duration of the experiment. Children might need to complete all four statistical learning tasks in multiple sittings. Therefore, the web-based platform is designed with this limitation in mind so that tasks may be disseminated individually. This methodology will allow users to investigate how the process of statistical learning unfolds across and within domains and modalities in children from different developmental backgrounds.

Introduction

Statistical learning is an elementary skill supporting the acquisition of rule-governed combinations in language inputs1. Successful statistical learning ability in infants predicts later language learning success2,3. Variability in statistical learning skills in school-aged children has also been associated with vocabulary4 and reading5,6. Difficulty in statistical learning has been proposed as one etiological mechanism underlying language impairment7. Despite the association between statistical learning and language outcomes in both neurotypical and atypical populations, the cognitive and the neural mechanisms underlying statistical learning remain poorly understood. In addition, previous literature has revealed that, within an individual, statistical learning ability is not uniform but independent across domains and modalities6,8,9. The developmental trajectory of statistical learning abilities may further vary across domains and modalities10. These findings emphasize the importance of assessing individual differences in statistical learning across multiple tasks throughout the course of development. However, the field first requires a more systematic investigation of the relationship between statistical learning and first language development. To address these questions, we apply innovative methods including a web-based testing platform11 that reaches a large number of children, and laboratory-based neuroimaging techniques (functional magnetic resonance imaging, or fMRI) that examine the real-time encoding of statistical information.

Standard measures of statistical learning begin with a familiarization phase and are followed by a two-alternative forced choice (2-AFC) task12,13. The familiarization phase introduces a continuous stream of stimuli embedded with statistical regularities, where some stimuli are more likely to co-occur than others. The presentation of these co-occurring stimuli follows a fixed temporal order. Participants are passively exposed to the stream during the familiarization phase, followed by a 2-AFC task that tests whether the participant successfully extracted the patterns. The 2-AFC accuracy task presents two consecutive sequences: one sequence has been presented to the participant during the familiarization phase, while the other is a novel sequence, or contains part of the sequence. Above-chance accuracy on the 2-AFC would indicate successful learning at the group level. Traditional behavioral tasks assessing statistical learning generally rely upon accuracy as the outcome measure of learning. However, accuracy fails to account for the natural learning of information as it unfolds in time. A measure of real-time learning is necessary to tap into the implicit learning process of statistical learning during which children are still encoding the regularities from the inputs14,15,16. Various adaptations across paradigms have been developed in an effort to move away from the 2-AFC measure, towards measures of on-line learning through behavioral responses during the exposure16. Studies utilizing these adaptations which measure reaction time during the exposure phase found they were related to post-learning accuracy17 with better test-retest reliability compared to that of the accuracy in adult learners18.

Neural measures are also foundational to our understanding of how learning unfolds over time, as the implicit process by which language learning occurs likely recruits different neural resources from those used once language is learned19. Neural measures also provide insights into differences in cognitive specializations underlying language ability across special populations20. How the condition contrast is designed in an fMRI study is crucial for how we interpret patterns of neural activation during learning. One common practice is to compare brain responses during the familiarization phase between sequences containing regular patterns versus those containing the same stimuli which are ordered randomly. However, previous research implementing such a random control condition found no evidence for learning in behavior, despite neural differences between structured and random sequences. This might be due to the interference of random sequences on learning of structured sequences, as both were constructed from the same stimuli21,22. Other fMRI studies which utilized backward speech or earlier learning blocks as the control condition confirmed learning took place behaviorally19,23. However, each of these paradigms introduced its own confounding factor, such as the effect of language processing for the former case and the effect of the experimental order for the latter case. Our paradigm uses the random sequence as the control condition but mitigates their interference on participants’ learning of the structured sequences. Our fMRI paradigm also implements a mixed block/event-related design, which allows for the simultaneous modeling of transient trial-related and sustained task-related BOLD signals24. Lastly, and more broadly, neural measures allow for the measurement of learning in populations where eliciting an explicit behavioral response may be difficult (e.g., developmental and special populations)25.

The current protocol adopts a response time measure, in addition to traditional accuracy measures, and examines brain activation during the familiarization phase. The combination of these methods aims to provide a rich dataset for the investigation of real-time learning processes. The web-based platform offers a set of learning measures by including both response time during the exposure phase and accuracy of the 2-AFC task during the test phase. The neuroimaging protocol allows for the investigation of the underlying neural mechanisms supporting statistical learning across domains and modalities. While it is optimal to measure statistical learning within an individual using both the web-based and fMRI protocols, the tasks are designed so that they may be disseminated independently, and therefore, as two independent measures of statistical learning. The fMRI experiments included in the current protocol can help clarify how stimulus encoding, pattern extraction, and other constituent components of statistical learning are represented by particular brain regions and networks.

Protocol

All participants gave written consent to participate and study was conducted in accordance with the Institutional Review Board. 1. Overview of the statistical learning paradigm utilized in the web-based protocol Include four tasks in the current paradigm: image (visual-nonlinguistic), letter (visual-linguistic), tone (auditory-nonlinguistic), and syllable (auditory-linguistic). Construct stimuli for visual tasks using 12 standalone alien cartoon images (image) and 12 le…

Representative Results

Web-based Behavioral Results Given the current protocol is designed for easy dissemination with developmental populations, we have included preliminary web-based results based on data from 22 developing school-aged children (Mean (M) age = 9.3 years, Standard Deviation (SD) age = 2.04 years, range = 6.2-12.6 years, 13 girls). In the web-based statistical learning task, children performed significantly better than 0.5 chance-level on all conditions, indicating successful statistical learning at the …

Discussion

The methods presented in the current protocol provide a multimodal paradigm for understanding the behavioral and neural indices of statistical learning across the course of development. The current design allows for the identification of individual differences in statistical learning ability across modalities and domains, which can be used for future investigation of the relationship between statistical learning and language development. Since an individuals’ statistical learning ability is found to vary across dom…

Disclosures

The authors have nothing to disclose.

Acknowledgements

We thank Yoel Sanchez Araujo and Wendy Georgan for their contribution in the initial design of the web-based platform. We thank An Nguyen and Violet Kozloff for their work on improving the web-based statistical learning tasks, implementing the fMRI tasks, and piloting the tasks in adult participants. We thank Violet Kozloff and Parker Robbins for their contribution in assisting data collection in children. We thank Ibrahim Malik, John Christopher, Trevor Wigal, and Keith Schneider at the Center for Biological and Brain Imaging at the University of Delaware for their assistance in neuroimaging data collection. This work is funded in part by the National Institute on Deafness and other Communication Disorders (PI: Qi; NIH 1R21DC017576) and the National Science Foundation Directorate for Social, Behavioral & Economic Sciences (PI: Schneider, Co-PI: Qi & Golinkoff; NSF 1911462).

Materials

4 Button Inline Response Device Cambridge Research Systems SKU: N1348 An fMRI reponse pad used for measuring in-scanner response time
Short/Slim Canal Tips Comply Foam SKU: 40-15028-11 Short & slim in-ear canal tips are recommended for children to protect hearing and allow for them to hear the stimuli while in the scanner.
jsPsych jsPsych https://www.jspsych.org/ jsPsych is a JavaScript library for running behavioral experiments in a web browser.
Speech Synthesizer Praat Version 6.1.14 This program is an artificial speech synthesizer which was used to create the syllable stimuli.
Web-based statistical learning tasks Zenodo http://doi.org/10.5281/zenodo.3820620 (2020). All web-based statistical learning tasks are available for free access on Zenodo.

References

  1. Saffran, J. R., Newport, L. L., Aslin, R. N. Word Segmentation: The Role of Distributional Cues. Journal of Memory and Language. 35, 606-621 (1996).
  2. Newman, R., Ratner, N. B., Jusczyk, A. M., Jusczyk, P. W., Dow, K. A. Infants’ early ability to segment the conversational speech signal predicts later language development: A retrospective analysis. Developmental Psychology. 42 (4), 643-655 (2006).
  3. Graf Estes, K., Gluck, S. C. W., Grimm, K. J. Finding patterns and learning words: Infant phonotactic knowledge is associated with vocabulary size. Journal of Experimental Child Psychology. 146, 34-49 (2016).
  4. Evans, J. L., Saffran, J. R., Robe-Torres, K. Statistical Learning in Children With Specific Language Impairment. Journal of Speech, Language, and Hearing Research. 52 (2), 321-335 (2009).
  5. Arciuli, J., Simpson, I. C. Statistical Learning Is Related to Reading Ability in Children and Adults. Cognitive Science. 36 (2), 286-304 (2012).
  6. Qi, Z., Sanchez Araujo, Y., Georgan, W. C., Gabrieli, J. D. E., Arciuli, J. Hearing Matters More Than Seeing: A Cross-Modality Study of Statistical Learning and Reading Ability. Scientific Studies of Reading. 23 (1), 101-115 (2019).
  7. Walenski, M., Tager-Flusberg, H. B., Ullman, M. T., Moldin, S. O., Rubenstein, J. L. R. Language in autism. Understanding autism: From Basic Neuroscience to Treatment. , 175-203 (2006).
  8. Siegelman, N., Frost, R. Statistical learning as an individual ability: Theoretical perspectives and empirical evidence. Journal of Memory and Language. 81, 105-120 (2015).
  9. Erickson, L. C., Kaschak, M. P., Thiessen, E. D., Berry, C. A. S. Individual Differences in Statistical Learning: Conceptual and Measurement Issues. Collabra. 2 (1), 14 (2016).
  10. Shufaniya, A., Arnon, I. Statistical Learning Is Not Age-Invariant During Childhood: Performance Improves With Age Across Modality. Cognitive Science. 42 (8), 3100-3115 (2018).
  11. Qi, Z., et al. An online platform for visual and auditory statistical learning for school-aged children (Version 1.0.0). Zenodo. , (2020).
  12. Conway, C. M., Christiansen, M. H. Statistical learning within and between modalities: Pitting abstract against stimulus-specific representations. Psychological Science. 17 (10), 905-912 (2006).
  13. Saffran, J. R., Johnson, E. K., Aslin, R. N., Newport, E. L. Statistical learning of tone sequences by human infants and adults. Cognition. 70 (1), 27-52 (1999).
  14. Siegelman, N., Bogaerts, L., Elazar, A., Arciuli, J., Frost, R. Linguistic entrenchment: Prior knowledge impacts statistical learning performance. Cognition. 177, 198-213 (2018).
  15. Armstrong, B. C., Frost, R., Christiansen, M. H. The long road of statistical learning research: past, present and future. Philosophical Transactions of the Royal Society B: Biological Sciences. 372 (1711), 20160047 (2017).
  16. Siegelman, N., Bogaerts, L., Christiansen, M. H., Frost, R. Towards a theory of individual differences in statistical learning. Transactions of the Royal Society B. 372 (1711), 20160059 (2017).
  17. Krogh, L., Vlach, H. A., Johnson, S. P. Statistical Learning Across Development: Flexible Yet Constrained. Frontiers in Psychology. 3, 598 (2013).
  18. Siegelman, N., Bogaerts, L., Elazar, A., Arciuli, J., Frost, R. Linguistic entrenchment: Prior knowledge impacts statistical learning performance. Cognition. 177, 198-213 (2018).
  19. Plante, E., Patterson, D., Dailey, N. S., Kyle, R. A., Fridriksson, J. Dynamic changes in network activations characterize early learning of a natural language. Neuropsychologia. 62 (1), 77-86 (2014).
  20. Milne, A. E., Wilson, B., Christiansen, M. H., Petkov, C., Marslen-Wilson, W. Structured sequence learning across sensory modalities in humans and nonhuman primates This review comes from a themed issue on The evolution of language. Current Opinion in Behavioral Sciences. 21, 39-48 (2018).
  21. Mcnealy, K., Mazziotta, J., Dapretto, M. Cracking the Language Code: Neural Mechanisms Underlying Speech Parsing. Journal of Neuroscience. 26 (29), 7629-7639 (2006).
  22. McNealy, K., Mazziotta, J. C., Dapretto, M. Age and experience shape developmental changes in the neural basis of language-related learning. Developmental Science. 14 (6), 1261-1282 (2011).
  23. Karuza, E. A., Emberson, L. L., Aslin, R. N. Combining fMRI and behavioral measures to examine the process of human learning. Neurobiology of Learning and Memory. 109, 193-206 (2014).
  24. Petersen, S. E., Dubis, J. W. The mixed block/event-related design. NeuroImage. 62 (2), 1177-1184 (2012).
  25. Batterink, L. J., Paller, K. A., Reber, P. J. Understanding the Neural Bases of Implicit and Statistical Learning. Topics in Cognitive Science. 11, 482-503 (2019).
  26. Boersma, P., Weenink, D. . Praat: doing phonetics by computer [Computer program]. Version 601014. , (2020).
  27. Boersma, P. Praat, a system for doing phonetics by computer. Glot International. 5 (9), 341-345 (2001).
  28. Conway, C. M., Christiansen, M. H. Seeing and hearing in space and time: Effects of modality and presentation rate on implicit statistical learning. European Journal of Cognitive Psychology. 21 (4), 561-580 (2009).
  29. Emberson, L. L., Conway, C. M., Christiansen, M. H. Timing is everything: Changes in presentation rate have opposite effects on auditory and visual implicit statistical learning. Quarterly Journal of Experimental Psychology. 64 (5), 1021-1040 (2011).
  30. de Leeuw, J. R. jsPsych: A JavaScript library for creating behavioral experiments in a Web browser. Behavior Research Methods. 47 (1), 1-12 (2015).
  31. Kana, R. K., et al. Probing the brain in autism using fMRI and diffusion tensor imaging. Journal of Visualized Experiments. (55), e3178 (2011).
  32. Casey, B. J., et al. The Adolescent Brain Cognitive Development (ABCD) study: Imaging acquisition across 21 sites. Developmental Cognitive Neuroscience. 32, 43-54 (2018).
  33. Gorgolewski, K. J., et al. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Scientific Data. 3 (1), 1-9 (2016).
  34. Halchenko, Y. . nipy/heudiconv v0.6.0 (Version v0.6.0). Zenodo. , (2019).
  35. Esteban, O., et al. FMRIPrep: a robust preprocessing pipeline for functional MRI. Nature Methods. 16, 111-116 (2019).
  36. Esteban, O., et al. Analysis of task-based functional MRI data preprocessed with fMRIPrep. bioRxiv. , 694364 (2020).
  37. Cox, R. W. AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research. 29 (3), 162-173 (1996).
  38. Avants, B. B., et al. A reproducible evaluation of ANTs similarity metric performance in brain image registration. NeuroImage. 54 (3), 2033-2044 (2011).
  39. Dale, A. M., Fischl, B., Sereno, M. I. Cortical surface-based analysis: I. Segmentation and surface reconstruction. NeuroImage. 9 (2), 179-194 (1999).
  40. Woolrich, M. W., et al. Bayesian analysis of neuroimaging data in FSL. NeuroImage. 45, 173-186 (2009).
  41. Klein, A., et al. Mindboggling morphometry of human brains. PLoS Computational Biology. 13 (2), 1005350 (2017).
  42. Arnon, I. Do current statistical learning tasks capture stable individual differences in children? An investigation of task reliability across modality. Behavior Research Methods. 52 (1), 68-81 (2020).
  43. Finn, A. S., Hudson Kam, C. L. The curse of knowledge: First language knowledge impairs adult learners’ use of novel statistics for word segmentation. Cognition. 108 (2), 477-499 (2008).
  44. Krogh, L., Vlach, H. A., Johnson, S. P. Statistical learning across development: Flexible yet constrained. Frontiers in Psychology. 3, 598 (2013).
  45. De Leeuw, J. R., Motz, B. A. Psychophysics in a Web browser? Comparing response times collected with JavaScript and Psychophysics Toolbox in a visual search task. Behavior Research Methods. 48, 1-12 (2016).
  46. Lew-Williams, C., Saffran, J. R. All words are not created equal: Expectations about word length guide infant statistical learning. Cognition. 122 (2), 241-246 (2012).
  47. Poulin-Charronnat, B., Perruchet, P., Tillmann, B., Peereman, R. Familiar units prevail over statistical cues in word segmentation. Psychological Research. 81 (5), 990-1003 (2017).
  48. Leonard, J., Flournoy, J., Lewis-de los Angeles, C. P., Whitaker, K. How much motion is too much motion? Determining motion thresholds by sample size for reproducibility in developmental resting-state MRI. Research Ideas and Outcomes. 3, 12569 (2017).
  49. Power, J. D., et al. Ridding fMRI data of motion-related influences: Removal of signals with distinct spatial and physical bases in multiecho data. Proceedings of the National Academy of Sciences of the United States of America. 115 (9), 2105-2114 (2018).

Play Video

Cite This Article
Schneider, J. M., Hu, A., Legault, J., Qi, Z. Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques. J. Vis. Exp. (160), e61474, doi:10.3791/61474 (2020).

View Video