Science Education
>

An Experimental Paradigm for Measuring the Effects of Ageing on Sentence Processing

PRÉPARATION DE L'INSTRUCTEUR
concepts
PROTOCOLE ETUDIANT
Journal JoVE
Sciences du comportement
Un abonnement à JoVE est nécessaire pour voir ce contenu.  Connectez-vous ou commencez votre essai gratuit.
Journal JoVE Sciences du comportement
An Experimental Paradigm for Measuring the Effects of Ageing on Sentence Processing

The experiment was approved by the Ethics Committee of Beijing Foreign Studies University and it complied with the guideline for experiments with human subjects. All participants in the experiment provided written informed consent.

1. Stimuli Construction

  1. Construct experimental stimuli on the basis of the specific experimental questions. This protocol is intended to explore the effect of ageing on online sentence processing during reading, and as such, the visual stimuli used in the experiment are two types of RCs, namely SRCs and ORCs, which are the structures most frequently used in the studies of sentence processing by older adults.
  2. Prepare at least 24 experimental sentences with twelve sentences in each condition and at least 24 fillers that are of various length and structures. The number of fillers can be increased to up to three times of the experimental sentences. The experimental sentences should be counterbalanced across the two conditions.
    NOTE: As our study focused on the processing of Mandarin sentences, all the sentences used in the experiment were in Mandarin Chinese. However, the protocol reported here may be also applicable to other languages.
  3. Plausibility rating: Invite at least 30 participants to rate the semantic plausibility of the experimental sentences using a five-point Likert scale with scores from ''1'' (the least plausible) to ''5'' (the most plausible). Make sure the group is similar to the participants in age, gender ratio and education. Make sure they do not take part in the subsequent experiment. Ensure the sentences used in the study are all semantically plausible (>3) and semantic plausibility does not differ significantly between different experimental conditions.
    NOTE: In our study, 15 older adults and 15 younger adults were invited to participate in the plausibility rating (Mage = 43.6, SD = 24.1; Female 16, Male 14).
  4. For each word in the experimental sentences, provide an ungrammatical alternative. In this way, prepare a pair of words for each segment of the sentences, with one of them being the grammatical continuation of the sentence and the other is not. Match the two alternatives in lexical frequency. Participants are expected to choose between the grammatically correct word and the grammatically incorrect one (See Figure 1 for sample sentences in English). An experimental sentence used in this study is shown in Figure 2.
  5. Randomization and design. Randomize the sentences and the positions of the two alternatives in the sentences before presenting them to participants. Find the Selection tab of the Property Page in the stimulus presentation software (see Table of Materials) and set the selection method to Random.
    1. Divide the experiment into blocks with each lasting for no more than 10 min.
      NOTE: In the study, the experiment consisted of two blocks with 24 sentences in each block. Each block lasted for about 5 min.
    2. Allow participants to have a break between two blocks. Breaks for about 5 min can be helpful for younger adults. Allow longer breaks for older adults to ensure they can recover from fatigue.

Figure 2
Figure 2: Example of two experimental sentences. This figure shows that participants were presented two Chinese words in each frame and were required to choose the one which can grammatically continue the sentence. The words on the frame are Chinese characters with the English equivalents provided in parentheses. Please click here to view a larger version of this figure.

2. Participant Screening and Preparation for the Experiment

  1. Recruit participants who are native speakers of the language tested. Ensure participants have normal or corrected-to-normal vision. Invite at least 30 younger adults and 30 older adults. Match the two age groups in years of education and gender ratio.
  2. Ask participants whether they have had neurological, psychiatric or communication disorders before. Exclude the ones who report any history of these diseases.
  3. To ensure older participants recruited are cognitively healthy, have them complete the Global Deterioration Scale22 before the experiment as a way of screening. Exclude the participants who score above level two.
  4. Inform the participants that they should be free from exhaustion, hunger, illness or other conditions that make them uncomfortable on the day of the experiment.
  5. Invite the participants individually or in groups to the laboratory room.

3. Procedure

  1. Take participants to the laboratory room and instruct them to sit down at the computer workplaces.
  2. Ask the participants to read and sign the written informed consent forms. Exclude the participants who cannot provide informed consent for any reason.
  3. Provide verbal instructions to the participants to ensure they are clear about the requirements of the task. Ask participants to choose between the two words or phrases on the computer screen to form a grammatical continuation of the sentences. Inform them that their responses will be timed, so they are expected to respond as quickly and as accurately as possible.
  4. Provide the written instruction to the participants and ask them to read it carefully. Answer any questions participants may have about the instructions. Present the following message on paper or on computer screen in participants' native language:
    "In this experiment, you will read a number of Chinese sentences. However, the sentences will be presented one word at a time. On each screen, two words will be presented and you need to choose the word which can grammatically continue the sentence as quickly as possible. If you choose the word on your left hand side, please press the F button on the keyboard and if you choose the word on the right, please press J. Please respond as quickly as possible. If you fail to respond in ten seconds, the next trial begins. If you have no further questions, press any key to start practice."
  5. Ask the participants to complete a small number of practice questions to ensure they understand how to perform the task. Provide participants with feedbacks after they have made their choices regarding which of the two phrases is the grammatical continuation of the sentence. To minimize the disturbance to the natural reading process, only provide feedback when incorrect answers are detected. The feedbacks are short phrases ("incorrect") in the participants' native language, which are visually presented on the computer screen.
  6. When participants complete the practice questions, ask them to make a choice as to whether they would like to redo the practice. If they press the button p on the keyboard, the practice session starts all over again and if they press the space bar, the practice session is over and the experimental session begins. Allow them to redo the practice as many times as possible until they are familiar with the procedures of the task. Provide them assistance whenever they encounter any difficulties during the practice session.
  7. Allow the participants to perform the required experimental task when they are clear about the experimental procedures.
  8. Present the items on the computer screen as black letters on a white background.
  9. Have participants read the items and for each segment, choose between the two words placed side by side on the screen with a press of the button on the keyboard (F button for the word on the left and J button for the word on the right).
  10. If participants choose the correct answer, present the next pair of words. When they choose a wrong answer, have the sentence terminate and have the next one appear.
  11. Administer the digital span task from the Wechsler Memory Scale23 to assess participants' working memory span. Test participants individually.
  12. Ask participants to listen to a sequence of digits (1-9) that are presented auditorily at the rate of one digit per second.
  13. Ask participants to repeat the digit sequence in the same order.
  14. Start from short strings and increase the string length one digit at a time. Stop the test when participants make errors at two trials at a given length.
  15. Record participants' responses on the record form. Use a digital recording device to record participants' responses.
  16. Ask participants to complete the questionnaires about their background information, such as age, gender and years of education. Prepare participants' payment during the questionnaire.
  17. Provide participants monetary compensation for their participation.
    NOTE: In our experiment, each participant was paid 20 RMB (about USD$3) for their participation. The amount of payment may vary in different experiments. Other approaches can also be used to motivate participants such as rewards.

4. Data Analysis

  1. Obtain the RTs (ms) for each word in the sentences from the output files of the presentation software.
  2. Exclude the RTs for the trials that are responded incorrectly from data analysis. In order to reduce the influence of outliners on the results, exclude the RTs above three standard deviations from the means for each participant in each condition.
  3. Analyze the RTs for the regions of interest in the sentences, using repeated measures ANOVA with RTs as the dependent variable and age group (old, young), type of sentence (SRC, ORC) and region (1-6) as independent variables.

An Experimental Paradigm for Measuring the Effects of Ageing on Sentence Processing

Learning Objectives

This study is intended to examine the effect of ageing on online sentence processing using a maze task. The RTs for each segment in the sentences are used to indicate the processing difficulty. In this study, we explored how a group of older adults (Mage = 65.2, SD = 3.04, Range = 59 -74) and younger adults (Mage = 19.1, SD = 1.04, Range = 18-23) differentially processed Mandarin SRCs and ORCs. The two age groups were matched in education (Mold = 12.8, SD = 3.21; Myoung = 13.2, SD = 0.75; p = .620) and gender ratio (Old: 14 female; Young: 15 female; χ2 = .067, p = .796). Specifically, the study aimed to explore the overall differences between younger and older adults in processing Mandarin SRCs and ORCs as well as the exact locations of such differences. It was hypothesized that due to the decline in working memory, older adults are more sensitive than younger adults to the experimental manipulation of syntactic complexity and the processing costs associated with integrating words into the previous sentential segments. Therefore, a stronger effect of syntactic complexity or sentence type may be found in older adults than in younger adults at the regions which require more processing resources such as RC head nouns.

The regions of interest in the experimental sentences include the RC noun (zuojia 'writer'), the RC verb (aimu 'love'), the RC marker (de), the head noun (yanyuan 'actor') and main clause verb (xihuan 'like'). The mean RTs for each region are presented in Table 1 and graphically summarized in Figure 3.

Group Type Region 1 Region 2 Region 3 Region 4 Region 5 Region 6 Region 7
Mean SD Mean SD Mean SD Mean SD Mean SD Mean SD Mean SD
Old SRC 1589 1044 2768 1197 2119 961 1467 826 2038 1282 2035 1123 1986 982
ORC 1354 834 2322 941 2070 870 1436 694 1828 878 2078 1024 1937 938
Young SRC 789 434 1558 677 1020 437 659 223 812 341 848 331 928 428
ORC 765 519 1155 494 1071 388 713 245 816 333 972 464 972 465

Table 1: Mean reading times by group and region. The table presents the mean reading times and the standard deviations for each age group in each region.

Figure 3
Figure 3: Mean reading times (RTs) by group and region. The figure displays the average reading times for older adults and younger adults for each region in the sentence. The error bars represent the standard deviation of the data. Please click here to view a larger version of this figure.

Analysis was made to examine the effect of randomization order on the participants' performance and found that the effect of randomization was not significant. ANOVA was performed with group (old, young), type (SRC, ORC) and region (1-6) as predictors and RTs as the dependent variable. Group is the between-subjects variable. Type and region are the within-subjects variables. The results revealed a significant main effect of group (F1 (1, 58) = 171.25, p < 0.001, η2p = 0.71, F2 (1, 23) = 273.13, p < 0.001, η2p = 0.52), a significant main effect of type (F1 (1, 58) = 14.9, p < 0.001, η2p = 0.10, F2 (1, 23) = 12.78, p < 0.001, η2p = 0.03), a significant interaction between group and region (F1 (1, 58) = 100.15, p < .001, η2p = 0.64, F2 (1, 23) = 118.12, p < .001, η2p = 0.44), and a significant interaction between type and region (F1 (1, 58) =18.43, p < 0.001, η2p = 0.11, F2 (1, 23) = 28.43, p < 0.001, η2p = 0.02). The three-way interaction between group, type and region was significant (F1 (1, 58) = 5.13, p < 0.05, η2p = 0.05, F2 (1, 23) = 2.71, p < 0.05, η2p = 0.01).

To facilitate the interpretation of these results, we analyzed the data for each word using 2 (sentence type) x 2 (group) mixed ANOVAs by items and participants. In the SRC verb (aimu 'love')/ORC noun (zuojia 'writer'), there was a significant main effect of group (F1 (1, 58) = 122.93, p < 0.001, η2p = 0.10, F2 (1, 23) = 337.06, p < 0.001, η2p = 0.53), a significant main effect of RC type (F1 (1, 58) = 34.82, p < 0.001, η2p = 0.03, F2 (1, 23) = 49.98, p < 0.001, η2p = 0.07). Older adults had longer RTs than younger adults and the RTs for SRCs were longer than those for ORCs.

In the SRC noun (zuojia 'writer')/ORC verb (aimu 'love'), there was a significant main effect of group (F1 (1, 58) = 174.98, p < 0.001, η2p = 0.15, F2 (1, 23) = 377.25, p < 0.001, η2p = 0.43). The effect of sentence type was significant by items (F2 (1, 23) = 43.98, p < 0.01, η2p = 0.02). Older adults read this segment significantly more slowly than younger adults. No other significant interaction effect was found.

In the RC marker de, there was a significant main effect of group (F1 (1, 58) = 177.66, p < 0.001, η2p = 0.15, F2 (1, 23) = 489.25, p < 0.001, η2p = 0.45). Younger adults read the RC marker faster than older adults.

At the head nouns (yanyuan 'actor'), there was a main significant effect of group (F1 (1, 58) = 371.07, p < 0.001, η2p = 0.32, F2 (1, 23) = 53.21, p < 0.001, η2p = 0.04), a significant main effect of RC type (F1 (1, 58) = 13.28, p < 0.001, η2p = 0.02, F2 (1, 23) = 346.30, p < 0.001, η2p = 0.34), and a significant interaction effect between group and RC type (F1 (1, 58) = 5.14, p < 0.05, η2p = 0.01, F2 (1, 23) = 4.25, p < 0.05, η2p = 0.01). Pair-wise comparison shows that for older adults, the SRCs were more difficult to process than ORCs; for younger adults, however, there was no significant difference between SRCs and ORCs. This finding suggests that older adults were more sensitive to the experimental manipulation of sentence complexity or processing costs and they had greater difficulties than younger adults in processing syntactically more complex SRCs.

At the main verb (xihuan 'like'), a significant main effect of group was found (F1 (1, 58) = 174.99, p < 0.001, η2p = 0.15, F2 (1, 23) = 124.02, p < 0.001, η2p = 0.12). Younger adults performed faster than older adults.

To further explore whether the observed effect at head nouns was relevant to working memory, we performed a correlation analysis between working memory span and RT differences between SRCs and ORCs. The results revealed a significant negative relation (r = -0.41, p < 0.05), which suggests that participants with higher working memory span were less affected by syntactic complexity. As younger adults (M = 16.40, SD = 2.78) had larger working memory span than older adults (M = 12.17, SD = 2), they tended to be less affected by the manipulation of syntactic complexity.

List of Materials

Computers N/A N/A Used to present stimuli and record subjects' responses.
E-prime PST 2.0.8.22 Stimulus presentation software
The Digital Working Memory Span Test N/A N/A Used to assess subjects' working memory span. From Wechsler (1987).
The Global Deterioration Scale (GDS) N/A N/A Used to assess subjects' general cognitive status. From Reisberg, Ferris, de Leon and Crook (1988)

Lab Prep

Previous studies have found that older adults have greater difficulties in processing syntactically complex sentences than younger adults. However, the exact regions where the difficulties arise have not been fully identified. In this study, a maze task was implemented to investigate how older adults and younger adults differentially processed two types of sentences with different levels of syntactic complexity, namely subject relative clauses and object relative clauses. Participants were asked to choose between two alternatives at each segment of the sentences. The task required participants to engage in a strictly incremental mode of processing. The reading times for each segment were recorded, allowing the quantification of the difficulty of sentence reading. The task allowed us to identify the exact locations of the processing difficulty and thus facilitate a more accurate assessment of the age-related decline in sentence processing. The results indicate that the effect of ageing was found mainly at the head nouns, but not at other regions of the sentences, a finding which suggests that the maze task is an effective method to identify the exact location of the ageing effect on sentence processing. The implications of this experimental paradigm for investigating the effect of ageing on sentence processing are discussed.

Previous studies have found that older adults have greater difficulties in processing syntactically complex sentences than younger adults. However, the exact regions where the difficulties arise have not been fully identified. In this study, a maze task was implemented to investigate how older adults and younger adults differentially processed two types of sentences with different levels of syntactic complexity, namely subject relative clauses and object relative clauses. Participants were asked to choose between two alternatives at each segment of the sentences. The task required participants to engage in a strictly incremental mode of processing. The reading times for each segment were recorded, allowing the quantification of the difficulty of sentence reading. The task allowed us to identify the exact locations of the processing difficulty and thus facilitate a more accurate assessment of the age-related decline in sentence processing. The results indicate that the effect of ageing was found mainly at the head nouns, but not at other regions of the sentences, a finding which suggests that the maze task is an effective method to identify the exact location of the ageing effect on sentence processing. The implications of this experimental paradigm for investigating the effect of ageing on sentence processing are discussed.

Procédure

Previous studies have found that older adults have greater difficulties in processing syntactically complex sentences than younger adults. However, the exact regions where the difficulties arise have not been fully identified. In this study, a maze task was implemented to investigate how older adults and younger adults differentially processed two types of sentences with different levels of syntactic complexity, namely subject relative clauses and object relative clauses. Participants were asked to choose between two alternatives at each segment of the sentences. The task required participants to engage in a strictly incremental mode of processing. The reading times for each segment were recorded, allowing the quantification of the difficulty of sentence reading. The task allowed us to identify the exact locations of the processing difficulty and thus facilitate a more accurate assessment of the age-related decline in sentence processing. The results indicate that the effect of ageing was found mainly at the head nouns, but not at other regions of the sentences, a finding which suggests that the maze task is an effective method to identify the exact location of the ageing effect on sentence processing. The implications of this experimental paradigm for investigating the effect of ageing on sentence processing are discussed.

Tags