The Evoked Potential Operant Conditioning System (EPOCS): A Research Tool and an Emerging Therapy for Chronic Neuromuscular Disorders

N. Jeremy Hill; Disha Gupta; Amir Eftekhar; Jodi A. Brangaccio; James J. S. Norton; Michelle McLeod; Tim Fake; Jonathan R. Wolpaw; Aiko K. Thompson

doi:10.3791/63736

JoVE Journal > Neuroscience

Neurosciences

The Evoked Potential Operant Conditioning System (EPOCS): A Research Tool and an Emerging Therapy for Chronic Neuromuscular Disorders

Published: August 25, 2022

doi:

10.3791/63736

N. Jeremy Hill^1,2, Disha Gupta^1,2, Amir Eftekhar¹, Jodi A. Brangaccio¹, James J. S. Norton^1,2, Michelle McLeod³, Tim Fake¹, Jonathan R. Wolpaw^1,2,4, Aiko K. Thompson³

¹National Center for Adaptive Neurotechnologies,Stratton VA Medical Center, ²Electrical & Computer Engineering Department,State University of New York at Albany, ³College of Health Professions,Medical University of South Carolina, ⁴Department of Biomedical Sciences,State University of New York at Albany

Summary

The Evoked Potential Operant Conditioning System aids scientific investigation of sensorimotor function and can administer targeted neurobehavioral training that can impact sensorimotor rehabilitation in neuromuscular disorders. This article describes its capabilities and illustrates its application in modifying a simple spinal reflex to achieve lasting improvement in motor function.

Abstract

The Evoked Potential Operant Conditioning System (EPOCS) is a software tool that implements protocols for operantly conditioning stimulus-triggered muscle responses in people with neuromuscular disorders, which in turn can improve sensorimotor function when applied appropriately. EPOCS monitors the state of specific target muscles—e.g., from surface electromyography (EMG) while standing, or from gait cycle measurements while walking on a treadmill—and automatically triggers calibrated stimulation when pre-defined conditions are met. It provides two forms of feedback that enable a person to learn to modulate the targeted pathway's excitability. First, it continuously monitors ongoing EMG activity in the target muscle, guiding the person to produce a consistent level of activity suitable for conditioning. Second, it provides immediate feedback of the response size following each stimulation and indicates whether it has reached the target value.

To illustrate its use, this article describes a protocol through which a person can learn to decrease the size of the Hoffmann reflex—the electrically-elicited analog of the spinal stretch reflex—in the soleus muscle. Down-conditioning this pathway's excitability can improve walking in people with spastic gait due to incomplete spinal cord injury. The article demonstrates how to set up the equipment; how to place stimulating and recording electrodes; and how to use the free software to optimize electrode placement, measure the recruitment curve of direct motor and reflex responses, measure the response without operant conditioning, condition the reflex, and analyze the resulting data. It illustrates how the reflex changes over multiple sessions and how walking improves. It also discusses how the system can be applied to other kinds of evoked responses and to other kinds of stimulation, e.g., motor evoked potentials to transcranial magnetic stimulation; how it can address various clinical problems; and how it can support research studies of sensorimotor function in health and disease.

Introduction

Over the past decade, targeted neuroplasticity strategies have emerged as a new approach for the rehabilitation of neurological impairments¹^,². One such strategy is operant conditioning of an evoked potential. This entails repeatedly eliciting electrophysiological responses that can be measured non-invasively – for example, by electroencephalography (EEG) or surface electromyography (EMG) – and giving the person immediate feedback on the size of each response relative to a criterion level set by the therapist or investigator. Over time, this protocol trains the person to increase or decrease their response and can, consequently, target beneficial change to a central nervous system site that is important in a behavior such as locomotion or reach-and-grasp. The targeted change benefits performance and, in addition, enables better practice that leads to widespread beneficial change that improves the entire behavior. For example, in people with incomplete spinal cord injury (iSCI) in whom clonus impairs locomotion, operant conditioning that reduces the Hoffmann reflex in the soleus muscle of one leg improves locomotor muscle activity in both legs, thereby increasing walking speed and restoring right/left step symmetry¹^,³^,⁴^,⁵. Another example is that of paired-pulse stimulation, which can lastingly increase the size of the motor-evoked potential (MEP) to transcranial magnetic stimulation, thereby improving reach-and-grasp function in people with chronic hand and arm impairment following iSCI⁶.

Implementing such protocols demands special-purpose software that must perform multiple functions. Specifically, it must continuously acquire, process, and save electrophysiological signals; it must continuously monitor the state of the nervous system and trigger stimulation appropriately under tight real-time constraints; it must provide continuous moment-by-moment feedback, trial-by-trial feedback, and session-by-session feedback; it must provide a user interface to guide setup and tuning by the investigator or therapist; and, finally, it must store and organize signal data and meta-information in a standardized format.

The evoked potential operant conditioning system (EPOCS) is our answer to this outstanding need. Under the hood, the software is based on BCI2000, an open-source neurotechnology platform that is used in hundreds of laboratories around the world⁷^,⁸. In EPOCS, BCI2000's usual user interface is hidden and replaced by a streamlined interface that is optimized for evoked potential operant conditioning protocols.

The current article and its accompanying video illustrate the use of EPOCS in one particular protocol: operant conditioning to reduce the size of the Hoffmann (H-) reflex in the soleus muscle. This response is the electrically elicited analog of the knee-jerk stretch reflex. H-reflex down-conditioning has been shown to reduce the impact of clonus on, and to thereby improve, locomotion in animals with iSCI⁹^,¹⁰^,¹¹^,¹²^,¹³ and in humans with iSCI, multiple sclerosis, or stroke⁵^,¹⁴^,¹⁵. It can be applied without adverse side effects in animals and people with or without neurological injury¹⁶^,¹⁷.

The operant conditioning protocol functions by performing multiple trials, each lasting several seconds. The sequence of events of one trial is shown schematically in Figure 1, with numbers denoting the following functions:

1. Continuous background EMG is recorded from bipolar surface electrodes over the target muscle (soleus) and its antagonist (tibialis anterior). The background level is evaluated as the mean rectified value of the high-pass-filtered signal in a sliding window.

2. Background EMG level in the target muscle is shown as the height of a bar, continuously updated on the participant's screen. This helps the participant to keep the activity within a specified range (hatched region).

3. The software judges the appropriate moment for electrical stimulation and triggers the stimulator accordingly. The principal criteria are that at least 5 s must have elapsed since the previous stimulation and that the background EMG level must have remained in the specified range continuously for 2 s.

4. A constant-current stimulator delivers an electrical pulse transcutaneously to the tibial nerve (typically monophasic, with 1 ms duration).

5. The resulting stimulus-locked response is recorded. The software computes the sizes of two components of particular interest: the earlier M-wave, which reflects muscle activation resulting from direct stimulation of the motor axon; and the later H-reflex, which reflects the signal relayed through a reflex arc in the spinal cord¹⁸^,¹⁹^,²⁰^,²¹^,²². EPOCS refers to these as the reference response and target response, respectively.

6. H-reflex size for the current trial is displayed as the height of a second bar, relative to a desired criterion level that defines a successful or unsuccessful trial. For down-conditioning, the bar is dark green if the H-reflex size fell below the criterion, or bright red if it did not (vice versa for up-conditioning). Simultaneously, the numeric display of the cumulative success rate is updated accordingly. Together, these graphical display elements provide the immediate positive or negative reinforcement on which operant conditioning relies²³.

Figure 1: Schematic illustration of EPOCS' core functionality during down-conditioning of the soleus H-reflex. The participant views a large monitor screen that shows the background EMG level, the most recent H-reflex size, the number of trials completed so far in the current run of 75, and the running proportion of successful trials for the run. The sequence of events in one trial is denoted by the numbers 1-6, as described in the Introduction. Please click here to view a larger version of this figure.

A human H-reflex conditioning protocol typically consists of 6 baseline sessions, followed by 24-30 conditioning sessions spread over 10 weeks at a rate of 3 sessions/week, and several follow-up sessions over the subsequent 3-6 months¹⁴^,¹⁶. Each session lasts 60-90 min.

To support this protocol as well as other related protocols, EPOCS has five distinct modes of operation, each served by one of the tabs of its main window, entitled Stimulus Test, Voluntary Contraction, Recruitment Curve, Control Trials, and Training Trials.

In Stimulus Test mode, the software triggers a stimulus every few seconds, not necessarily contingent on the state of the target muscle. The response signals are shown on the screen after each stimulus. This allows the operator to verify the quality of the electrode connections and the EMG signal; to optimize the position of the stimulating and recording electrodes; and to establish the individual's response morphology.

In Voluntary Contraction mode, the software measures and shows the background EMG level while the participant is encouraged to contract the muscle as much as possible, in the absence of electrical stimulation. In some protocols, the EMG level at maximum voluntary contraction (MVC) is a useful reference for setting the background EMG criteria. In the protocol demonstrated here, this is not necessary, as a stable standing posture standardizes the activity of the soleus muscle sufficiently.

In Recruitment Curve mode, stimulation is contingent on the background EMG level (shown continuously on the screen) remaining in the correct range; response signals are shown on the screen after each stimulus; and the sequence of responses may be analyzed at the end of a run. This allows the operator to determine the start and end of the time intervals in which the responses of interest appear; to determine the relationship between stimulation intensity and response size, both before and after the conditioning runs; and to determine the stimulation intensity to be used for conditioning.

In Control Trials mode, stimulation is contingent on the background EMG level (shown continuously on screen), but no feedback is given about the target response size. The sequence and distribution of response sizes may be analyzed. This mode may be used to gather baseline measurements of response size, or as a control condition for comparison against operant conditioning in a crossover or between-subjects experimental design. It can serve as a basis for setting the performance criterion for operant conditioning at the beginning of each session.

Finally, in Training Trials mode, stimulation is contingent on the background EMG level (shown continuously on screen), and trial-by-trial reinforcement is also provided by showing the target response size, as described above and shown in Figure 1. This is the mode in which operant conditioning is performed.

The next section will guide the reader through the five modes by demonstrating the protocol for down-conditioning the soleus H-reflex in an adult participant without neurological injury.

Protocol

All procedures described here were approved by the institutional review board of the Stratton VA Medical Center (approval number 1584762-9). The participant in the video gave informed consent for the use of their image and EMG signals in this publication.

NOTE: The terms in bold indicate labels that should be visible on the hardware and/or in the software graphical user interface.

1. Software setup

Go to https://neurotechcenter.org/epocs for instructions on obtaining the latest software installer. Install the software using the downloaded installer.
Ensure that the necessary drivers and manufacturer's software are installed for the digitizer. In particular, ensure that the NI-DAQmx installation includes 64-bit support.
Launch the NI-MAX application, select the device to be used under Devices and Interfaces, and ensure that its name is Dev1. Then, under Configure > Power-up States, ensure that the Line State checkbox for port 0 line 7 is unchecked (zeroed). Also, zero the corresponding Tristate checkbox, if there is one.
Using the Add or Remove Programs tool, remove any unnecessary software that might intermittently consume processor resources in the background, as this can lead to glitches in real-time signal processing. Make sure to remove any software update/troubleshooter suites provided by the computer's manufacturer, as these have been known to cause serious performance problems.
NOTE: The software setup steps above only need to be performed once for a given hardware configuration.

2. Hardware setup

Set up the digitizer to coordinate input and output as described below.
1. Using a short piece of solid-core insulated wire, patch the spring terminal for digital output port 0 line 7 (marked P0.7-or possibly DIO7 on older equipment) to the spring terminal for USER output.
2. Attach a female/male/female BNC tee connector to the USER output. Connect the USER output to the external trigger input port of the stimulator.
3. Connect the first and second amplified EMG signal cables to the first and second analog input channels of the data acquisition card, respectively. These are marked AI0 and AI1-or possibly ACH0 and ACH1 on older equipment. Make an additional connection from the USER output back into the third analog input channel (marked AI2 or ACH2).
Set up the constant-current stimulator as described below.
NOTE: To make the protocol generalizable to a variety of stimulator brands and models, this article describes manual stimulus intensity control rather than taking advantage of the option for automatic control of the particular stimulator models.
1. Turn on the stimulator and configure it to deliver 1 ms monophasic pulses. For the DS8R model, ensure that stimulus intensity is controlled by the front panel or USB interface, not via the rear analog input. Plug in the long output cable and connect it to the snap leads that will attach to the stimulating electrode pads.
Set up the analog amplifier to deliver at least two EMG channels as described below.
1. Turn on the amplifier. Ensure all channel GAIN values are at their default value of 500 and the corresponding VARIABLE knobs are turned to their minimum value of 1.
2. Connect the portable unit to the amplifier using the long cable. Insert two square 9 V batteries into the portable unit's battery pack. Strap the portable unit and battery pack around the participant's waist.

3. Preparing stimulation and recording electrodes

Use any previously noted landmarks or measurements to recreate previous participant-specific electrode positions as closely as possible. Prepare the skin where the electrodes will be attached by wiping with alcohol pads to remove excess oil, then wipe with a paper towel to remove dead skin.
Attach the stimulation electrodes in position to stimulate the tibial nerve precisely, with minimal effect on the common peroneal nerve. Use the larger (22 mm x 35 mm) electrode as the anode and place it at the apex of the popliteal fossa where the sciatic nerve branches into tibial and common peroneal nerves. Place the cathode (22 mm x 22 mm) at the crease of the knee, directly below the anode, with a 3-4 cm separation between electrode centers.
Attach the EMG recording electrodes in a bipolar montage at the target muscle (soleus) as follows.
1. To determine the correct location, first find the gastrocnemius muscle by palpating while the participant alternates between standing on their toes and standing naturally.
2. Place the first electrode directly below the distal border of the gastrocnemius muscle belly. Place the second electrode below the first, with a 5 cm spacing between electrode centers. Keep both electrodes in line with the Achilles tendon.
Attach the EMG recording electrodes in a bipolar montage at the antagonist muscle (tibialis anterior). To do this, identify the muscle by palpating while the participant lifts (dorsiflexes) their toes. Place the electrodes on the muscle belly, about 1/3 of the way down from the fibular head to the ankle, with a 5 cm vertical separation between electrode centers.
Attach a ground electrode at the patella.
Connect the EMG amplifier leads as follows. Plug the green-taped active electrode into channel 1 on the portable unit and connect the red clips to the target-muscle electrodes (soleus) and the green clip to the ground electrode. Plug the black-taped active electrode into channel 2 on the portable unit and connect the clips to the antagonist-muscle electrodes (tibialis anterior).
Connect the battery pack to the portable unit.
Connect the stimulation snap leads to the stimulation electrodes.

4. Using the EPOCS software

Position the monitor such that both the investigator and subject (or the therapist and patient) can see it clearly.
Launch an EPOCS session.
NOTE: A session is defined as one visit to the laboratory or clinic, typically lasting 60-90 min.
1. Double-click the EPOCS icon to launch the application. Enter the participant ID code (or choose from the list of previously used IDs).
2. If this is a continuation of an existing session, e.g., if the software had to be re-launched following an interruption, press Continue Session. This will only be available if a session for the specified participant has been started in the last 3 h.
3. Otherwise, press Start New Session. This will create a new data folder, date- and time-stamped and marked with the participant ID.
Verify the electrode location and contact quality and adjust as necessary.
1. Ensure that the Stimulus Test tab is displayed.
2. In Settings > Stimulation, configure the Min. Interval for Stimulus Test to 3 s. Note that this is configured separately from the Min. Interval for Normal Usage, which will typically be longer, around 5 s. Leave the Digitimer Link setting disabled.
  NOTE: When enabled, the Digitimer Link option would allow software control of the stimulation intensity when using certain stimulator models. The current protocol instead demonstrates manual control of stimulus intensity, which is applicable across multiple stimulator makes and models.
3. On the stimulator control panel, set the stimulus intensity to 5 mA and enable stimulation.
4. Ask the participant to stand, with their hands partially supporting their weight on a walker if necessary.
5. Warn the participant to expect stimulation, then press Start to start a new run (i.e., to start recording signals continuously to a new file). Runs will be numbered sequentially, and their files will never overwrite each other.
6. Each repetition of stimulation is called a trial. The EMG responses elicited in each trial are shown immediately. Assess the M-wave and H-reflex elicited in the target muscle (the upper, blue trace) and antagonist muscle (the lower, red trace). If necessary, increase the current gradually to 10 mA or more, until the responses appear clearly.
7. To find the optimal location for stimulating (i.e., the location that yields the largest H-reflex), compare the evoked potentials after moving the cathode a full electrode-width medially and then laterally, followed by a half electrode-width medially and then laterally, and finally by a full electrode-width up and then down.
8. Mark, note, and photograph the position of the electrodes to aid repositioning in future sessions. If possible, make a plaster cast of the calf and the back of the knee and make holes in the cast that allow the marks to be re-applied precisely.
9. Once the optimal positions for the electrodes have been found, replace the repositioned electrodes with fresh electrodes.
For soleus conditioning, skip the Voluntary Contraction tab.
Measure the maximum M-wave and H-reflex sizes (M_max and H_max) by charting the recruitment curve, i.e., the relationship between stimulus intensity and response. Measure the recruitment curve as follows, before and after the control or training trials in each session. In the first session, use the recruitment curve to guide the selection of an appropriate stimulation intensity for use throughout the conditioning process.
1. Switch to the Recruitment Curve tab.
2. In Settings > EMG, configure the ranges that the target and antagonist background EMG values must stay within to enable stimulation. For the soleus, assuming the maximum voluntary contraction has not been measured, simply ensure that the ranges encompass the EMG levels generated by natural weight-bearing during standing. Set the Background Hold Duration to 2 s to dictate how long the participant must continuously keep the EMG in range to trigger each stimulus.
  NOTE: The upper or lower limits may be left blank if no corresponding restriction is to be imposed.
3. Enable the stimulator and set the intensity to the minimum value to be used in recruitment curve measurement: 5 mA. (This value is an example and should be chosen on a case-by-case basis-see discussion.)
4. If this is the participant's first session, allow them to practice keeping the EMG in the correct range for the required duration as described below.
  1. With the participant standing, press Start. Demonstrate to the participant how the background EMG level in the target muscle is shown in real-time as the height of the bar against a shaded region that shows the target range.
  2. Explain to the participant that the activity from both muscles (target and antagonist) must be within their required ranges to turn the bar from a bright red to a darker green (although the antagonist activity level is not shown directly).
  3. To adjust the background ranges, press Stop followed by Settings; then, enter the new numbers, press OK, then Start again. Press Stop when the practice run is finished.
5. To measure the recruitment curve, with the participant standing, press Start. If the H-reflex is already visible at the chosen starting intensity, gradually decrease the current until the H-reflex is no longer seen. Then, press Stop and again press Start to begin the run.
6. Pay close attention to the Trials Completed counter. After every four trials, manually increase the stimulation intensity by 2 mA. (This value is an example and should be chosen on a case-by-case basis-see discussion.) Continue until M-wave size reaches a plateau, provided the participant does not report discomfort. Press Stop when done and invite the participant to sit down to rest.
7. Make a note of the stimulus intensity values used for each trial. Associate any written records with the run number shown in the top right of the window. At the end of any run, enter this information manually into the session log, along with any other notes, via the Log tab.
  NOTE: If stimulation intensity is being controlled manually, this information will not be recorded by the software.
8. Press the Analysis button to open the analysis window and allow definition of the M- and H-waves as follows. In the upper pane of the analysis window, examine the stimulus-locked overlay of the target-muscle signals from each trial in the last run.
9. Use the mouse to adjust the beginning and end of the brown reference and green target intervals (in the H-reflex operant conditioning protocol, these correspond to M-wave and H-reflex, respectively). When the intervals are correct, press the red Use Marked Timings buttons to save these personalized interval settings for future analyses.
10. In the Sequence pane in the lower half of the analysis window, assess the resulting recruitment curve. Adjust the settings to view either peak-to-peak or mean-rectified amplitude and to pool results from consecutive trials. Since the stimulus current was increased every four trials, specify Trials to Pool: 4. Record the resulting M_max and H_max.
11. If this is the participant's first session, optimize the target-muscle EMG recording locations as follows.
  1. Move the soleus electrodes medially by a half electrode-width (or a full electrode-width if the muscle is wide enough). Then, repeat the steps above to gather a full recruitment curve and record the resulting M_max and H_max.
  2. Move the soleus electrodes the same distance laterally from their original position, and again perform a recruitment curve measurement to estimate M_max and H_max. Adopt the electrode positioning that maximizes H_max and mark, note, and photograph their positions as in step 4.3.8.
12. Choose a stimulus intensity that elicits a close-to-maximal H-reflex—ideally on the ascending (left-hand) slope of the H-reflex recruitment curve—but with the constraint that there must be a visible M-wave. Set this stimulus intensity value on the stimulator and note it for future sessions. Also, note the corresponding M-wave size (see discussion).
Measure the distribution of H-reflex sizes without giving response feedback as follows.
1. Switch to the Control Trials tab.
2. With the participant standing, press Start. As before, instruct the participant to use the feedback provided by the rising and falling bar to maintain the level of background muscle activity within the required range.
3. If this is a baseline or follow-up session, perform 75 trials in succession at the chosen stimulus intensity. If this is a conditioning session, perform just 20 trials. After the prescribed number of trials, press Stop to end the run.
4. Press Analysis. As before, assess the overlay of trial-by-trial response waveforms in the upper panel and the Sequence of response sizes below. A new tab called Distribution is also activated by default, on top of Sequence. It shows the distribution of H-reflex sizes, with summary statistics on the right.
5. Press Log Results to append the summary statistics to the session log.
6. If this is a baseline session, repeat the above steps for a total of 3 runs of 75 trials each. Then, skip to the closing recruitment curve measurement in step 4.8.
7. If this is a conditioning session, set the Target Percentile to 66. The up- and down-conditioning criterion levels, along with the median, are shown by the vertical red lines. Select a criterion for conditioning by pressing the Up-Condition or Down-Condition button. For this protocol, press Down-Condition. This action will be logged automatically, and the analysis window will close.
  NOTE: In a down-conditioning protocol, a Target Percentile value of 66 means that a successful trial is defined as one in which the response size is in the bottom 66% of the previously measured distribution; conversely, in up-conditioning, success means producing a response size in the top 66% of the distribution.
Perform operant conditioning as described below.
1. Switch to the Training Trials tab.
2. With the participant standing, press Start.
3. If the participant has not seen it before, draw their attention to the new feedback bar in the middle of the screen. Explain that it shows the most recent H-reflex size relative to the hatched target range. If the response falls within the target range, the trial will be counted as successful, and the bar will be dark green. If it falls outside the range, the trial will be counted as unsuccessful, and the bar will be a brighter red.
4. Throughout the run, motivate the participant to perform as many successful trials as possible. The number of trials performed and the proportion of trials that were successful in the run so far are shown on the right of the screen. After 75 trials, press Stop to end the run.
5. Press the Analysis button. The analysis window looks the same as it did for control trials. Again, use the Sequence tab to verify that the M-waves remained constant at the desired size.
6. As before, with the Distribution tab selected, use the Down-Condition button to update the operant conditioning criterion for the next run. Repeat the operant conditioning procedure 2x more, for a total of 3 runs of 75 trials each.
At the end of the session, perform another recruitment curve measurement as in steps 4.5.1.-4.5.6.
Finish the session as described below.
1. Type up any additional session notes in the Log tab. The log is saved automatically as it is filled in in a date-stamped plain-text file in the session-specific data directory. Close the window. Data and logs will already have been saved.
2. To revisit the analysis window for previously recorded data, double-click the EPOCS Offline Analysis icon, and select the data file for the run to be analyzed. Wait for the raw signals to be processed (this may take 1 min or more).
  NOTE: Data are saved as .dat files in BCI2000 format. The file name indicates the date and time of the session, the participant ID, the mode (ST for stimulus test, VC for voluntary contraction, RC for recruitment curve, CT for control trials, and TT for training trials), and the sequential run number.

5. Performing multiple repeat sessions

Schedule a total of 6 baseline sessions, 24 conditioning sessions (or 30, for people with neurological impairment), and 4 follow-up sessions. Schedule the baseline and conditioning sessions at a rate of 3 sessions/week, each session lasting no longer than 90 min. Arrange for all sessions to be conducted at the same time of day to minimize the effects of diurnal variation.
In each of the 6 baseline sessions, conduct an initial Recruitment Curve run, 3 runs of 75 Control Trials, and a final Recruitment Curve run.
In each of the 24 (or 30) conditioning sessions, conduct an initial Recruitment Curve run, 1 run of 20 Control Trials, 3 runs of 75 Training Trials, and a final Recruitment Curve run.
Conduct 4 follow-up sessions at 10-14 days, 1 month, 2 months, and 3 months after the last conditioning session. Depending on the goals of the study, these may be identical to baseline sessions, or to conditioning sessions.

Representative Results

Figure 2 shows the effectiveness of the above protocol in measuring M-wave and H-reflex recruitment curves and in measuring the distribution of H-reflex sizes at constant stimulation intensity. It also illustrates the overall effectiveness of the multi-session protocol in changing the H-reflex size in neurologically unimpaired participants and in improving locomotor function in participants with incomplete spinal cord injury.

Figure 2A shows a screenshot of the analysis window following a run performed in Recruitment Curve mode during H-reflex operant conditioning (see protocol step 4.5.). In the lower half of the window (the Sequence pane), the horizontal axis shows trial number—hence, stimulus intensity increases from left to right. H-reflex size (green circles) rises then falls as a function of stimulus intensity, whereas M-wave size (brown triangles) rises then saturates. Figure 2B shows a screenshot of the analysis window following a run performed in Control Trials or Training Trials mode during H-reflex operant conditioning (see protocol step 4.6. and step 4.7.). In the lower panel (the "Distribution" pane), the histogram of H-reflex sizes facilitates the selection of an appropriate criterion level for subsequent up- or down-conditioning. In Figure 2C, H-reflex size in neurologically unimpaired participants is plotted as a function of session number across 6 baseline sessions, 24 conditioning sessions, and 4 follow-up sessions. Data were collected from 15 participants (8 male, 7 female) of whom 2 participated in both up- and down-conditioning arms. Participants were aged 21-55 years. All the participants gave informed consent. The protocol was approved by the institutional review board (IRB) of the New York State Department of Health (approval number 05-058). Thompson et al.¹⁶ provides further details. Figure 2D shows the beneficial effect of soleus H-reflex down-conditioning in participants with chronic lower limb impairment following incomplete spinal cord injury. Successful conditioning was associated with an improvement in gait symmetry and in walking speed relative to baseline. Data were collected from 13 participants (9 male, 4 female) aged 28-68 years, who gave informed consent. The protocol was approved by the IRB of Helen Hayes Hospital (approval number 07-07). Thompson et al.¹⁴ provides further details.

Figure 2: Representative results. (A) Screenshot of the recruitment curve analysis window. (B) Screenshot of the Control Trials or Training Trials analysis window. (C) Contrasting effects of up- and down-conditioning of the soleus H-reflex in uninjured participants. Red upward triangles show mean H-reflex size from N = 6 successfully up-conditioned participants (out of 8); blue downward triangles show mean responses from N = 8 successfully down-conditioned participants (out of 9). Error bars denote standard error. This image has been modified from Thompson et al.¹⁶. (D) Therapeutic effect of soleus H-reflex down-conditioning on walking speed and gait symmetry in people with chronic impairment following incomplete spinal cord injury. The bars contrast results for N = 6 participants whose H-reflexes were successfully down-conditioned against N = 4 participants from the control condition (no operant conditioning) and N = 3 participants in whom the down-conditioning protocol failed to reduce reflex size. Error bars denote standard error. Each asterisk indicates a p-value below 0.05 on a paired t-test comparing pre- against post-conditioning measurements. This image has been modified from Thompson et al.¹⁴. Please click here to view a larger version of this figure.

Discussion

The protocol described above is suitable for demonstrating soleus H-reflex down-conditioning in a typical adult without neurological impairment. The precise parameter values may vary from person to person and particularly as a function of impairment. Whereas the participant's recruitment curve reached M_max at a stimulating current of around 25 mA in the video, another person might require 50 mA or more, so the current would be increased in larger steps during recruitment curve measurement. They might also require a longer pulse duration. A third person might be more sensitive and require smaller current settings. The protocol also needs to be adapted according to the muscle that is being conditioned. For example, when targeting the flexor carpi radialis muscle²⁴^,²⁵, a lower current setting is generally used; the Voluntary Contraction mode should be used to establish a scale for the background-EMG limits; and greater care must be taken both during the optimization of electrode placement and during the optimization of posture, which must then be kept constant across trials.

The protocol is sensitive to variations in the relationship between stimulator current setting and the amount of current actually delivered to the nerve—this may be affected by small variations in posture, hydration of the participant, and drying out of the adhesive electrode gel. In H-reflex conditioning, this problem can be mitigated by using M-wave size as an indicator of effective stimulation intensity. It reflects the number of soleus motoneuron efferent axons excited by the stimulus. Thus, if M-wave size is kept constant, it implies that the number of primary afferent axons excited by the stimulus, i.e., the axons that elicit the H-reflex, is also kept constant (see also Crone et al.²⁶). Hence, this M-wave is referred to as the reference response in the software. For this reason, step 4.5.12. mentions that the target M-wave size should be recorded. It is actually more important to keep this response size roughly constant than to keep the nominal current strictly constant. The Sequence tab of the analysis window allows retrospective verification of M-wave constancy over each run; for soleus H-reflex conditioning, this is often sufficient to correct any problems. For greater control, a second monitor may be attached to the computer to display real-time M-wave analytics that guide trial-by-trial manual adjustment. Automation of this control task is an ongoing project²⁷.

Diurnal variation may also affect a person's electrophysiological responses²⁸^,²⁹^,³⁰^,³¹. For this reason, it is recommended that all sessions be performed at the same time of day, i.e., within the same 3 h time window.

The success of operant conditioning may be sensitive to the accuracy of the time interval chosen by the operator to define the H-reflex; in particular, the interval should not be too wide. Detailed guidelines for correct interval definition are beyond the scope of the current article. This is also a function that will be automated in future versions of the software.

A critical step in the protocol is step 4.5.6., in which the operator manually increases the stimulator current repeatedly after each fixed number of trials. Mis-counting the trials here or mis-adjusting the current dial can lead to distortion of the resulting recruitment curve. This possibility of user error can be mitigated by enabling the Digitimer Link option, which allows automation of the current adjustment for one particular stimulator model.

This article has focused on H-reflex conditioning, as it is the most fully developed of the potential clinical applications of EPOCS. The existing software helps researchers in the ongoing efforts to hone this protocol toward wide clinical dissemination³². Beyond H-reflex conditioning, EPOCS may also be applied in its current form to a wider variety of stimulation methods and evoked responses. For example, it can equally well trigger a mechanical device that elicits a stretch reflex, which may also be conditioned³³^,³⁴^,³⁵. The approach is adaptable to an individual's impairments; in one person, down-conditioning the soleus H-reflex improves locomotion by reducing spastic hyperreflexia¹⁴; in another, up-conditioning the tibialis anterior MEP improves locomotion by alleviating foot drop³⁶.

While efforts are ongoing to produce a commercial implementation of the protocol, the original software will be maintained in parallel as a research tool to provide the necessary flexibility to expand the field of targeted neuroplasticity. This flexibility is enabled by the modularity and extensibility of the widespread and well-established BCI2000 software platform, on which EPOCS is based. This means that, with minimal intervention by a software engineer, the system is re-configurable for an even wider variety of research purposes. For example, it can be configured to record additional biosignal channels or additional sensors for later analysis (e.g., foot switches and motion tracking sensors) for conditioning during locomotion. It can also be programmed to consider additional triggering criteria for stimulation (e.g., triggering stimulation only at a particular part of the gait cycle) or to trigger additional reinforcement stimuli on successful or unsuccessful trials. Example customization files are provided.

Targeted neuroplasticity is still in its infancy. Its as-yet unexplored avenues are expected to provide great benefits both for developing novel therapeutic approaches (as discussed above) and for elucidating the natural history of disease and the mechanisms of central nervous system function in both health and disease²^,³²^,³⁷. We are, therefore, committed to maintaining and supporting EPOCS as a key tool for realizing this therapeutic and scientific potential.

Divulgations

The authors have nothing to disclose.

Acknowledgements

This work was supported by NIH (NIBIB) P41EB018783 (JRW), NIH (NINDS) R01NS114279 (AKT), NIH (NINDS) U44NS114420 (I. Clements, AKT, JRW), NYS SCIRB C33279GG & C32236GG (JRW), NIH (NICHD) P2C HD086844 (S. Kautz), The Doscher Neurorehabilitation Research Program (AKT), and Stratton Albany VA Medical Center.

Materials

Alcohol swabs	any		For application to skin
BNC cable (long) x 1	any		Male BNC to male BNC, long enough to reach from digitizer to stimulator
BNC cable (medium) x 2	any		Male BNC to male BNC, long enough to reach from amplifier to digitizer
BNC cable (short) x 1	any		Male BNC to male BNC, short (to patch between two digitizer ports)
BNC tee connector	any		Female-male-female BNC splitter
Computer	Lenovo	ThinkStation P340	A wide range of computing hardware is suitable, especially if using a USB digitizer (no PCI slots needed). Must run Windows 7+. Include standard keyboard & mouse.
Constant-current stimulator	Digitimer Ltd.	DS8R	The DS8R enjoys EPOCS automation support. If controlled manually, other constant-current stimulators may be used provided they have an external TTL trigger and can achieve a pulse duration of 1 ms or more.
Digitizer (option A)	National Instruments	USB-6212	USB digitizer with integrated BNC connectors.
Digitizer (option B)	National Instruments	PCIe-6321	PCIe digitizer—requires desktop computer with a free PCI slot, also cable and BNC terminal block (below)
Digitizer cable (for option B only)	National Instruments	SHC68-68-EPM	Connects PCIe digitizer to BNC terminal block
Digitizer terminal block (for option B only)	National Instruments	BNC-2090A	19-inch-rack-mountable BNC terminal block
EMG amplifier system	Bortec Biomedical Ltd.	AMT-8	Analog amplifier + portable unit + long transmission cable + battery pack + two 500-gain active electrode leads (1 bipolar, 1 bipolar with ground)
Monitor	any		Large enough for the participant to see clearly from the intended viewing distance.
NeuroPlus electrodes (22 x 22 mm) x 6	Vermont Medical Inc.	A10040-60	Disposable self-adhesive silver/silver-chloride 22 x 22 mm surface-EMG electrodes. 6 needed per session (11 on participant's first session)
NeuroPlus electrode (22 x 35 mm) x 1	Vermont Medical Inc.	A10041-60	Disposable self-adhesive silver/silver-chloride 22 x 35 mm surface-EMG electrode. 1 needed per session.
Snap lead x 2	any	EDR1220	Leads for stimulating electrodes: 1.5mm DIN to button snap
Wire	any		8–10 cm length of single-core insulated wire

References

Thompson, A. K., Wolpaw, J. R. Targeted neuroplasticity for rehabilitation. Progress in Brain Research. 218, 157-172 (2015).
Wolpaw, J. R. What can the spinal cord teach us about learning and memory. Neuroscientist. 16 (5), 532-549 (2010).
Thompson, A. K., Pomerantz, F. R., Wolpaw, J. R. Operant conditioning of a spinal reflex can improve locomotion after spinal cord injury in humans. Journal of Neuroscience. 33 (6), 2365-2375 (2013).
Chen, Y., et al. Locomotor impact of beneficial or nonbeneficial H-reflex conditioning after spinal cord injury. Journal of Neurophysiology. 111 (6), 1249-1258 (2014).
Thompson, A. K., Wolpaw, J. R. H-reflex conditioning during locomotion in people with spinal cord injury. Journal of Physiology. 599 (9), 2453-2469 (2021).
Bunday, K. L., Perez, M. A. Motor recovery after spinal cord injury enhanced by strengthening corticospinal synaptic transmission. Current Biology. 22 (24), 2355-2361 (2012).
Schalk, G., McFarland, D., Hinterberger, T., Birbaumer, N., Wolpaw, J. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Transactions on Biomedical Engineering. 51 (6), 1034-1043 (2004).
Schalk, G., Mellinger, J. . A Practical Guide to Brain-Computer Interfacing with BCI2000. , (2010).
Wolpaw, J. R., Braitman, D. J., Seegal, R. F. Adaptive plasticity in primate spinal stretch reflex: initial development. Journal of Neurophysiology. 50 (6), 1296-1311 (1983).
Wolpaw, J. R. Operant conditioning of primate spinal reflexes: The H-reflex. Journal of Neurophysiology. 57 (2), 443-459 (1987).
Chen, X. Y., Wolpaw, J. R. Operant conditioning of H-reflex in freely moving rats. Journal of Neurophysiology. 73 (1), 411-415 (1995).
Chen, Y., et al. Operant conditioning of H-reflex can correct a locomotor abnormality after spinal cord injury in rats. Journal of Neuroscience. 26 (48), 12537-12543 (2006).
Chen, X. Y., Chen, L., Chen, Y., Wolpaw, J. R. Operant conditioning of reciprocal inhibition in rat soleus muscle. Journal of Neurophysiology. 96 (4), 2144-2150 (2006).
Thompson, A. K., Pomerantz, F. R., Wolpaw, J. R. Operant conditioning of a spinal reflex can improve locomotion after spinal cord injury in humans. Journal of Neuroscience. 33 (6), 2365-2375 (2013).
Thompson, A. K., Favale, B. M., Velez, J., Falivena, P. Operant up-conditioning of the tibialis anterior motor-evoked potential in multiple sclerosis: feasibility case studies. Neural Plasticity. , 4725393 (2018).
Thompson, A. K., Chen, X. Y., Wolpaw, J. R. Acquisition of a simple motor skill: Task-dependent adaptation plus long-term change in the human soleus H-reflex. Journal of Neuroscience. 29 (18), 5784-5792 (2009).
Makihara, Y., Segal, R. L., Wolpaw, J. R., Thompson, A. K. Operant conditioning of the soleus H-reflex does not induce long-term changes in the gastrocnemius H-reflexes and does not disturb normal locomotion in humans. Journal of Neurophysiology. 112 (6), 1439-1446 (2014).
Hoffmann, P. Beitrag zur Kenntnis der menschlichen Reflexe mit besonderer Berücksichtigung der elektrischen Erscheinungen. Archiv für Anatomie, Physiologie und Wissenschaftliche Medicin. 1, 223-246 (1910).
Magladery, J. W., McDougal, D. B. Electrophysiological studies of nerve and reflex activity in normal man, I: Identification of certain reflexes in the electromyogram and the conduction velocity of peripheral nerve fibers. Bulletin of the Johns Hopkins Hospital. 86, 265-289 (1950).
Zehr, E. P. Considerations for use of the Hoffmann reflex in exercise studies. European Journal of Applied Physiology. 86 (5), 455-468 (2002).
Misiaszek, J. E. The H-reflex as a tool in neurophysiology: Its limitations and uses in understanding nervous system function. Muscle & Nerve. 28 (2), 144-160 (2003).
Pierrot Deseilligny, E., Burke, D. . The Circuitry of the Human Spinal Cord: Its Role in Motor Control and Movement Disorders. , (2012).
Skinner, B. F. . The Behavior of Organisms: An Experimental Analysis. , (1938).
Eftekhar, A., Norton, J. J. S., McDonough, C. M., Wolpaw, J. R. Retraining reflexes: Clinical translation of spinal reflex operant conditioning. Neurotherapeutics. 15 (3), 669-683 (2018).
Norton, J., et al. Operant condition of the flexor carpi radialis H-reflex. Archives of Physical Medicine and Rehabilitation. 101 (12), 145-146 (2020).
Crone, C., Johnsen, L. L., Hultborn, H., Orsnes, G. B. Amplitude of the maximum motor response (Mmax) in human muscles typically decreases during the course of an experiment. Experimental Brain Research. 124 (2), 265-270 (1999).
Devetzoglou-Toliou, S., et al. Recursive PID controller for automatically adjusting M-wave size during H-reflex operant conditioning. International IEEE/EMBS Conference on Neural Engineering. 10, 1079-1082 (2021).
Wolpaw, J. R., Seegal, R. F. Diurnal rhythm in the spinal stretch reflex. Brain Research. 244 (2), 365-369 (1982).
Chen, X. Y., Wolpaw, J. R. Circadian rhythm in rat H-reflex. Brain Research. 648 (1), 167-170 (1994).
Carp, J. S., Tennissen, A. M., Chen, X. Y., Wolpaw, J. R. Diurnal H-reflex variation in mice. Experimental Brain Research. 168 (4), 517-528 (2006).
Lagerquist, O., Zehr, E. P., Baldwin, E. R., Klakowicz, P. M., Collins, D. F. Diurnal changes in the amplitude of the Hoffmann reflex in the human soleus but not in the flexor carpi radialis muscle. Experimental Brain Research. 170, 1-6 (2006).
Thompson, A. K., Wolpaw, J. R. Operant conditioning of spinal reflexes: From basic science to clinical therapy. Frontiers in Integrative Neuroscience. 8, 25 (2014).
Segal, R. L., Wolf, S. L. Operant conditioning of spinal stretch reflexes in patients with spinal cord injuries. Experimental Neurology. 130 (2), 202-213 (1994).
Wolf, S. L., Segal, R. L. Reducing human biceps brachii spinal stretch reflex magnitude. Journal of Neurophysiology. 75 (4), 1637-1646 (1996).
Mrachacz-Kersting, N., et al. Acquisition of a simple motor skill: Task-dependent adaptation and long-term changes in the human soleus stretch reflex. Journal of Neurophysiology. 122 (1), 435-446 (2019).
Thompson, A. K., et al. Operant conditioning of the motor-evoked potential and locomotion in people with and without chronic incomplete spinal cord injury. Journal of Neurophysiology. 121 (3), 853-866 (2019).
Thompson, A. K., et al. Effects of sensorimotor rhythm modulation on the human flexor carpi radialis H-reflex. Frontiers in Neuroscience. 12, 505 (2018).

Play Video

PDF

DOI

DOWNLOAD MATERIALS LIST

Citer Cet Article

Hill, N. J., Gupta, D., Eftekhar, A., Brangaccio, J. A., Norton, J. J. S., McLeod, M., Fake, T., Wolpaw, J. R., Thompson, A. K. The Evoked Potential Operant Conditioning System (EPOCS): A Research Tool and an Emerging Therapy for Chronic Neuromuscular Disorders. J. Vis. Exp. (186), e63736, doi:10.3791/63736 (2022).