We describe a protocol for using insect antennae in the form of electroantennograms (EAGs) on autonomous robots. Our experimental design allows stable recordings within a day and resolves individual odor patches up to 10 Hz. The efficiency of EAG sensors for olfactory searches is demonstrated in driving a robot toward an odor source.
Robots designed to track chemical leaks in hazardous industrial facilities1 or explosive traces in landmine fields2 face the same problem as insects foraging for food or searching for mates3: the olfactory search is constrained by the physics of turbulent transport4. The concentration landscape of wind borne odors is discontinuous and consists of sporadically located patches. A pre-requisite to olfactory search is that intermittent odor patches are detected. Because of its high speed and sensitivity5-6, the olfactory organ of insects provides a unique opportunity for detection. Insect antennae have been used in the past to detect not only sex pheromones7 but also chemicals that are relevant to humans, e.g., volatile compounds emanating from cancer cells8 or toxic and illicit substances9-11. We describe here a protocol for using insect antennae on autonomous robots and present a proof of concept for tracking odor plumes to their source. The global response of olfactory neurons is recorded in situ in the form of electroantennograms (EAGs). Our experimental design, based on a whole insect preparation, allows stable recordings within a working day. In comparison, EAGs on excised antennae have a lifetime of 2 hr. A custom hardware/software interface was developed between the EAG electrodes and a robot. The measurement system resolves individual odor patches up to 10 Hz, which exceeds the time scale of artificial chemical sensors12. The efficiency of EAG sensors for olfactory searches is further demonstrated in driving the robot toward a source of pheromone. By using identical olfactory stimuli and sensors as in real animals, our robotic platform provides a direct means for testing biological hypotheses about olfactory coding and search strategies13. It may also prove beneficial for detecting other odorants of interests by combining EAGs from different insect species in a bioelectronic nose configuration14 or using nanostructured gas sensors that mimic insect antennae15.
Nowadays, animals like dogs are frequently used in safety and security applications that involve the localization of chemical leaks, drugs and explosives because of their excellent smell detection capabilities16. Yet, they show behavioral variations, get tired after extensive work, and require frequent retraining as their performance decreases over time17. One way to circumvent these limitations is to replace trained dogs by olfactory robots.
Nonetheless, tracking scents and odor sources is a major challenge in robotics. In turbulent environments, the landscape of an odor plume is very heterogeneous and unsteady, and consists of sporadically located patches4. Even at moderate distances from the source, as short as few meters, detections become sporadic and only provide cues intermittently. Furthermore, local concentration gradients during detections do not generally point towards the source. Given discontinuous flow of information and limited local information when detections are made how to navigate a robot toward the source?
It is well known that insects such as male moths use chemical communication to successfully locate their mates over long distances (hundreds of meters). To do so, they adopt a stereotypical behavior18-20: they surge upwind upon sensing an odor patch and perform an extended search called casting when odor information vanishes. This surge-casting strategy is purely reactive, i.e. actions are completely determined by current perceptions (detection and non-detection events). Yet, its implementation on olfactory robots had limited success in the past because the detection of odor patches is hampered by the slowness of artificial gas sensors.
Metal-oxide sensors used in most of the olfactory robots have response and recovery times of several tens of seconds so that they generally filter out the concentration fluctuations encountered in turbulent plumes21. In contrast, the response time of insect chemoreceptors is much shorter, e.g., the rise time of insect electroantennograms (EAGs) is less than 50 msec22. Consequently, by using insect EAGs, odor pulses are resolved at frequencies of several Hertz23. This property makes EAG sensors well suited for the detection of odor filaments in natural plumes. We describe here a protocol for embedding insect EAGs on robots allowing for efficient olfactory searches using surge and casting strategies.
The protocol is based on a commercially available robot (see Materials table) and male moths (Agrotis ipsilon) with their sex pheromone. Yet, it can be adapted with minor modifications to other insect species, odorants, and robots.
1. Insects
2. Electrophysiology
3. Hardware Interface
4. Software Interface
The main threads contain a graphical user interface (GUI), methods for signal detection and various functions for controlling the robot.
The protocol described above was first tested with short 20 msec pulses of pheromone (dose 1 μg and 10 μg) directly puffed on the antenna. Figure 4A shows the EAGs in response to pheromone pulses. They are positive because the recording electrode was connected to the inverting input of the amplifier, as described in step 3.3. As indicated by the power spectrum, the measurement system is able to resolve pheromone pulses up to 10 Hz. For comparison, we also tested a commercially available gas sensor. The TGS2620 is a metal oxide sensor manufactured for the detection of solvent vapors. Although the sensor presents a high sensitivity to ethanol, it was unable to follow variations in concentration (see the dashed curve in Figure 4B). The problem came from the sensor housing. The TGS2620 is commercialized with a cap that has a flame-proof stainless steel gauze. The response time is slow because, in practice, it takes a certain time for the gas to diffuse through the gauze and reach the metal oxide surface. Recovery is also slow because it takes time to clean the sensor when the gas is trapped inside the cap. We therefore removed the cap and this modification improved the dynamics significantly (see the plain curve in Figure 4B). Still, there was a factor ten between the EAG and the TGS2620 (10 Hz versus 1 Hz). This comparison is nevertheless qualitative as the EAG and the TGS2620 were not tested in the same conditions.
We then assessed the stability over time of our whole-insect preparation (n = 12 moths) as compared to excised antennae (n = 7 antennae). The EAG was recorded periodically in response to pheromone stimulations (duration 500 msec, dose 1 μg). Raw EAGs (in mV) were converted to relative EAGs (percentages of initial value obtained at time t = 0). Figure 5 shows very good stability of our whole-insect preparation within a working day. In contrast, EAGs recorded on isolated antennae decrease rapidly over time so that the signal falls to one half of its initial value after only 1.5 hr. This time dependence is well described by an exponential decay with a lifetime of 2 hr.
Finally, we tested the ability of the EAG robotic plateform to search for an odor source (pheromone compound Z7-12:OAc) using a reactive search strategy (Figure 6A). The search strategy combines upwind surge every time the pheromone is detected with spiral casting in the absence of detections28. The presence of pheromone is detected from the EAG by the neuromorphic detector, as described in step 4.3. Two examples of EAG recorded during the search are shown in Figure 6B. Without the odor source, the EAG remains around zero (i.e. 2.5 V) with very few or no detections. The robot performs spiral casting and generally leaves the search space before reaching the target location (in 92% of the trials, n = 26 trials, Figure 6C right). With the odor source (Figure 6C left), the EAG presents bursts of activity (detections) intertwined with periods of silence (no detections). Spiral casting mainly occurs at the plume contour (Figure 6C left, red line) and appears to be an efficient strategy for relocating the plume centerline when the odor is lost. In this condition, the source is generally found (success rate = 96%, n = 44 trials).
Figure 1. Whole-insect EAG preparation and robotic setup. A) The electroantennogram (EAG) is recorded from a whole-insect preparation (see text for details). B) The preparation is mounted on the robot. Please click here to view a larger version of this figure.
Figure 2. Hardware-software interface. A) Eagle schematic of the hardware. The circuit consists of six sections (see text for details). It allows filtering (frequency band 0.1-500 Hz, notch at 50 Hz), amplification (total gain 250X) and signal conditioning in the range 0-5 V. B) Eagle layout showing lines of copper (the top is in red and the bottom in blue) and holes (in green). C) Printed circuit board (PCB) showing the discrete elements. D) Graphical user interface (GUI) written in Qt-C++ for data visualization (red trace = EAG input, green trace = neuron model output), filter design and signal detection. Please click here to view a larger version of this figure.
Figure 3. Signal detection from the EAG. A) Electroantennogram (EAG) model. The EAG is modeled by a nonlinear cascade27 that consists of a static nonlinearity followed by a 1st order low pass filter with exponential impulse function . The EAG output is given by the convolution integral with . B) Engineering approach. The deconvolution filter writes and , see text for details. Odor encounters (hits) are detected wheneverexceeds a predefined threshold. C) Bio-inspired approach. A Hodgkin–Huxley type neuron model with five internal currents (leak, K+, Na+, Ca2+ and SK) is used to reproduce the observed firing pattern of excitation-inhibition (E-I) observed experimentally13. For signal detection, the EAG signal is used as input current and hits are detected whenever a burst of excitation is followed by inhibition in the firing activity.
Figure 4. EAG response time. A) EAG recordings in response to 20 msec pheromone pulses (dose 1 μg and 10 μg) delivered at different rates (1, 2, 4, 6, 8, and 10 pulses/sec). The normalized EAG power spectrum is shown for a stimulus pulsed at 1 and 10 Hz (dose 1 μg and 10 μg). The EAG resolves individual pulses up to 10 Hz. B) Recordings from gas sensor TGS2620 in response to ethanol (fluctuating concentration). The dashed and plain curves are the sensor response with and without the cap, respectively. The sensor with the cap has a response time of tens of seconds and thus cannot follows the fluctuations in the gas concentration. The TGS2620 without cap resolves individual fluctuations up to 1 Hz. Please click here to view a larger version of this figure.
Figure 5. EAG stability (whole insect preparation vs excised antenna). The EAG was recorded every hour during 8 hr for the whole-insect preparation (n = 12 moths) and every 20 min during 3.2 hr for excised antennae (n = 7 antennae). The figure shows relative EAGs (percentages of initial value obtained at time t = 0). The time dependence for excised antennae is well fitted by an exponential decay with a lifetime of 2 hr (half-life of 1.5 hr).
Figure 6. Robotic experiments. A) The surge-casting strategy combines upwind surge in the presence of the odor with spiral casting in its absence28. B) Typical EAG recorded during the search while the robot is moving (with and without the odor). C) Robot trajectories with odor (n = 44 trials) and without odor (n = 26 trials). The red dashed line represents the plume contour where 90% of all detections occurred during the trials. Experimental conditions : search space = 4 m x 2.5 m, robot’s speed = 5.6 cm/sec, target = 10 μg of pheromone deposited on a paper filter and replaced every 2 trials, robot initial location = 2 m from target, wind velocity = 0.9 ± 0.2 m/sec at target location. Please click here to view a larger version of this figure.
Almost twenty years ago, Kanzaki and his colleagues pioneered the idea of using EAGs on olfactory robots29-30. Their technique was originally based on excised antennae. Here, we recorded from intact antennae to improve the sensitivity and the lifetime of the preparation. Other studies31-32 also noticed the superiority of whole-body preparations over isolated antennae. In our robotic experiments, we experienced stable recordings within a day. In contrast, EAGs recorded on isolated antennae have a lifetime of 2 hr (Figure 5).
Our EAG-robotic platform was primarily developed to test biological hypotheses about olfactory coding and search strategies in insects13. Similar to central neurons receiving input from insect antennae, we connected a neuron model to a real moth antenna on a robot and performed pheromone detection based on its firing pattern. Detection and non-detection events were then used to drive the robot toward the source of pheromone. The reactive search strategy considered here was inspired by the behavioral patterns of male moths attracted by a sex pheromone. It performed well in laboratory conditions (Figure 6), allowing the localization of a low emission source (pheromone dose of 10 μg in our case versus 10 mg in previous work24) in a relatively large search space (initial distance from source of 2 m versus 10 cm in previous experiments20-21).
These robotic experiments should be considered as a proof of concept showing that insect antennae are suitable for robotic olfactory searches. Although insect antennae are known to respond to toxic gases, drugs and explosives9-11, several extensions are needed for coping with real world applications. First, a more sophisticated search method34-36 may be more efficient at distances beyond 10 m, when the reacquisition of the plume becomes very unlikely. Second, it may be necessary to combine EAGs from different species in a bio-electronic nose configuration14 in order to detect odorants of interests. Third, stereo sensing capabilities obtained by recording from the two antennae of the same insect may prove beneficial in terms of effectiveness. Two sensors employed in parallel may indeed increase directionality. Fourth, extensions of the search strategy to collective robotic searches37 are ought to be considered for practical applications even if they are not biologically relevant in the case of moths.
The authors have nothing to disclose.
This work was funded by the state program Investissements d’avenir managed by ANR (grant ANR-10-BINF-05 ‘Pherotaxis’).
Name of Material/ Equipment | Company | Catalog Number | Comments/Description |
Agrotis ipsilon | PISC | moth | |
http://www-physiologie-insecte.versailles.inra.fr/indexenglish.php | |||
Robot Khepera III | K-team | Khe3Base + KorBotLE + KorWifi | |
www.k-team.com | |||
KoreIOLE | K-team | Input/output extension board | |
EAG-robot interface | LORIA | Custom-made hardware and software | |
www.loria.fr | |||
Sirene | LORIA | neuronal simulator sirene.gforge.inria.fr | |
Eagle | CadSoft www.cadsoftusa.com | PCB design software | |
Micromanipulator | Narishige / Bio-logic | UN-3C | |
Magnet base | Narishige/ Bio-logic | USM-6 | |
Adapter | Narishige/ Bio-logic | UX-6-6 | |
Rotule | Narishige/ Bio-logic | UPN-B | |
Micro scisors | MORIA / Phymep | 15371-92 | |
Stereo microscope Zeiss Stémi 2000 | Fisher Scientific | B19961 | |
Light source 20W KL200 | Fisher Scientific | W41745 | |
Narishige PC-10 Na PC-1 | Narishige | Narishige PC-10 | |
Capillaries Na PC-1 | Fisher scientific | C01065 | |
Pheromone cis-7-Dodecenyl acetate(Z7-12:OAc) | Sigma-Aldrich | 259829 | |
Pack of 3 pipettes | Eppendorf | 4910000514 | For pheromone dilution and deposition on paper filter |
2-20 µl/ 50-200 µl/ 100-1000 µl | |||
Gas sensor TGS2620 | Figaro www.figarosensor.com | Optional, for comparison with EAG | |
electrode puller | Narishige | PC-10 |