This study introduces experimental protocols for a bio-hybrid odor-detecting drone based on silkmoth antennae. The operation of an experimental electroantennogram device with silkmoth antennae is presented, in addition to the structure of a bio-hybrid drone designed for odor source localization using the spiral-surge algorithm.
Small drones with chemical or biosensor devices that can detect airborne odorant molecules have attracted considerable attention owing to their applicability in environmental and security monitoring and search-and-rescue operations. Small drones with commercial metal-oxide-semiconductor (MOX) gas sensors have been developed for odor source localization; however, their real-time-odor-detection performance has proven inadequate. However, biosensing technologies based on insect olfactory systems exhibit relatively high sensitivity, selectivity, and real-time response with respect to odorant molecules compared to commercial MOX gas sensors. In such devices, excised insect antennae function as portable odorant biosensor elements and have been found to deliver excellent sensing performance. This study presents experimental protocols for odorant-molecule detection in the air using a small autonomous bio-hybrid drone based on a mountable electroantennography (EAG) device incorporating silkmoth antennae.
We developed a mountable EAG device including sensing/processing parts with a Wi-Fi module. The device was equipped with a simple sensor enclosure to enhance the sensor directivity. Thus, odor source localization was conducted using the spiral-surge algorithm, which does not assume an upwind direction. The experimental bio-hybrid odor-detecting drone identified real-time odorant-concentration differences in a pseudo-open environment (outside a wind tunnel) and localized the source. The developed drone and associated system can serve as an efficient odorant molecule-detection tool and a suitable flight platform for developing odor source localization algorithms owing to its high programmability.
With recent advances, small drones with chemical sensing devices have become highly applicable in environmental and security monitoring and gas-leak detection1. Small drones (with a diameter approximately < 20 cm) with commercial metal-oxide-semiconductor (MOX) gas sensors have been recently applied for performing odor mapping or odor source localization2,3,4. When searching for odor sources, a drone must trace odor plumes; however, odor source localization using small drones presents significant challenges. In an open environment, odor-plume structures are subjected to continual changes due to environmental factors such as the wind or landscape. Hence, drones should be capable of identifying odorant-concentration differences and directions varying over time; however, the odor detection performance of commercial MOX sensors is still inadequate for real-time sensing because of their slow recovery time5.
Bio-hybrid systems formed by the merging of biological and artificial systems are a recent trend in robotics and sensor technologies6, showing great potential for surpassing the capabilities of existing approaches. For instance, a bio-robotic sensor network has been developed based on cockroaches for application in disaster situations7. Experiments have been conducted in which cyborg rats with computationally enhanced intelligence were tasked with solving mazes8. The possibility of social integration of biomimetic robots into groups of real zebra fishes have been investigated9.
Naturally, this trend has been applied to develop odorant sensors10. For example, biosensors based on insect olfactory systems have relatively high sensitivity and selectivity with respect to various odorant molecules compared to existing MOX sensors11. Along these lines, we had previously developed bio-hybrid odorant biosensor systems based on a combination of insect cells expressing insect odorant receptors and a microscope or electronic devices12,13,14,15,16. Moreover, insect antennae can be independently used as portable odorant sensing parts with high sensitivity, selectivity, reproducibility, and quick response/recovery time, using the electroantennography (EAG) technique17,18,19. Several ground-mobile odor-sensing robots with EAG techniques based on insect antennae20,21,22,23 or small drones with EAG devices24,25 have been developed for odor detection and odor source localization. These robots displayed sensor sensitivity and real-time sensing ability. However, the mobility of ground mobile robots is significantly influenced by land features or obstacles. In addition, the flight performance and odor source localization algorithms of existing EAG-based bio-hybrid drones remain limited because experimental conditions have been limited to tethered flight24 or to being conducted in a small wind tunnel25.
This study presents experimental protocols for odor detection in the air and odor source localization using a recently developed bio-hybrid drone based on silkmoth (Bombyx mori) antennae26. We developed a mountable-sized and lightweight EAG device with a wireless communication function to detect the odor responses of silkmoth antennae. The EAG device was mounted on a small drone, installed in a simple sensor enclosure to enhance the sensor directivity for odorant molecules and reduce noise. The bio-hybrid drone reproducibly detected airborne odorant molecules and identified the maximum odorant concentration during spiral movements. Moreover, the drone localized the odor source using the spiral-surge algorithm without wind-direction information.
1. Insects
NOTE: Eggs of silkmoths (Bombyx mori) were purchased from a domestic company. The silkmoths were used within 10 days after they emerged from cocoons. Prepare three adult silkmoths for the experiments (six antennae); however, this number can be changed depending on the experimental requirements.
2. Odorants and odor source preparation
NOTE: The principal component of the female silkmoth sex pheromone, bombykol ((E,Z)-10,12-hexadecadien-1-ol), was used as an odor source to perform stimulation. A male silkmoth (Figure 1A) can identify and discriminate bombykol27, and isolated silkmoth antennae have been used to act as a biosensor on mobile robots20,21,22. Store purified bombykol dissolved in hexane (10 mg/mL) in a high-sealed storage bottle in a refrigerator at −30 °C.
3. EAG experiments on a fixed desk surface
NOTE: The mountable EAG device, which functions as a portable biosensor on a small drone, is shown in Figure 1B. The device included high-pass (0.1 Hz) and low-pass (300 Hz) filters. The detailed information of the electrical circuit is described in Terutsuki et al.26
4. Drone
NOTE: A commercial drone flight platform (98 mm x 93 mm x 41 mm; weight 87 g; maximum flight time 13 min) was used in this study. The payload of the drone was approximately 30 g based on the experiments. The drone was equipped with a vision positioning system (VPS) consisting of a camera and an infrared sensor under its body, which allowed for stable hovering without an external positioning system.
5. Flight experimental area preparation
6. EAG experiments on the drone
7. Sensor enclosure
8. Odor tracing demonstration using the bio-hybrid drone
9. Odor source localization using the bio-hybrid drone
This paper describes the protocols for signal measurements using the proposed EAG device mounted on a desk and drone. First, we evaluated the performance of the EAG device on a desk. A silkmoth antenna on the EAG device was stimulated by bombykol. Twenty-five continuous stimulations were conducted using 100 ng of bombykol dissolved in 50 µL of hexane with intervals of 5 s, as controlled by a microcontroller. The results indicated that the proposed EAG device reproducibly responded to the stimulations (Figure 5).
The odor detection performance of the EAG device was subsequently evaluated on the drone. The drone equipped with the EAG device hovered at the height of 95 cm from the floor and at a distance of 90 cm from the odor source (Figure 6A). By following the procedure described in section 6, the signals of the EAG device on the drone were measured relative to bombykol (50,000 ng in 250 µL of hexane/filter paper). The sensor performance of a commercial gas sensor on a drone was evaluated for comparison. A digital multi-pixel gas sensor28 was used to detect ethanol vapors. This sensor can be used for the detection of total volatile organic compounds (TVOCs).
According to the datasheet, the TVOC signal range of the sensor was 0-60,000 ppb. The drone with the gas sensor breakout board hovered under the same conditions as the EAG device. Moreover, 500 µL of ethanol (99.5% purity) was used as the odor source instead of bombykol. The typical signals of the EAG device and gas sensor on the drone are shown in Figure 6B. As the odorant molecules and sensor devices differed in this comparison, quantitative comparisons could not be performed. However, the experimental results suggest that it may be difficult for a drone with a commercial gas sensor to detect odorant molecules with a rapid response/recovery speed. In particular, the recovery time of the gas sensor in this study was significantly higher than that of the EAG device with silkmoth antennae.
We also evaluated the sensor directivity of the EAG device on the drone. In this study, the direction toward the odor source was defined as 0°, and the drone was rotated clockwise by 60° intervals to evaluate signal intensities at each angle. For the drone without a sensor enclosure, the signal intensity at 180°, while the drone faced in the opposite direction from the odor source, was occasionally higher than that at 0° (Figure 6C). However, for the drone equipped with the enclosure, the signal intensity of the EAG at 0° became higher than that at 180° (Figure 6D). Consequently, the sensor enclosure enhanced the sensor directivity of the EAG device on the drone.
An odor-tracing demonstration was conducted using the bio-hybrid drone with the sensor enclosure. The results indicated that the drone detected bombykol in the air outside a wind tunnel and identified the direction of the odor plume by pivoting movements (Figure 7, Supplemental Video S1). Finally, odor source localization was conducted based on the spiral-surge algorithm using the bio-hybrid drone (Figure 8A). The drone was set at 270° from the odor source at the starting point. After hovering, the drone started searching for the maximum value of the signal intensity during clockwise or counterclockwise spiral movements. Then, the drone moved forward in the direction of the maximum value of the signal intensity. After repeating the odor-searching spiral and surge movements six times, the drone landed on the ground. The flowchart of the spiral-surge algorithm is described in Terutsuki et al.26
The trajectory, yaw angles, and EAG signals during the odor source localization are presented in Figure 8B–D. Figure 8D shows that the detection time, including response and recover times of the EAG device on the drone, was approximately 1 s. The drone autonomously modified its movement by searching for the maximum odor concentration during the spiral movements. Readers can view videos of the odor source localization by the bio-hybrid drone described by Terutsuki et al.26.
Figure 1: The silkmoth, EAG device, and odor stimulation system. (A) Image of a male silkmoth. (B) Image of the mountable EAG device for a small drone. (C) Image of the odor stimulation system with airflow directions. Abbreviation: EAG = electroantennography. Please click here to view a larger version of this figure.
Figure 2: Isolation of silkmoth antenna. (A) Isolation of a silkmoth antenna using postmortem scissors. (B) Typical isolated silkmoth antenna. (C) Enlarged view of an isolated silkmoth antenna; scale bar = 0.5 mm. Please click here to view a larger version of this figure.
Figure 3: EAG device set up and GUI. (A) Installation of an isolated silkmoth antenna on the electrodes of the EAG device using gel. (B) Setup for odor stimulation using the EAG device on the desk. (C) The GUI for the experiments. Abbreviations: EAG = electroantennography; GUI = graphical user interface. Please click here to view a larger version of this figure.
Figure 4: Bio-hybrid drone. (A) Bio-hybrid drone based on a silkmoth antenna. (B) Bio-hybrid drone with the sensor enclosure. (C) Configuration of the bio-hybrid drone. Scale bars (A, B) = 50 mm. Abbreviation: CFRP = carbon fiber-reinforced plastic. Please click here to view a larger version of this figure.
Figure 5: Typical continuous response profile of the EAG device on the desk stimulated by bombykol. Abbreviation: EAG = electroantennography. Please click here to view a larger version of this figure.
Figure 6: Experimental environment of the bio-hybrid drone and signal intensity of the EAG device. (A) Image of the experimental environment with the bio-hybrid drone, which autonomously hovered 95 cm above the ground at a distance of 90 cm from the odor source. (B) Comparison between the typical signals of the EAG device and commercial gas sensor on the drone. (C) Typical signal intensity of the EAG device without equipping the sensor enclosure on the drone at each angle (N = 1). (D) Average signal intensity of the EAG device with the enclosure on the drone at each angle (N = 3; individual tests). The unit of the signal intensities is V. C and D have been modified from Terutsuki et al.26. Abbreviations: EAG = electroantennography; TVOC = total volatile organic compounds. Please click here to view a larger version of this figure.
Figure 7: Manual odor stimulation to demonstrate detection and tracing of odor in a room by the bio-hybrid drone. Please click here to view a larger version of this figure.
Figure 8: Odor source localization by the bio-hybrid drone. (A) Viewpoint from the ceiling camera of the flight area of the bio-hybrid drone. (B) Typical flight trajectory, (C) yaw angles, and (D) EAG signal intensities during odor source localization using the spiral-surge algorithm. These figures are representative results (N=1). A–D have been modified from Terutsuki et al.26. Please click here to view a larger version of this figure.
Supplemental Video S1: Demonstration of manual odor stimulation using the bio-hybrid drone. Please click here to download this Video.
Mobile robots with EAG devices were first developed 25 years ago20. Since then, there have been significant advancements in robotic technologies, including drones. Considering these technological advancements, we developed an autonomous bio-hybrid drone with an EAG device based on a silkmoth antenna for odor detection and localization in air26. This study demonstrates the operation of the developed bio-hybrid drone and the tracing of manual stimulation of odors in a room using the drone.
In this study, as silkmoth antennae were attached to electrodes using electrically conductive gel, we verified that both ends of each antenna made contact with the electrodes securely before beginning EAG experiments on the desk or the drone. If signals from the EAG device were suddenly lost during the experiment, a researcher would first check the connection of the antenna with the electrodes. It is possible that this problem occurred with a higher probability in the EAG experiments on the drone. While the lifespan of isolated silkmoth antennae is more than an hour, because the gel dried out in a dozen to dozens of minutes in this study, the addition of gel to the connecting points of the antennae and the electrodes may help recover signal intensities.
The drone in this study was equipped with the VPS comprising a camera and an infrared sensor for flight stabilization. We found that the drone drifted during hovering on a smooth floor, which may have caused the instability of an infrared sensor under the body of the drone. The same problem sometimes arose when experiments were conducted using this drone in a room with a smooth floor such as tile. Therefore, we covered the floor with raised carpets (we used four-color carpets of 45 cm × 45 cm area) and reduced the drift of the drone. This process was found to be useful for flight stabilization of the EAG experiments on the drone.
The significance of the bio-hybrid drone in this study lies in its ability to recognize odor concentration and its sensor directivity toward odor sources. The drone identified real-time odorant-concentration differences outside a wind tunnel and localized the source using the spiral-surge algorithm (Figure 8). The spiral-surge algorithm29,30 does not require plume-location information during plume reacquisition and exhibits its relatively high reliability, compared to that of the casting algorithm, in a low-speed laminar flow30. This algorithm was previously installed on a ground mobile robot30; however, a wind direction sensor was required to recognize the upwind direction. Odor information was binarized, and concentration was ignored.
For the insect antenna-based drone, mounting additional sensors, such as wind sensors, is a trade-off between payload and battery consumption. In addition, odor information detected by the EAG on the drone was still assessed to determine whether it exceeded a threshold25. The bio-hybrid drone design used in this study enhanced the directivity of the EAG device itself and did not require a wind direction sensor. The sensor directivity enabled the drone to utilize odor concentration information during spiral movements in a room environment that was more complex than a wind tunnel. A cylindrical enclosure was used in this study; however, a more elaborate and lightweight enclosure should be developed in the future.
However, the bio-hybrid drone examined in this study has some limitations. For example, the distance of odor source localization was still limited. Owing to their high mobility, drones should be capable of searching for odors over long distances in the order of several tens of meters. However, the distance achieved by the insect antenna-based bio-hybrid drone was limited to 2 m26, and odor source localization tests were conducted in a wind tunnel with limited space25. Extending the searching distance is essential for the development of a practical odor-detecting flight platform.
For long-distance searches (over 10 m), a high sensor directivity and an efficient odor source localization algorithm are required, given that dilution of the odor concentration and complex distribution of the odor plume are expected. Stereo sensing using two antennae of the same insect can increase directionality23. Most odor source localization experiments using small drones with commercial gas sensors were conducted using a single sensor, and an EAG device array on drones was not conducted. Therefore, an EAG device array must be developed for small drones to increase their odor-sensing-application potential. The EAG device array would also facilitate the development of an efficient odor source localization algorithm as it allows for more precise localization of an odor plume.
Insect antenna-based bio-hybrid odor-detecting drones contribute to both fundamental and applied research. From the perspective of fundamental research, such drones can be used as test platforms to develop odor source localization algorithms. Various algorithms have been previously proposed31; however, test platforms using a mobile robot that conducted two-dimensional odor searches or commercial gas sensors have exhibited limited performance. In these setups, it is difficult for proposed algorithms to demonstrate their performance. The bio-hybrid drone in this study demonstrated odor concentration recognition ability as well as sensor directivity, sensitivity, and selectivity. Therefore, it shows great promise for installation in more advanced or three-dimensional odor source localization algorithms.
In terms of applications, bio-hybrid drones can be deployed on missions that living animals may have difficulty approaching, such as detecting toxic chemical/biological leaks, explosive materials, and search-and-rescue operations. To apply such drones to these missions, the insect antennae need to detect odorant molecules included in target odor sources. Silkmoth antennae can be genetically modified32 to have the potential to detect odorant molecules other than the female silkmoth sex pheromone; thus, these applications are now becoming reality.
The authors have nothing to disclose.
This work was supported in part by a research grant from The Murata Science Foundation. The authors would like to acknowledge Smart Robotics Co., Ltd., Tokyo, Japan, for assisting in the development of the drone platforms and programming and Assist Technology Co., Ltd., Osaka, Japan, for assisting with the design of the electronic circuits. The authors would also like to thank Dr. Shigeru Matsuyama (Graduate School of Life and Environmental Sciences, University of Tsukuba) for providing purified bombykol; Mr. Takuya Nakajo (RCAST, The University of Tokyo) for support for silkmoth breeding; and Mr. Yusuke Notomi (Graduate School of Science and Technology, Tokyo University of Science) for supporting the acquisition of silkmoth images.
Anemometer | MK Scientific, Kanagawa, Japan | DT-8880 | |
Circulator | IRIS OHYAMA Inc., Miyagi, Japan | PCF-SC15T | |
Compact air pump | AS ONE Corporation, Osaka, Japan | NUP-1 | |
Drone | Shenzhen Ryze Tech Co., Ltd. | Tello EDU | Ryze Tech opens Tello EDU SDK. Our source code is based on SDK 2.0 Use Guide. https://dl-cdn.ryzerobotics.com/downloads/Tello/Tello%20SDK%202.0%20User%20Guide.pdf You can download python code (Tello3.py.) and develop flight programs. |
EAG device | Custom made | The EAG device has custom software to measure signals and communicate with the PC. | |
Electrically conductive gel | Parker Laboratories, NJ, USA | Spectra 360 | |
Ethanol | FUJIFILM Wako Pure Chemical Corporation, Ltd., Osaka, Japan | 057-00456 | |
Flowmeter | KOFLOC, Kyoto, Japan | RK1600R-12-B-Air-20 | |
Gas sensor | Sensirion AG, Stäfa, Switzerland | SGP30 | SGP30 breakout board can be used. You can refer the Adafruit_SGP30 github library. https://github.com/adafruit/Adafruit_SGP30 |
High-sealed storage bottle | FUJIFILM Wako Pure Chemical Corporation, Ltd., Osaka, Japan | 290-35731 | |
Microcontroller | M5Stack, Shenzhen, China | M5StickC | |
Purebred silkworm diet | Nosan Corporation Life Tech Department, Kanagawa, Japan | Sausage type | |
Silkmoth | Ueda-sansyu, Nagano, Japan | a hybrid strain of Kinshu × Showa | |
Solenoid valve | Takasago Electric, Inc., Nagoya, Japan | YDV-3-1/8 | |
Wi-Fi access point | Yamaha Corporation, Shizuoka, Japan | WLX313 |