Audio-based Swarming MAVs

Project Overview

Robots within an aerial swarm need to localize themselves and to obtain the relative position of their neighbouring robots. In the case of small, lightweight and safe Micro Air Vehicle (MAV) swarms there are not many technologies that could provide individuals with such information. The most common approaches are based on GPS sensors. However, GPS vulnerability is considered to be one of the main problems that need to be solved before allowing MAVs to operate in civilian airspace. Inspired by the sense of hearing in some animal groups, we hypothesize that using sound could offer a promising solution.

In this project, we have so far shown the success of an audio-based system for:

  • Relative positioning:

      Audio based Relative Positioning System for Multiple Micro Air Vehicle Systems, RSS 2013

  •  Self-Localization:

     Audio based Localization system for swarms of Micro Air Vehicles, ICRA 2014 

We furthermore showed that such a system could also be exploited to locate acoustic targets on the ground, such as the sound of an emergency whistle in a search and rescue mission.         

  •  Acoustic Target Localization

     Robust Acoustic Source Localization of Emergency Signals from Micro Air Vehicles, IROS 2012

Videos

Behaviour-based emergency source localization system

Emergency sound source localization system for fixed wing MAVs

Design of emergency sound-source and audio-based micro air vehicles for search and rescue applications

Audio based leader following behaviour for multiple micro aerial vehicles

Publications

Localization of emergency acoustic sources by micro aerial vehicles

M. Basiri; F. Schill; P. Lima; D. Floreano 

Journal of Field Robotics. 2017. Vol. 35, num. 2, p. 187-201. DOI : 10.1002/rob.21733.

On-Board Relative Bearing Estimation for Teams of Drones Using Sound

M. Basiri; F. S. Schill; P. Lima; D. Floreano 

IEEE Robotics and Automation Letters. 2016. Vol. 1, num. 2, p. 820-827. DOI : 10.1109/LRA.2016.2527833.

Distributed Formation Control of Fixed Wing Micro Aerial Vehicles for Uniform Area Coverage

M. Varga; M. Basiri; G. H. M. Heitz; D. Floreano 

2015. IEEE/RSJ International Conference on Intelligent Robots and Systems, Hamburg, Germany, p. 669-674. DOI : 10.1109/IROS.2015.7353444.

Audio-based Positioning and Target Localization for Swarms of Micro Aerial Vehicles

M. Basiri / D. Floreano; P. M. U. De Almeida Lima (Dir.)  

Lausanne, EPFL, 2015. 

Audio-based Localization for Swarms of Micro Air Vehicles

M. Basiri; F. S. Schill; D. Floreano; P. Lima 

2014. IEEE International Conference on Robotics and Automation (ICRA 2014), Hong Kong, China, May 31 – June 7, 2014. p. 4729-4734. DOI : 10.1109/ICRA.2014.6907551.

Audio-based Relative Positioning System for Multiple Micro Air Vehicle Systems

M. Basiri; F. Schill; D. Floreano; P. Lima 

2013. Robotics: Science and Systems RSS2013, Berlin, Germany, June 24-28, 2013.

Robust Acoustic Source Localization of Emergency Signals from Micro Air Vehicles

M. Basiri; F. S. Schill; P. Lima U.; D. Floreano 

2012. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Algarve, Portugal, October 7-12, 2012.. p. 4737-4742. DOI : 10.1109/IROS.2012.6385608.

Introduction

/* Style Definitions */ table.MsoNormalTable {mso-style-name:”Table Normal”; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:””; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin-top:0cm; mso-para-margin-right:0cm; mso-para-margin-bottom:10.0pt; mso-para-margin-left:0cm; line-height:115%; mso-pagination:widow-orphan; font-size:11.0pt; font-family:”Calibri”,”sans-serif”; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:”Times New Roman”; mso-bidi-theme-font:minor-bidi;}

v\:* {behavior:url(#default#VML);} o\:* {behavior:url(#default#VML);} w\:* {behavior:url(#default#VML);} .shape {behavior:url(#default#VML);}

/* Style Definitions */ table.MsoNormalTable {mso-style-name:”Table Normal”; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:””; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin-top:0cm; mso-para-margin-right:0cm; mso-para-margin-bottom:10.0pt; mso-para-margin-left:0cm; line-height:115%; mso-pagination:widow-orphan; font-size:11.0pt; font-family:”Calibri”,”sans-serif”; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:”Times New Roman”; mso-bidi-theme-font:minor-bidi; mso-fareast-language:EN-US;}

Teams of flying robots are preferred over single robots because of their ability to accomplish aerial coverage tasks more robustly and more efficiently. Tasks such as security patrolling or searching for victims in a disaster area can benefit from several autonomous robots operating in parallel instead of a single robot. In addition, using multiple robots allows for the use of cheap, light and safe “Micro Air Vehicles” (MAVs) for complex tasks which would otherwise require a single large and expensive platform. Finally, multiple robots can accomplish tasks beyond the capabilities of a single robot. 

https://jahia-prod.epfl.ch/files/content/sites/lis/files/images/research/ABSMAV/Picture1.pngRobots within an aerial swarm are required to interact with each other and to work together towards achieving a common goal. This introduces new problems such as collisions among robots and motion coordination. Drawing inspiration from natural swarms (e.g. flocking in birds and schooling in fishes), two key elements required for succesful motion coordination are:

/* Style Definitions */ table.MsoNormalTable {mso-style-name:”Table Normal”; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:””; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin-top:0cm; mso-para-margin-right:0cm; mso-para-margin-bottom:10.0pt; mso-para-margin-left:0cm; line-height:115%; mso-pagination:widow-orphan; font-size:11.0pt; font-family:”Calibri”,”sans-serif”; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:”Times New Roman”; mso-bidi-theme-font:minor-bidi; mso-fareast-language:EN-US;}

  • Relative positioning (knowledge of the relative position of other swarm members)
  • Distributed control  (local control actions resulting in a global swarm behavior)

A relative positioning system for a MAV needs to satisfy severe constraints in terms of size, weight, processing power, power consumption and 3D coverage. This makes the current relative positioning technologies used in ground robots not applicable to MAVs.

In nature, hearing is a key sensory input which allows animals to communicate with each other and localize each other. Taking inspiration from nature and considering the success of acoustic sensors in satisfying the imposed constraints of the MAVs, we hypothesize that an audio-based relative positioning system could be promising in obtaining collision avoidance and coordinated motion in a swarm of MAVs. We propose an approach where each robot detects and localizes the sound of other robots via its onboard acoustic sensors and tries to use this information to perform local actions resulting in the desired swarm behaviours. One behaviour we aim to accomplish during this project is the “Hear-and-Avoid” behaviour for achieving collision-free navigation in a swarm of MAVs.