Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

T. Schoepe; D. Gutierrez-Galan; J. P. Dominguez-Morales; A. Jimenez-Fernandez; A. Linares-Barranco; E. Chicca

doi:10.1109/ISCAS45731.2020.9181257

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

T. Schoepe, D. Gutierrez-Galan, J. P. Dominguez-Morales, A. Jimenez-Fernandez, A. Linares-Barranco, E. Chicca

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

119 Downloads (Pure)

Abstract

The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.

Original language	English
Title of host publication	2020 IEEE International Symposium on Circuits and Systems (ISCAS)
Publisher	IEEE
Number of pages	1
ISBN (Electronic)	978-1-7281-3320-1
ISBN (Print)	978-1-7281-3321-8
DOIs	https://doi.org/10.1109/ISCAS45731.2020.9181257
Publication status	Published - 2020
Event	IEEE International Symposium on Circuits and Systems (ISCAS) 2020 - Seville, Spain Duration: 10-Oct-2020 → 21-Oct-2020

Conference

Conference	IEEE International Symposium on Circuits and Systems (ISCAS) 2020
Country/Territory	Spain
City	Seville
Period	10/10/2020 → 21/10/2020

Access to Document

10.1109/ISCAS45731.2020.9181257

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision AvoidanceFinal publisher's version, 629 KBLicence: Taverne

Handle.net

Persistent link

Cite this

@inproceedings{208b1fabe0864a1498d0c8e983d9ed48,

title = "Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance",

abstract = "The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.",

author = "T. Schoepe and D. Gutierrez-Galan and Dominguez-Morales, {J. P.} and A. Jimenez-Fernandez and A. Linares-Barranco and E. Chicca",

note = "Accepted; IEEE International Symposium on Circuits and Systems (ISCAS) 2020 ; Conference date: 10-10-2020 Through 21-10-2020",

year = "2020",

doi = "10.1109/ISCAS45731.2020.9181257",

language = "English",

isbn = "978-1-7281-3321-8",

booktitle = "2020 IEEE International Symposium on Circuits and Systems (ISCAS)",

publisher = "IEEE",

}

Schoepe, T, Gutierrez-Galan, D, Dominguez-Morales, JP, Jimenez-Fernandez, A, Linares-Barranco, A & Chicca, E 2020, Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance. in 2020 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, IEEE International Symposium on Circuits and Systems (ISCAS) 2020, Seville, Spain, 10/10/2020. https://doi.org/10.1109/ISCAS45731.2020.9181257

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance. / Schoepe, T.; Gutierrez-Galan, D.; Dominguez-Morales, J. P. et al.
2020 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, 2020.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Live Demonstration

T2 - IEEE International Symposium on Circuits and Systems (ISCAS) 2020

AU - Schoepe, T.

AU - Gutierrez-Galan, D.

AU - Dominguez-Morales, J. P.

AU - Jimenez-Fernandez, A.

AU - Linares-Barranco, A.

AU - Chicca, E.

N1 - Accepted

PY - 2020

Y1 - 2020

N2 - The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.

AB - The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.

U2 - 10.1109/ISCAS45731.2020.9181257

DO - 10.1109/ISCAS45731.2020.9181257

M3 - Conference contribution

SN - 978-1-7281-3321-8

BT - 2020 IEEE International Symposium on Circuits and Systems (ISCAS)

PB - IEEE

Y2 - 10 October 2020 through 21 October 2020

ER -

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

Abstract

Conference

Access to Document

Handle.net

Fingerprint

Cite this