Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

T. Schoepe; D. Gutierrez-Galan; J. P. Dominguez-Morales; A. Jimenez-Fernandez; A. Linares-Barranco; E. Chicca

doi:10.1109/ISCAS45731.2020.9181257

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

T. Schoepe, D. Gutierrez-Galan, J. P. Dominguez-Morales, A. Jimenez-Fernandez, A. Linares-Barranco, E. Chicca

Onderzoeksoutput › Academic › peer review

120 Downloads (Pure)

Samenvatting

The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.

Originele taal-2	English
Titel	2020 IEEE International Symposium on Circuits and Systems (ISCAS)
Uitgeverij	IEEE
Aantal pagina's	1
ISBN van elektronische versie	978-1-7281-3320-1
ISBN van geprinte versie	978-1-7281-3321-8
DOI's	https://doi.org/10.1109/ISCAS45731.2020.9181257
Status	Published - 2020
Evenement	IEEE International Symposium on Circuits and Systems (ISCAS) 2020 - Seville, Spain Duur: 10-okt.-2020 → 21-okt.-2020

Conference

Conference	IEEE International Symposium on Circuits and Systems (ISCAS) 2020
Land/Regio	Spain
Stad	Seville
Periode	10/10/2020 → 21/10/2020

Toegang tot document

10.1109/ISCAS45731.2020.9181257

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision AvoidanceFinal publisher's version, 629 KBLicentie: Taverne

Handle.net

Permanente koppeling

Citeer dit

@inproceedings{208b1fabe0864a1498d0c8e983d9ed48,

title = "Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance",

abstract = "The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.",

author = "T. Schoepe and D. Gutierrez-Galan and Dominguez-Morales, {J. P.} and A. Jimenez-Fernandez and A. Linares-Barranco and E. Chicca",

note = "Accepted; IEEE International Symposium on Circuits and Systems (ISCAS) 2020 ; Conference date: 10-10-2020 Through 21-10-2020",

year = "2020",

doi = "10.1109/ISCAS45731.2020.9181257",

language = "English",

isbn = "978-1-7281-3321-8",

booktitle = "2020 IEEE International Symposium on Circuits and Systems (ISCAS)",

publisher = "IEEE",

}

Schoepe, T, Gutierrez-Galan, D, Dominguez-Morales, JP, Jimenez-Fernandez, A, Linares-Barranco, A & Chicca, E 2020, Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance. in 2020 IEEE International Symposium on Circuits and Systems (ISCAS). IEEE, IEEE International Symposium on Circuits and Systems (ISCAS) 2020, Seville, Spain, 10/10/2020. https://doi.org/10.1109/ISCAS45731.2020.9181257

TY - GEN

T1 - Live Demonstration

T2 - IEEE International Symposium on Circuits and Systems (ISCAS) 2020

AU - Schoepe, T.

AU - Gutierrez-Galan, D.

AU - Dominguez-Morales, J. P.

AU - Jimenez-Fernandez, A.

AU - Linares-Barranco, A.

AU - Chicca, E.

N1 - Accepted

PY - 2020

Y1 - 2020

N2 - The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.

AB - The brain is able to solve complex tasks in real time by combining different sensory cues with previously acquired knowledge. Inspired by the brain, we designed a neuromorphic demonstrator which combines auditory and visual input to find an obstacle free direction closest to the sound source. The system consists of two event-based sensors (the eDVS for vision and the NAS for audition) mounted onto a pan-tilt unit and a spiking neural network implemented on the SpiNNaker platform. By combining the different sensory information, the demonstrator is able to point at a sound source direction while avoiding obstacles in real time.

U2 - 10.1109/ISCAS45731.2020.9181257

DO - 10.1109/ISCAS45731.2020.9181257

M3 - Conference contribution

SN - 978-1-7281-3321-8

BT - 2020 IEEE International Symposium on Circuits and Systems (ISCAS)

PB - IEEE

Y2 - 10 October 2020 through 21 October 2020

ER -

Live Demonstration: Neuromorphic Sensory Integration for Combining Sound Source Localization and Collision Avoidance

Samenvatting

Conference

Toegang tot document

Handle.net

Vingerafdruk

Citeer dit