Three-dimensional multi-source localization of underwater objects using convolutional neural networks for artificial lateral lines

Ben J Wolf*, Jos van de Wolfshaar, Sietse M van Netten

*Bijbehorende auteur voor dit werk

OnderzoeksoutputAcademicpeer review

12 Citaten (Scopus)
111 Downloads (Pure)


This research focuses on the signal processing required for a sensory system that can simultaneously localize multiple moving underwater objects in a three-dimensional (3D) volume by simulating the hydrodynamic flow caused by these objects. We propose a method for localization in a simulated setting based on an established hydrodynamic theory founded in fish lateral line organ research. Fish neurally concatenate the information of multiple sensors to localize sources. Similarly, we use the sampled fluid velocity via two parallel lateral lines to perform source localization in three dimensions in two steps. Using a convolutional neural network, we first estimate a two-dimensional image of the probability of a present source. Then we determine the position of each source, via an automated iterative 3D-aware algorithm. We study various neural network architectural designs and different ways of presenting the input to the neural network; multi-level amplified inputs and merged convolutional streams are shown to improve the imaging performance. Results show that the combined system can exhibit adequate 3D localization of multiple sources.

Originele taal-2English
TijdschriftJournal of the Royal Society Interface
Nummer van het tijdschrift162
StatusPublished - jan.-2020

Citeer dit