TY - GEN
T1 - Multi-agent Based Manifold Denoising
AU - Mohammadi, Mohammad
AU - Bunte, Kerstin
N1 - Funding Information:
Acknowledgments. This project has received financial support from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No. 721463 to the SUNDIAL network.
Publisher Copyright:
© 2020, Springer Nature Switzerland AG.
PY - 2020/11/1
Y1 - 2020/11/1
N2 - Manifold learning plays a central role in many Machine Learning (ML) methods where it assumes information lies on a low-dimensional manifold, but the presence of high dimensional noise may defect their performance. In this contribution, we propose a novel (swarm) algorithm to suppress the noise of manifolds of potentially varying dimensionalities. Inspired by colonial insects this method employs multiple agents with different strategies moving through the data space in parallel. During this process, they use local information to reconstruct the manifolds and then move data objects close to them. Moreover, principles of evolutionary game theory are used to encourage agents to select better strategies and hence optimize the hyper-parameters automatically. While other denoising techniques can be seen as single-agent approaches, the new algorithm is a multi-agent approach which makes it more flexible and suitable for scenarios including multiple manifolds. In the experiments, we simulate several situations from a simple manifold with a specific noise level, to more complex manifolds where there are variations on the density, noise level or dimensionalities. Furthermore, we demonstrate the improvement of the proposed algorithm for the performance of the Parzen Window (PW) density estimator.
AB - Manifold learning plays a central role in many Machine Learning (ML) methods where it assumes information lies on a low-dimensional manifold, but the presence of high dimensional noise may defect their performance. In this contribution, we propose a novel (swarm) algorithm to suppress the noise of manifolds of potentially varying dimensionalities. Inspired by colonial insects this method employs multiple agents with different strategies moving through the data space in parallel. During this process, they use local information to reconstruct the manifolds and then move data objects close to them. Moreover, principles of evolutionary game theory are used to encourage agents to select better strategies and hence optimize the hyper-parameters automatically. While other denoising techniques can be seen as single-agent approaches, the new algorithm is a multi-agent approach which makes it more flexible and suitable for scenarios including multiple manifolds. In the experiments, we simulate several situations from a simple manifold with a specific noise level, to more complex manifolds where there are variations on the density, noise level or dimensionalities. Furthermore, we demonstrate the improvement of the proposed algorithm for the performance of the Parzen Window (PW) density estimator.
U2 - 10.1007/978-3-030-62365-4_2
DO - 10.1007/978-3-030-62365-4_2
M3 - Conference contribution
SN - 978-3-030-62365-4
T3 - Lecture Notes in Computer Science
SP - 12
EP - 24
BT - Intelligent Data Engineering and Automated Learning -- IDEAL 2020
A2 - Analide, Cesar
A2 - Novais, Paulo
A2 - Camacho, David
A2 - Yin, Hujun
PB - Springer
CY - Cham
T2 - 21st International Conference on Intelligent Data Engineering and Automated Learning
Y2 - 4 November 2020 through 6 November 2020
ER -