Multi-agent Based Manifold Denoising

Mohammad Mohammadi*, Kerstin Bunte

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Manifold learning plays a central role in many Machine Learning (ML) methods where it assumes information lies on a low-dimensional manifold, but the presence of high dimensional noise may defect their performance. In this contribution, we propose a novel (swarm) algorithm to suppress the noise of manifolds of potentially varying dimensionalities. Inspired by colonial insects this method employs multiple agents with different strategies moving through the data space in parallel. During this process, they use local information to reconstruct the manifolds and then move data objects close to them. Moreover, principles of evolutionary game theory are used to encourage agents to select better strategies and hence optimize the hyper-parameters automatically. While other denoising techniques can be seen as single-agent approaches, the new algorithm is a multi-agent approach which makes it more flexible and suitable for scenarios including multiple manifolds. In the experiments, we simulate several situations from a simple manifold with a specific noise level, to more complex manifolds where there are variations on the density, noise level or dimensionalities. Furthermore, we demonstrate the improvement of the proposed algorithm for the performance of the Parzen Window (PW) density estimator.
Original languageEnglish
Title of host publicationIntelligent Data Engineering and Automated Learning -- IDEAL 2020
EditorsCesar Analide, Paulo Novais, David Camacho, Hujun Yin
Place of PublicationCham
PublisherSpringer International Publishing
Pages12-24
Number of pages13
ISBN (Electronic)978-3-030-62365-4
ISBN (Print)978-3-030-62365-4
DOIs
Publication statusPublished - 1-Nov-2020
Event21st International Conference on Intelligent Data Engineering and Automated Learning: IDEAL 2020 - Guimarães, Portugal
Duration: 4-Nov-20206-Nov-2020

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume12490
ISSN (Print)0302-9743

Conference

Conference21st International Conference on Intelligent Data Engineering and Automated Learning
Country/TerritoryPortugal
CityGuimarães
Period04/11/202006/11/2020

Cite this