Prototype-Based Classifiers in the Presence of Concept Drift: A Modelling Framework

Michael Biehl*, Fthi Abadi, Christina Göpfert, Barbara Hammer

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

2 Citations (Scopus)
171 Downloads (Pure)

Abstract

We present a modelling framework for the investigation of prototype-based classifiers in non-stationary environments. Specifically, we study Learning Vector Quantization (LVQ) systems trained from a stream of high-dimensional, clustered data. We consider standard winner-takes-all updates known as LVQ1. Statistical properties of the input data change on the time scale defined by the training process. We apply analytical methods borrowed from statistical physics which have been used earlier for the exact description of learning in stationary environments. The suggested framework facilitates the computation of learning curves in the presence of virtual and real concept drift. Here we focus on time-dependent class bias in the training data. First results demonstrate that, while basic LVQ algorithms are suitable for the training in non-stationary environments, weight decay as an explicit mechanism of forgetting does not improve the performance under the considered drift processes.

Original languageEnglish
Title of host publicationAdvances in Self-Organizing Maps, Learning Vector Quantization, Clustering and Data Visualization
EditorsAlfredo Vellido, Karina Gibert, Cecilio Angulo, José David Martín Guerrero
PublisherSpringer
Pages210-221
Number of pages12
ISBN (Electronic)978-3-030-19642-4
ISBN (Print)978-3-030-19641-7
DOIs
Publication statusPublished - 2020

Publication series

NameAdvances in Intelligent Systems and Computing
PublisherSpringer
Volume976

Keywords

  • cs.LG
  • cond-mat.dis-nn
  • stat.ML

Cite this