Optimal Feature Search for Vigilance Estimation Using Deep Reinforcement Learning

Woojoon Seok, Minsoo Yeo, Jiwoo You, Heejun Lee, Taeheum Cho, Bosun Hwang, Cheolsoo Park*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

47 Downloads (Pure)

Abstract

A low level of vigilance is one of the main reasons for traffic and industrial accidents. We conducted experiments to evoke the low level of vigilance and record physiological data through single-channel electroencephalogram (EEG) and electrocardiogram (ECG) measurements. In this study, a deep Q-network (DQN) algorithm was designed, using conventional feature engineering and deep convolutional neural network (CNN) methods, to extract the optimal features. The DQN yielded the optimal features: two CNN features from ECG and two conventional features from EEG. The ECG features were more significant for tracking the transitions within the alertness continuum with the DQN. The classification was performed with a small number of features, and the results were similar to those from using all of the features. This suggests that the DQN could be applied to investigating biomarkers for physiological responses and optimizing the classification system to reduce the input resources.

Original languageEnglish
Article number142
Number of pages17
JournalElectronics world
Volume9
Issue number1
DOIs
Publication statusPublished - Jan-2020

Keywords

  • feature extraction
  • deep Q-network
  • electrocardiogram
  • electroencephalogram
  • optimal feature selection
  • vigilance estimation
  • NEURAL-NETWORKS
  • AUTOMATED DETECTION
  • DRIVER DROWSINESS
  • EEG
  • COMPONENTS
  • SLEEPINESS
  • VARIANCE
  • LEVEL

Cite this