CentroidNetV2: A hybrid deep neural network for small-object segmentation and counting

Klaas Dijkstra*, Jaap van de Loosdrecht, Waatze A. Atsma, Lambert R. B. Schomaker, Marco A. Wiering

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

This paper presents CentroidNetV2, a novel hybrid Convolutional Neural Network (CNN) that has been specifically designed to segment and count many small and connected object instances. This complete redesign of the original CentroidNet uses a CNN backbone to regress a field of centroid-voting vectors and border-voting vectors. The segmentation masks of the individual object instances are produced by decoding centroid votes and border votes. A loss function that combines cross-entropy loss and Euclidean-distance loss achieves high quality centroids and borders of object instances. Several backbones and loss functions are tested on three different datasets ranging from precision agriculture to microbiology and pathology. CentroidNetV2 is compared to the state-of-the art networks You Only Look Once Version 3 (YOLOv3) and Mask Recurrent Convolutional Neural Network (MRCNN). On two out of three datasets CentroidNetV2 achieves the highest F1 score and on all three datasets CentroidNetV2 achieves the highest recall. CentroidNetV2 demonstrates the best ability to detect small objects although the best segmentation masks for larger objects are produced by MRCNN. (c) 2020 Elsevier B.V. All rights reserved.

Original languageEnglish
Pages (from-to)490-505
Number of pages16
JournalNeurocomputing
Volume423
DOIs
Publication statusPublished - 29-Jan-2021

Keywords

  • Deep Learning
  • Computer Vision
  • Convolutional Neural Networks
  • Object Detection
  • Instance Segmentation

Cite this