Accelerating the Performance of Data Analytics using Network-centric Processing

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

29 Downloads (Pure)

Abstract

Distributed execution of real-time data analytics such as event stream processing is the key to scalability, performance and reliable detection of situation changes. Although real-time analytics is highly I/O centric, existing methods supporting the efficient execution of data analytics functions mostly rely on traditional compute models that are available in data centers, e.g., CPU or GPU based processing models, but treat the network mainly as a blackbox.
However, with recent advance in software-defined networking (SDN) and the standardization of packet processing pipeline, data analytics functions can be offloaded to programmable switches and benefit from hardware acceleration in an easier and more flexible way than a decade ago.
In this paper we focus on the potential of in-network processing to enhance the performance of the overall real-time data analytics application. We aim to contribute to an (i) understanding on how in-network processing can accelerate real-time data analytics and (ii) assess what models of in-network computing can accelerate which event processing functions considering the limitations of network models compared to traditional compute models.
We motivate the potential and illustrate the research problems in the context of load balancing which is an important concept in the data-parallel execution of event processing systems.
Original languageEnglish
Title of host publicationThe 15th ACM International Conference on Distributed and Event-based Systems (DEBS '21), June 28-July 2, 2021, Virtual Event, Italy
PublisherACM New York, NY, USA
Chapter192-195
Number of pages4
ISBN (Electronic)978-1-4503-8555-8
DOIs
Publication statusAccepted/In press - 2021
EventDEBS'21: DEBS '21: The 15th ACM International Conference on Distributed and Event-based Systems - virtual event
Duration: 28-Jun-20212-Jul-2021

Conference

ConferenceDEBS'21
Period28/06/202102/07/2021

Keywords

  • Complex Event Processing (CEP)
  • In-network Computing
  • Data Plane Programming
  • P4

Cite this