TY - JOUR
T1 - Pattern-based serverless data processing pipelines for Function-as-a-Service orchestration systems
AU - Mathew, Anil
AU - Andrikopoulos, Vasilios
AU - Blaauw, Frank J.
AU - Karastoyanova, Dimka
N1 - Publisher Copyright:
© 2023 The Author(s)
PY - 2024/5
Y1 - 2024/5
N2 - The serverless cloud computing execution model presents an opportunity for implementing data processing pipelines in a cost efficient manner with minimum or no consideration about managing their operational aspects. In doing so, however, a major concern that emerges is the adoption of provider-specific languages required for orchestrating serverless functions and supporting services into the higher order logic of pipelines. As a result, the vendor lock-in problem inherent to cloud computing becomes further intensified. In this work we propose an approach to mitigate this issue through the adoption and adaptation of well-known patterns from the literature as the means for modeling the pipeline logic. By providing mappings from these patterns to vendor-specific orchestration language constructs we allow for efficient realization of provider-agnostic pipeline models as provider-specific executable workflows. An industrial case study provides evidence towards the suitability of our proposal for practical purposes.
AB - The serverless cloud computing execution model presents an opportunity for implementing data processing pipelines in a cost efficient manner with minimum or no consideration about managing their operational aspects. In doing so, however, a major concern that emerges is the adoption of provider-specific languages required for orchestrating serverless functions and supporting services into the higher order logic of pipelines. As a result, the vendor lock-in problem inherent to cloud computing becomes further intensified. In this work we propose an approach to mitigate this issue through the adoption and adaptation of well-known patterns from the literature as the means for modeling the pipeline logic. By providing mappings from these patterns to vendor-specific orchestration language constructs we allow for efficient realization of provider-agnostic pipeline models as provider-specific executable workflows. An industrial case study provides evidence towards the suitability of our proposal for practical purposes.
KW - Enterprise integration patterns
KW - Function orchestration
KW - Function-as-a-Service (FaaS)
KW - Serverless
KW - Workflow patterns
UR - http://www.scopus.com/inward/record.url?scp=85183413305&partnerID=8YFLogxK
U2 - 10.1016/j.future.2023.12.026
DO - 10.1016/j.future.2023.12.026
M3 - Article
AN - SCOPUS:85183413305
SN - 0167-739X
VL - 154
SP - 87
EP - 100
JO - Future generation computer systems
JF - Future generation computer systems
ER -