Pattern-based serverless data processing pipelines for Function-as-a-Service orchestration systems

Anil Mathew, Vasilios Andrikopoulos*, Frank J. Blaauw, Dimka Karastoyanova

*Corresponding author voor dit werk

OnderzoeksoutputAcademicpeer review

63 Downloads (Pure)

Samenvatting

The serverless cloud computing execution model presents an opportunity for implementing data processing pipelines in a cost efficient manner with minimum or no consideration about managing their operational aspects. In doing so, however, a major concern that emerges is the adoption of provider-specific languages required for orchestrating serverless functions and supporting services into the higher order logic of pipelines. As a result, the vendor lock-in problem inherent to cloud computing becomes further intensified. In this work we propose an approach to mitigate this issue through the adoption and adaptation of well-known patterns from the literature as the means for modeling the pipeline logic. By providing mappings from these patterns to vendor-specific orchestration language constructs we allow for efficient realization of provider-agnostic pipeline models as provider-specific executable workflows. An industrial case study provides evidence towards the suitability of our proposal for practical purposes.

Originele taal-2English
Pagina's (van-tot)87-100
Aantal pagina's14
TijdschriftFuture generation computer systems
Volume154
Vroegere onlinedatum6-jan.-2024
DOI's
StatusPublished - mei-2024

Vingerafdruk

Duik in de onderzoeksthema's van 'Pattern-based serverless data processing pipelines for Function-as-a-Service orchestration systems'. Samen vormen ze een unieke vingerafdruk.

Citeer dit