Carbon emission-aware job scheduling for Kubernetes deployments

Tobias Piontek, Kawsar Haghshenas*, Marco Aiello

*Corresponding author voor dit werk

OnderzoeksoutputAcademicpeer review

14 Downloads (Pure)

Samenvatting

Decreasing carbon emissions of data centers while guaranteeing Quality of Service (QoS) is one of the major challenges for efficient resource management of large-scale cloud infrastructures and societal sustainability. Previous works in the area of carbon reduction mostly focus on decreasing overall energy consumption, replacing energy sources with renewable ones, and migrating workloads to locations where lower emissions are expected. These measures do not consider the energy mix of the power used for the data center. In other words, all KWh of energy are considered the same from the point of view of emissions, which is rarely the case in practice. In this paper, we overcome this deficit by proposing a novel practical CO2-aware workload scheduling algorithm implemented in the Kubernetes orchestrator to shift non-critical jobs in time. The proposed algorithm predicts future CO2 emissions by using historical data of energy generation, selects time-shiftable jobs, and creates job schedules utilizing greedy sub-optimal CO2 decisions. The proposed algorithm is implemented using Kubernetes’ scheduler extender solution due to its ease of deployment with little overheads. The algorithm is evaluated with real-world workload traces and compared to the default Kubernetes scheduling implementation on several actual scenarios.

Originele taal-2English
Pagina's (van-tot)549–569
Aantal pagina's21
TijdschriftJournal of supercomputing
Volume80
Vroegere onlinedatum27-jun.-2023
DOI's
StatusPublished - 2023

Vingerafdruk

Duik in de onderzoeksthema's van 'Carbon emission-aware job scheduling for Kubernetes deployments'. Samen vormen ze een unieke vingerafdruk.

Citeer dit