The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges

Marco Frailis, Andrey Belikov, Kevin Benson, Andrea Bonchi, Christophe Dabin, Anne Ealet, Marco Fumana, Catherine Grenet, Mark Holliman, Gianmarco Maggio, Davide Maino, Henry J. McCracken, Martin Melchior, Antonello Piemonte, Gianluca Polenta, Maurice Poncet, Paolo Luigi Scala, Santiago Serrano, Owen Rees Williams

Research output: Chapter in Book/Report/Conference proceedingChapterAcademic

8 Downloads (Pure)

Abstract

The Science Ground Segment (SGS) of the Euclid mission provides distributed and redundant data storage and processing, federating nine Science Data Centres (SDCs) and a Science Operations Centre. The SGS reference architecture is based on loosely coupled systems and services, broadly organized into a common infrastructure of transverse software components and the scientific data Processing Functions. The SGS common infrastructure includes: 1) the Euclid Archive System (EAS), a central metadata repository which

inventories, indexes and localizes the huge amount of distributed data; 2) a Distributed Storage System of EAS, providing a unified view of the SDCs storage systems and supporting several transfer

protocols; 3) an Infrastructure Abstraction Layer, isolating the scientific data processing software from the underlying IT infrastructure and providing a common, lightweight workflow management system; 4) a Common Orchestration System, performing a balanced distribution of data and processing among the SDCs. Virtualization is another key element of the SGS infrastructure. We present the status of the Euclid SGS software infrastructure, the prototypes developed and the continuous system integration and testing performed through the Euclid “SGS Challenges”.
Original languageEnglish
Title of host publication.
EditorsMarco Molinaro, Keith Shortridge, Fabio Pasian
PublisherAstronomical Society of the Pacific
Pages612-615
Publication statusPublished - 2019
EventAstronomical Data Analysis Software and Systems XXVI ASP - Stazione Marittima Conference Centre, Trieste, Italy
Duration: 16-Oct-201620-Oct-2016

Publication series

NameASP Conference series
Volume521
ISSN (Print)1050-3390

Conference

ConferenceAstronomical Data Analysis Software and Systems XXVI ASP
Country/TerritoryItaly
CityTrieste
Period16/10/201620/10/2016

Cite this