The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges

Marco Frailis; Andrey Belikov; Kevin Benson; Andrea Bonchi; Christophe Dabin; Anne Ealet; Marco Fumana; Catherine Grenet; Mark Holliman; Gianmarco Maggio; Davide Maino; Henry J. McCracken; Martin Melchior; Antonello Piemonte; Gianluca Polenta; Maurice Poncet; Paolo Luigi Scala; Santiago Serrano; Owen Rees Williams

The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges

Marco Frailis, Andrey Belikov, Kevin Benson, Andrea Bonchi, Christophe Dabin, Anne Ealet, Marco Fumana, Catherine Grenet, Mark Holliman, Gianmarco Maggio, Davide Maino, Henry J. McCracken, Martin Melchior, Antonello Piemonte, Gianluca Polenta, Maurice Poncet, Paolo Luigi Scala, Santiago Serrano, Owen Rees Williams

Sterrenkunde

Onderzoeksoutput › Academic

28 Downloads (Pure)

Samenvatting

The Science Ground Segment (SGS) of the Euclid mission provides distributed and redundant data storage and processing, federating nine Science Data Centres (SDCs) and a Science Operations Centre. The SGS reference architecture is based on loosely coupled systems and services, broadly organized into a common infrastructure of transverse software components and the scientific data Processing Functions. The SGS common infrastructure includes: 1) the Euclid Archive System (EAS), a central metadata repository which

inventories, indexes and localizes the huge amount of distributed data; 2) a Distributed Storage System of EAS, providing a unified view of the SDCs storage systems and supporting several transfer

protocols; 3) an Infrastructure Abstraction Layer, isolating the scientific data processing software from the underlying IT infrastructure and providing a common, lightweight workflow management system; 4) a Common Orchestration System, performing a balanced distribution of data and processing among the SDCs. Virtualization is another key element of the SGS infrastructure. We present the status of the Euclid SGS software infrastructure, the prototypes developed and the continuous system integration and testing performed through the Euclid “SGS Challenges”.

Originele taal-2	English
Titel	.
Redacteuren	Marco Molinaro, Keith Shortridge, Fabio Pasian
Uitgeverij	Astronomical Society of the Pacific
Pagina's	612-615
Status	Published - 2019
Evenement	Astronomical Data Analysis Software and Systems XXVI ASP - Stazione Marittima Conference Centre, Trieste, Italy Duur: 16-okt.-2016 → 20-okt.-2016

Publicatie series

Naam	ASP Conference series
Volume	521
ISSN van geprinte versie	1050-3390

Conference

Conference	Astronomical Data Analysis Software and Systems XXVI ASP
Land/Regio	Italy
Stad	Trieste
Periode	16/10/2016 → 20/10/2016

Toegang tot document

The Euclid Science Ground Segment Distributed Infrastructure: System Integration and ChallengesFinal publisher's version, 974 KBLicentie: Taverne

https://ui.adsabs.harvard.edu/abs/2019ASPC..521..612F

Handle.net

Permanente koppeling

Citeer dit

Frailis, M., Belikov, A., Benson, K., Bonchi, A., Dabin, C., Ealet, A., Fumana, M., Grenet, C., Holliman, M., Maggio, G., Maino, D., McCracken, H. J., Melchior, M., Piemonte, A., Polenta, G., Poncet, M., Scala, P. L., Serrano, S., & Williams, O. R. (2019). The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges. In M. Molinaro, K. Shortridge, & F. Pasian (editors), . (blz. 612-615). (ASP Conference series; Vol. 521). Astronomical Society of the Pacific. https://ui.adsabs.harvard.edu/abs/2019ASPC..521..612F

@inbook{f25c1281ae17484fb199d1b2a6b88b42,

title = "The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges",

abstract = "The Science Ground Segment (SGS) of the Euclid mission provides distributed and redundant data storage and processing, federating nine Science Data Centres (SDCs) and a Science Operations Centre. The SGS reference architecture is based on loosely coupled systems and services, broadly organized into a common infrastructure of transverse software components and the scientific data Processing Functions. The SGS common infrastructure includes: 1) the Euclid Archive System (EAS), a central metadata repository which inventories, indexes and localizes the huge amount of distributed data; 2) a Distributed Storage System of EAS, providing a unified view of the SDCs storage systems and supporting several transfer protocols; 3) an Infrastructure Abstraction Layer, isolating the scientific data processing software from the underlying IT infrastructure and providing a common, lightweight workflow management system; 4) a Common Orchestration System, performing a balanced distribution of data and processing among the SDCs. Virtualization is another key element of the SGS infrastructure. We present the status of the Euclid SGS software infrastructure, the prototypes developed and the continuous system integration and testing performed through the Euclid “SGS Challenges”.",

author = "Marco Frailis and Andrey Belikov and Kevin Benson and Andrea Bonchi and Christophe Dabin and Anne Ealet and Marco Fumana and Catherine Grenet and Mark Holliman and Gianmarco Maggio and Davide Maino and McCracken, {Henry J.} and Martin Melchior and Antonello Piemonte and Gianluca Polenta and Maurice Poncet and Scala, {Paolo Luigi} and Santiago Serrano and Williams, {Owen Rees}",

year = "2019",

language = "English",

series = "ASP Conference series",

publisher = "Astronomical Society of the Pacific",

pages = "612--615",

editor = "Marco Molinaro and Keith Shortridge and Fabio Pasian",

booktitle = ".",

note = "Astronomical Data Analysis Software and Systems XXVI ASP ; Conference date: 16-10-2016 Through 20-10-2016",

}

Frailis, M, Belikov, A, Benson, K, Bonchi, A, Dabin, C, Ealet, A, Fumana, M, Grenet, C, Holliman, M, Maggio, G, Maino, D, McCracken, HJ, Melchior, M, Piemonte, A, Polenta, G, Poncet, M, Scala, PL, Serrano, S & Williams, OR 2019, The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges. in M Molinaro, K Shortridge & F Pasian (uitgave), .. ASP Conference series, vol. 521, Astronomical Society of the Pacific, blz. 612-615, Astronomical Data Analysis Software and Systems XXVI ASP , Trieste, Italy, 16/10/2016. <https://ui.adsabs.harvard.edu/abs/2019ASPC..521..612F>

TY - CHAP

T1 - The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges

AU - Frailis, Marco

AU - Belikov, Andrey

AU - Benson, Kevin

AU - Bonchi, Andrea

AU - Dabin, Christophe

AU - Ealet, Anne

AU - Fumana, Marco

AU - Grenet, Catherine

AU - Holliman, Mark

AU - Maggio, Gianmarco

AU - Maino, Davide

AU - McCracken, Henry J.

AU - Melchior, Martin

AU - Piemonte, Antonello

AU - Polenta, Gianluca

AU - Poncet, Maurice

AU - Scala, Paolo Luigi

AU - Serrano, Santiago

AU - Williams, Owen Rees

PY - 2019

Y1 - 2019

N2 - The Science Ground Segment (SGS) of the Euclid mission provides distributed and redundant data storage and processing, federating nine Science Data Centres (SDCs) and a Science Operations Centre. The SGS reference architecture is based on loosely coupled systems and services, broadly organized into a common infrastructure of transverse software components and the scientific data Processing Functions. The SGS common infrastructure includes: 1) the Euclid Archive System (EAS), a central metadata repository which inventories, indexes and localizes the huge amount of distributed data; 2) a Distributed Storage System of EAS, providing a unified view of the SDCs storage systems and supporting several transfer protocols; 3) an Infrastructure Abstraction Layer, isolating the scientific data processing software from the underlying IT infrastructure and providing a common, lightweight workflow management system; 4) a Common Orchestration System, performing a balanced distribution of data and processing among the SDCs. Virtualization is another key element of the SGS infrastructure. We present the status of the Euclid SGS software infrastructure, the prototypes developed and the continuous system integration and testing performed through the Euclid “SGS Challenges”.

AB - The Science Ground Segment (SGS) of the Euclid mission provides distributed and redundant data storage and processing, federating nine Science Data Centres (SDCs) and a Science Operations Centre. The SGS reference architecture is based on loosely coupled systems and services, broadly organized into a common infrastructure of transverse software components and the scientific data Processing Functions. The SGS common infrastructure includes: 1) the Euclid Archive System (EAS), a central metadata repository which inventories, indexes and localizes the huge amount of distributed data; 2) a Distributed Storage System of EAS, providing a unified view of the SDCs storage systems and supporting several transfer protocols; 3) an Infrastructure Abstraction Layer, isolating the scientific data processing software from the underlying IT infrastructure and providing a common, lightweight workflow management system; 4) a Common Orchestration System, performing a balanced distribution of data and processing among the SDCs. Virtualization is another key element of the SGS infrastructure. We present the status of the Euclid SGS software infrastructure, the prototypes developed and the continuous system integration and testing performed through the Euclid “SGS Challenges”.

M3 - Chapter

T3 - ASP Conference series

SP - 612

EP - 615

BT - .

A2 - Molinaro, Marco

A2 - Shortridge, Keith

A2 - Pasian, Fabio

PB - Astronomical Society of the Pacific

T2 - Astronomical Data Analysis Software and Systems XXVI ASP

Y2 - 16 October 2016 through 20 October 2016

ER -

The Euclid Science Ground Segment Distributed Infrastructure: System Integration and Challenges

Samenvatting

Publicatie series

Conference

Toegang tot document

Handle.net

Vingerafdruk

Citeer dit