Information systems playground-the target infrastructure: Scaling Astro-WISE into the petabyte range

Andrey N. Belikov, Fokke Dijkstra*, Hans Gankema, Jeroen B. A. N. van Hoof, Rick Koopman

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

5 Citations (Scopus)
36 Downloads (Pure)

Abstract

The Target infrastructure has been specially built as a storage and compute infrastructure for the information systems derived from Astro-WISE. This infrastructure will be used by several applications that collaborate in the area of information systems within the Target project. It currently consists of 10 PB of storage and thousands of computational cores. The infrastructure has been constructed based on the requirements of the applications. The storage is controlled by the Global Parallel File System of IBM. This file system takes care of the required flexibility by combining storage hardware with different characteristics into a single file system. It is also very scalable, which allows the system to be extended into the future, while replacing old hardware with new technology.

Original languageEnglish
Pages (from-to)367-389
Number of pages23
JournalExperimental Astronomy
Volume35
Issue number1-2
DOIs
Publication statusPublished - Jan-2013

Keywords

  • Astronomical databases
  • Image processing
  • Data processing infrastructure
  • Data storage

Cite this