ESA Big Data from Space (BiDS)

Challenges and Opportunities in the Adoption of High-performance Computing for Earth Observation Applications in the Exascale Era

2023

Abstract

High Performance Computing (HPC) enables precise analysis of large and complex Earth Observation (EO) datasets. However, the adoption of supercomputing in the EO community faces challenges from the increasing heterogeneity of HPC systems, limited expertise, and the need to leverage novel computing technologies. This paper explores the implications of exascale computing advancements and the inherent heterogeneity of HPC architectures. It highlights EU-supported projects optimizing software development and harnessing the capabilities of heterogeneous HPC configurations. Methodologies addressing challenges of modular supercomputing, large-scale Deep Learning (DL) models, and hybrid quantum-classical algorithms are presented, aiming to enhance the utilization of supercomputing in EO for improved research, industrial applications, and SME support.

Abstract

High Performance Computing (HPC) enables precise analysis of large and complex Earth Observation (EO) datasets. However, the adoption of supercomputing in the EO community faces challenges from the increasing heterogeneity of HPC systems, limited expertise, and the need to leverage novel computing technologies. This paper explores the implications of exascale computing advancements and the inherent heterogeneity of HPC architectures. It highlights EU-supported projects optimizing software development and harnessing the capabilities of heterogeneous HPC configurations. Methodologies addressing challenges of modular supercomputing, large-scale Deep Learning (DL) models, and hybrid quantum-classical algorithms are presented, aiming to enhance the utilization of supercomputing in EO for improved research, industrial applications, and SME support.

G. Cavallaro, R. Sedona, M. Riedel, A. Lintermann, K. Michielsen, "Challenges and Opportunities in the Adoption of High Performance Computing for Earth Observation Applications in the Exascale Era", in Proceedings of the 2023 conference on Big Data from Space (BiDS’23), pp. 25-28, 2023, https://data.europa.eu/doi/10.2760/46796‍

Conference proceedings

No items found.

Fotocredit: Patrick Weichmann

Previous talks