DR. -ING. GABRIELE CAVALLARO

Deputy Head High Productivity Data Processing Joint Research Group
Jülich Supercomputing Centre | University of Bonn | University of Iceland | The Chair of the IEEE GRSS Working Group High Performance and Disruptive Computing in Remote Sensing
Let's connect on LinkedIn!

Welcome to my personal website, where you can find my latest research, teaching tools and news.


Coming from Italy, I graduated in telecommunications with the University of Trento, where I received both my Bachelor's and Master's degree.

I decided to do my Erasmus stay with the University of Iceland, in the end staying for longer than three years and earning the title of PhD.

Since then, I've been a research assistant at JSC - Jülich Supercomputing Centre. My area of expertise is Remote Sensing (RS), High Performance Computing (HPC), and Machine Learning (ML).

You can contact me at
g.cavallaro@fz-juelich.de

RESEARCH

Remote Sensing

Earth Observation has evolved dramatically in the last decades due to the technological advances incorporated into remote sensing instruments in the optical and microwave domains. Remote sensing data are now used in a wide-range of applications, aimed at monitoring and implementing new policies in the fields of agriculture, assessment of environmental resources, urban planning, defense, disaster management, etc.

Machine (Deep) Learning

Machine (deep) learning for big Earth Observation applications is going through a major revolution due to the unique convergence of easy access to large volumes of open remote sensing data and the large-scale computing capability.

HPC

Due to the insufficient memory size and number of cores available in commodity computers on the one hand and on the other hand the increasing number of applications that require data computing in near real time (i.e., supporting decision-makers), remote sensing data processing pipelines necessitate the use of algorithms that can run and scale on High-Performance Computing systems.

REMOTE SENSING

TALKS

Here you can find my recent talks.

All talks

EuroCC Quantum Computing Mentoring Path (First Workshop)
09 November, 2021

Quantum Support Vector Machine Algorithms

Recent developments in Quantum Computing have paved the way for an enhancement of computing capabilities. Quantum Machine Learning (QML) aims at developing Machine Learning (ML) models specifically designed for quantum computers. The availability of the first quantum processors enabled further research, in particular the exploration of possible practical applications of QML algorithms. This presentation will introduce two different quantum formulations of the Support Vector Machine algorithm. Their performance and limitations will be presented for a binary classification problem based on satellite images.

Learn more
IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
2021

Quantum Support Vector Machine Algorithms for Remote Sensing Data Classification

Quantum formulations of the Support Vector Machine (SVM) algorithm are presented with their implementation using existing quantum technologies.

Learn more
IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
2021

Practice and Experience in using Parallel and Scalable Machine Learning in Remote Sensing from High Performance Computing over Cloud to Quantum Computing

This presentation reviews recent advances in High-Performance Computing, Cloud Computing, and Quantum Computing applied to Remote Sensing problems.

Learn more

TEACHING

Download my latest teaching materials

All courses

Università degli Studi del Sannio di Benevento
2021

Artificial Intelligence for Earth Observation powered by High Performance Computing and Quantum Computing

This course introduces cutting-edge HPC systems and emerging quantum computing technologies for Machine Learning (ML) and DL methods to address EO applications that deal with large and complex RS datasets.

Learn more
IEEE International Geoscience and Remote Sensing Symposium (IGARSS)
July 10-11, 2021

Scalable Machine Learning with High Performance and Cloud Computing

This tutorial introduces students to cutting-edge HPC systems and cloud computing technologies for Machine Learning and Deep Learning methods to address Earth Observation applications that deal with large and complex Remote Sensing datasets.

Learn more
University of Iceland
20/10/2020

Deep Learning driven by Big Data

Invited lecture on ''Deep Learning driven by Big Data'' in the Cloud Computing and Big Data course at the University of Iceland. The lecture first introduces to the limitations of a linear perceptron model and how Artificial Neural Networks (ANNs) can solve non-linearly separable data sets. Then, it explains how Convolutional Neural Networks (CNNs) can solve image recognition tasks. Finally it is demonstrates how to tune the parameters of the networks with the backpropagation algorithm.

Learn more

NEWS AND JOBS

Here you can find recent events and news.

All news and positions

IGARSS (Kuala Lumpur, Malaysia)
2022

Special session on ''Novelty Detection and Lifelong Learning for Robust Performance Under Ever-Changing Conditions''

This special session is for contributions with detection and lifelong learning approaches that tackle remote sensing applications

More information
IGARSS (Brussels, Belgium)
July 2021

Special session on ''Data Intensive Computing for Remote Sensing''

This special session collects papers in the most advanced and trendy areas interested in exploiting new high-performance and distributed computing technologies and algorithms to expedite the processing and analysis of big remote sensing data.

More information
IEEE JSTARS
May-November 2021

Special Issue on "Advances in Pattern Recognition in Remote Sensing"

Following the success of the 11th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS 2020), this special issue is to provide an updated snapshot of recent advances in the use of pattern recognition techniques to address the challenges in new-generation remote sensing data.

More information

PUBLICATIONS

Read my latest publications

All conference papers

CONFERENCE PAPERS
Practice and Experience in using Parallel and Scalable Machine Learning with Heterogenous Modular Supercomputing Architectures

2021

M. Riedel, R. Sedona, C. Barakat, P. Einarsson, R. Hassanian, G. Cavallaro, M. Book, H. Neukirchen and A. Lintermann

Proceedings of the IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)

Abstract

We observe a continuously increased use of Deep Learning (DL) as a specific type of Machine Learning (ML) for data-intensive problems (i.e., ’big data’) that requires powerful computing resources with equally increasing performance. Consequently, innovative heterogeneous High-Performance Computing (HPC) systems based on multi-core CPUs and many-core GPUs require an architectural design that addresses end user communities’ requirements that take advantage of ML and DL. Still the workloads of end user communities of the simulation sciences (e.g., using numerical methods based on known physical laws) needs to be equally supported in those architectures. This paper offers insights into the Modular Supercomputer Architecture (MSA) developed in the Dynamic Exascale Entry Platform (DEEP) series of projects to address the requirements of both simulation sciences and data-intensive sciences such as High Performance Data Analytics (HPDA). It shares insights into implementing the MSA in the Jülich Supercomputing Centre (JSC) hosting Europe No. 1 Supercomputer Jülich Wizard for European Leadership Science (JUWELS). We augment the technical findings with experience and lessons learned from two application communities case studies (i.e., remote sensing and health sciences) using the MSA with JUWELS and the DEEP systems in practice. Thus, the paper provides details into specific MSA design elements that enable significant performance improvements of ML and DL algorithms. While this paper focuses on MSA-based HPC systems and application experience, we are not losing sight of advances in Cloud Computing (CC) and Quantum Computing (QC) relevant for ML and DL.

Quantum Support Vector Machine Algorithms for Remote Sensing Data Classification

2021

A. Delilbasic, G. Cavallaro, M. Willsch, F. Melgani, M. Riedel and K. Michielsen

Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS)

Abstract

Recent developments in Quantum Computing (QC) have paved the way for an enhancement of computing capabilities. Quantum Machine Learning (QML) aims at developing Machine Learning (ML) models specifically designed for quantum computers. The availability of the first quantum processors enabled further research, in particular the exploration of possible practical applications of QML algorithms. In this work, quantum formulations of the Support Vector Machine (SVM) are presented. Then, their implementation using existing quantum technologies is discussed and Remote Sensing (RS) image classification is considered for evaluation.

Practice and Experience in using Parallel and Scalable Machine Learning in Remote Sensing from HPC over Clouds to Quantum Computing

2021

M. Riedel, G. Cavallaro and J. A. Benediktsson

Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS)

Abstract

Using computationally efficient techniques for transforming the massive amount of Remote Sensing (RS) data into scientific understanding is critical for Earth science. The utilization of efficient techniques through innovative computing systems in RS applications has become more widespread in recent years. The continuously increased use of Deep Learning (DL) as a specific type of Machine Learning (ML) for dataintensive problems (i.e., ’big data’) requires powerful computing resources with equally increasing performance. This paper reviews recent advances in High-Performance Computing (HPC), Cloud Computing (CC), and Quantum Computing (QC) applied to RS problems. It thus represents a snapshot of the state-of-the-art in ML in the context of the most recent developments in those computing areas, including our lessons learned over the last years. Our paper also includes some recent challenges and good experiences by using Europeans fastest supercomputer for hyper-spectral and multi-spectral image analysis with state-of-the-art data analysis tools. It offers a thoughtful perspective of the potential and emerging challenges of applying innovative computing paradigms to RS problems.

JOURNALS

All journals

A High-Performance Multispectral Adaptation GAN for Harmonizing Dense Time Series of Landsat-8 and Sentinel-2 images

2021

R Sedona, C Paris, G Cavallaro, L Bruzzone, M Riedel

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (J-STARS)

Abstract

The combination of data acquired by Landsat-8 and Sentinel-2 Earth Observation (EO) missions produces dense Time Series (TSs) of multispectral images that are essential for monitoring the dynamics of land-cover and land-use classes across the Earth’s surface with high temporal resolution. However, the optical sensors of the two missions have different spectral and spatial properties, thus they require a harmonization processing step before they can be exploited in Remote Sensing (RS) applications. In this work, we propose a workflow based on a Deep Learning (DL) approach to harmonize these two products developed and deployed on an High-Performance Computing (HPC) environment. In particular, we use a multispectral Generative Adversarial Network (GAN) with a U-Net generator and a PatchGan discriminator to integrate existing Landsat-8 TSs with data sensed by the Sentinel-2 mission. We show a qualitative and quantitative comparison with an existing physical method (NASA Harmonized Landsat and Sentinel (HLS)) and analyze original and generated data in different experimental setups with the support of spectral distortion metrics. To demonstrate the effectiveness of the proposed approach, a crop type mapping task is addressed using the harmonized dense TS of images, which achieved an Overall Accuracy (OA) of 87.83% compared to 81.66% of the state-of-the-art method.

Exploration of Machine Learning Methods for the Classification of Infrared Limb Spectra of Polar Stratospheric Clouds

2020

R. Sedona, L. Hoffmann, R. Spang, G. Cavallaro, S. Griessbach, M. Höpfner, M. Book, M. Riedel

Atmospheric Measurement Techniques

Abstract

Polar stratospheric clouds (PSCs) play a key role in polar ozone depletion in the stratosphere. Improved observations and continuous monitoring of PSCs can help to validate and improve chemistry–climate models that are used to predict the evolution of the polar ozone hole. In this paper, we explore the potential of applying machine learning (ML) methods to classify PSC observations of infrared limb sounders. Two datasets were considered in this study. The first dataset is a collection of infrared spectra captured in Northern Hemisphere winter 2006/2007 and Southern Hemisphere winter 2009 by the Michelson Interferometer for Passive Atmospheric Sounding (MIPAS) instrument on board the European Space Agency's (ESA) Envisat satellite. The second dataset is the cloud scenario database (CSDB) of simulated MIPAS spectra. We first performed an initial analysis to assess the basic characteristics of the CSDB and to decide which features to extract from it. Here, we focused on an approach using brightness temperature differences (BTDs). From both the measured and the simulated infrared spectra, more than 10 000 BTD features were generated. Next, we assessed the use of ML methods for the reduction of the dimensionality of this large feature space using principal component analysis (PCA) and kernel principal component analysis (KPCA) followed by a classification with the support vector machine (SVM). The random forest (RF) technique, which embeds the feature selection step, has also been used as a classifier. All methods were found to be suitable to retrieve information on the composition of PSCs. Of these, RF seems to be the most promising method, being less prone to overfitting and producing results that agree well with established results based on conventional classification methods.

Remote Sensing Big Data Classification with High Performance Distributed Deep Learning

2019

R. Sedona, G. Cavallaro, J. Jitsev, A. Strube, M. Riedel, J. A. Benediktsson

Remote Sensing

Abstract

High-Performance Computing (HPC) has recently been attracting more attention in remote sensing applications due to the challenges posed by the increased amount of open data that are produced daily by Earth Observation (EO) programs. The unique parallel computing environments and programming techniques that are integrated in HPC systems are able to solve large-scale problems such as the training of classification algorithms with large amounts of Remote Sensing (RS) data. This paper shows that the training of state-of-the-art deep Convolutional Neural Networks (CNNs) can be efficiently performed in distributed fashion using parallel implementation techniques on HPC machines containing a large number of Graphics Processing Units (GPUs). The experimental results confirm that distributed training can drastically reduce the amount of time needed to perform full training, resulting in near linear scaling without loss of test accuracy.

Parallel Computation of Component Trees on Distributed Memory Machines

2018

M. Goetz, G. Cavallaro, T. Geraud, M. Book and M. Riedel

IEEE Transactions on Parallel and Distributed Systems (TPDS)

Abstract

Component trees are region-based representations that encode the inclusion relationship of the threshold sets of an image. These representations are one of the most promising strategies for the analysis and the interpretation of spatial information of complex scenes as they allow the simple and efficient implementation of connected filters. This work proposes a new efficient hybrid algorithm for the parallel computation of two particular component trees-the max- and min-tree-in shared and distributed memory environments. For the node-local computation a modified version of the flooding-based algorithm of Salembier is employed. A novel tuple-based merging scheme allows to merge the acquired partial images into a globally correct view. Using the proposed approach a speed-up of up to 44.88 using 128 processing cores on eight-bit gray-scale images could be achieved. This is more than a five-fold increase over the state-of-the-art shared-memory algorithm, while also requiring only one-thirty-second of the memory.

Integration of LiDAR and Hyperspectral Data for Land-cover Classification: A Case Study

2017

P. Ghamisi, G. Cavallaro, Dan, Wu, J. A. Benediktsson and A. Plaza

Computer Vision and Pattern Recognition

Abstract

In this paper, an approach is proposed to fuse LiDAR and hyperspectral data, which considers both spectral and spatial information in a single framework. Here, an extended self-dual attribute profile (ESDAP) is investigated to extract spatial information from a hyperspectral data set. To extract spectral information, a few well-known classifiers have been used such as support vector machines (SVMs), random forests (RFs), and artificial neural networks (ANNs). The proposed method accurately classify the relatively volumetric data set in a few CPU processing time in a real ill-posed situation where there is no balance between the number of training samples and the number of features. The classification part of the proposed approach is fully-automatic.

Automatic Attribute Profiles

2017

G. Cavallaro, N. Falco, M. D. Mura and J. A. Benediktsson

IEEE Transactions on Image Processing (TIP)

Abstract

Morphological attribute profiles are multilevel decompositions of images obtained with a sequence of transformations performed by connected operators. They have been extensively employed in performing multiscale and region-based analysis in a large number of applications. One main, still unresolved, issue is the selection of filter parameters able to provide representative and non-redundant threshold decomposition of the image. This paper presents a framework for the automatic selection of filter thresholds based on Granulometric Characteristic Functions (GCFs). GCFs describe the way that non-linear morphological filters simplify a scene according to a given measure. Since attribute filters rely on a hierarchical representation of an image (e.g., the Tree of Shapes) for their implementation, GCFs can be efficiently computed by taking advantage of the tree representation. Eventually, the study of the GCFs allows the identification of a meaningful set of thresholds. Therefore, a trial and error approach is not necessary for the threshold selection, automating the process and in turn decreasing the computational time. It is shown that the redundant information is reduced within the resulting profiles (a problem of high occurrence, as regards manual selection). The proposed approach is tested on two real remote sensing data sets, and the classification results are compared with strategies present in the literature.

All journals

CHAPTERS

All chapters

Remote Sensing Data Fusion: Markov Models and Mathematical Morphology for Multisensor, Multiresolution, and Multiscale Image Classification

Mathematical Models for Remote Sensing Image Processing

J. A. Benediktsson, G. Cavallaro, N. Falco, I. Hedhli, V. A. Krylov, G. Moser, S. B. Serpico and J. Zerubia

Mathematical Models for Remote Sensing Image Processing

Abstract

Current and forthcoming sensor technologies and space missions are providing remote sensing scientists and practitioners with an increasing wealth and variety of data modalities. They encompass multisensor, multiresolution, multiscale, multitemporal, multipolarization, and multifrequency imagery. While they represent remarkable opportunities for the applications, they pose important challenges to the development of mathematical methods aimed at fusing the information conveyed by the input multisource data. In this framework, the present chapter continues the discussion of remote sensing data fusion, which was opened in the previous chapter. Here, the focus is on data fusion for image classification purposes. Both methodological issues of feature extraction and supervised classification are addressed. On both respects, the focus is on hierarchical image models rooted in graph theory. First, multilevel feature extraction is addressed through the latest advances in Mathematical Morphology and attribute profile theory with respect to component trees and trees of shapes. Then, joint supervised classification of multisensor, multiscale, multiresolution, and multitemporal imagery is formulated through hierarchical Markov random fields on quad-trees. Examples of experimental results with data from current VHR optical and SAR missions are shown and analysed.

Analyzing Remote Sensing Images with Hierarchical Morphological Representations

Handbook of Pattern Recognition and Computer Vision, 5th edition

G. Cavallaro, M. Dalla Mura and J. A. Benediktsson

Handbook of Pattern Recognition and Computer Vision, 5th edition

Abstract

Very high resolution (VHR) images provide a detailed representation of the surveyed scene with a geometrical resolution that at present can be up to 30 cm (WorldView-3). One of the most promising strategy for the analysis and the interpretation of a scene relies on hierarchical representations of the spatial content of an image. The hierarchical structure of a tree is useful for gathering the heterogeneous characteristics of the objects among different spatial scales (i.e., from the pixel level up to the entire image). In the remote sensing literature, there are several contributions addressing the use of hierarchical representations in many tasks such as filtering, segmentation, classification, object detection, change detection, and considering different types of images (e.g., panchromatic, multispectral, hyperspectral). The structure of each representation can vary significantly and can be efficiently adopted for a specific remote sensing application. After providing an overview of the different hierarchical representations, this chapter focuses on the tree structures on which image filtering (here we consider morphological attribute filters) can be efficiently implanted. Particular attention is paid to the tree of shapes, which is an important morphological structure that represents images in a self-dual way. Moreover, the identification of structures with heterogeneous characteristics (i.e., scale and shape) can be effectively done when computing attribute filters in multi-scale architectures, for instance Self-Dual Attribute Profiles (SDAPs). In this chapter we focus on the use of multilevel filtering based on hierarchical representations of the image for land cover classification. In particular, the experimental results reported in the literature for the classification of SDAPs computed on remotely sensed images are presented. Since the effectiveness of SDAPs is strictly correlated to the set of the filter parameters selected for the filtering we report on a technique for the automatic selection on the filter's parameters in order to obtain a profile that is representative and a non-redundant.

Remote Sensing Data Fusion: Markov Models and Mathematical Morphology for Multisensor, Multiresolution, and Multiscale Image Classification

2018

J. A. Benediktsson, G. Cavallaro, N. Falco, I. Hedhli, V. A. Krylov, G. Moser, S. B. Serpico and J. Zerubia

Mathematical Models for Remote Sensing Image Processing

Abstract

Current and forthcoming sensor technologies and space missions are providing remote sensing scientists and practitioners with an increasing wealth and variety of data modalities. They encompass multisensor, multiresolution, multiscale, multitemporal, multipolarization, and multifrequency imagery. While they represent remarkable opportunities for the applications, they pose important challenges to the development of mathematical methods aimed at fusing the information conveyed by the input multisource data. In this framework, the present chapter continues the discussion of remote sensing data fusion, which was opened in the previous chapter. Here, the focus is on data fusion for image classification purposes. Both methodological issues of feature extraction and supervised classification are addressed. On both respects, the focus is on hierarchical image models rooted in graph theory. First, multilevel feature extraction is addressed through the latest advances in Mathematical Morphology and attribute profile theory with respect to component trees and trees of shapes. Then, joint supervised classification of multisensor, multiscale, multiresolution, and multitemporal imagery is formulated through hierarchical Markov random fields on quad-trees. Examples of experimental results with data from current VHR optical and SAR missions are shown and analysed.

Analyzing Remote Sensing Images with Hierarchical Morphological Representations

2016

G. Cavallaro, M. Dalla Mura and J. A. Benediktsson

Handbook of Pattern Recognition and Computer Vision, 5th edition

Abstract

Very high resolution (VHR) images provide a detailed representation of the surveyed scene with a geometrical resolution that at present can be up to 30 cm (WorldView-3). One of the most promising strategy for the analysis and the interpretation of a scene relies on hierarchical representations of the spatial content of an image. The hierarchical structure of a tree is useful for gathering the heterogeneous characteristics of the objects among different spatial scales (i.e., from the pixel level up to the entire image). In the remote sensing literature, there are several contributions addressing the use of hierarchical representations in many tasks such as filtering, segmentation, classification, object detection, change detection, and considering different types of images (e.g., panchromatic, multispectral, hyperspectral). The structure of each representation can vary significantly and can be efficiently adopted for a specific remote sensing application. After providing an overview of the different hierarchical representations, this chapter focuses on the tree structures on which image filtering (here we consider morphological attribute filters) can be efficiently implanted. Particular attention is paid to the tree of shapes, which is an important morphological structure that represents images in a self-dual way. Moreover, the identification of structures with heterogeneous characteristics (i.e., scale and shape) can be effectively done when computing attribute filters in multi-scale architectures, for instance Self-Dual Attribute Profiles (SDAPs). In this chapter we focus on the use of multilevel filtering based on hierarchical representations of the image for land cover classification. In particular, the experimental results reported in the literature for the classification of SDAPs computed on remotely sensed images are presented. Since the effectiveness of SDAPs is strictly correlated to the set of the filter parameters selected for the filtering we report on a technique for the automatic selection on the filter's parameters in order to obtain a profile that is representative and a non-redundant.