In the recent years, remote sensing has faced a huge evolution. The constantly growing availability of remote sensing data has opened up new opportunities and laid the foundations for many new challenges. The continuous space missions and new constellations of satellites allow in fact more and more frequent acquisitions, at increasingly higher spatial resolutions, and at an almost total coverage of the globe. The availability of such an huge amount data has highlighted the need for automatic techniques capable of processing the data and exploiting all the available information. Meanwhile, the almost unlimited potential of machine learning has changed the world we live in. Artificial neural Networks have break trough everyday life, with applications that include computer vision, speech processing, autonomous driving but which are also the basis of commonly used tools such as online search engines. However, the vast majority of such models are of the supervised type and therefore their applicability rely on the availability of an enormous quantity of labeled data available to train the models themselves. Unfortunately, this is not the case with remote sensing, in which the enormous amounts of data are opposed to the almost total absence of ground truth. The purpose of this thesis is to find the way to exploit the most recent deep learning techniques, defining a common thread between two worlds, those of remote sensing and deep learning, which is often missing. In particular, this thesis proposes three novel contributions which face current issues in remote sensing. The first one is related to multisensor image registration and combines generative adversarial networks and non-linear optimization of crosscorrelation-like functionals to deal with the complexity of the setting. The proposed method was proved able to outperform state of the art approaches. The second novel contribution faces one of the main issues in deep learning for remote sensing: the scarcity of ground truth data for semantic segmentation. The proposed solution combines convolutional neural networks and probabilistic graphical models, two very active areas in machine learning for remote sensing, and approximate a fully connected conditional random field. The proposed method is capable of filling part of the gap which separate a densely trained model from a weakly trained one. Then, the third approach is aimed at the classification of high resolution satellite images for climate change purposes. It consist of a specific formulation of an energy minimization which allows to fuse multisensor information and the application a markov random field in a fast and efficient way for global scale applications. The results obtained in this thesis shows how deep learning methods based on artificial neural networks can be combined with statistical analysis to overcome their limitations, going beyond the classic benchmark environments and addressing practical, real and large-scale application cases.

Deep Learning and Advanced Statistical Methods for Domain Adaptation and Classification of Remote Sensing Images

MAGGIOLO, LUCA
2022-03-03

Abstract

In the recent years, remote sensing has faced a huge evolution. The constantly growing availability of remote sensing data has opened up new opportunities and laid the foundations for many new challenges. The continuous space missions and new constellations of satellites allow in fact more and more frequent acquisitions, at increasingly higher spatial resolutions, and at an almost total coverage of the globe. The availability of such an huge amount data has highlighted the need for automatic techniques capable of processing the data and exploiting all the available information. Meanwhile, the almost unlimited potential of machine learning has changed the world we live in. Artificial neural Networks have break trough everyday life, with applications that include computer vision, speech processing, autonomous driving but which are also the basis of commonly used tools such as online search engines. However, the vast majority of such models are of the supervised type and therefore their applicability rely on the availability of an enormous quantity of labeled data available to train the models themselves. Unfortunately, this is not the case with remote sensing, in which the enormous amounts of data are opposed to the almost total absence of ground truth. The purpose of this thesis is to find the way to exploit the most recent deep learning techniques, defining a common thread between two worlds, those of remote sensing and deep learning, which is often missing. In particular, this thesis proposes three novel contributions which face current issues in remote sensing. The first one is related to multisensor image registration and combines generative adversarial networks and non-linear optimization of crosscorrelation-like functionals to deal with the complexity of the setting. The proposed method was proved able to outperform state of the art approaches. The second novel contribution faces one of the main issues in deep learning for remote sensing: the scarcity of ground truth data for semantic segmentation. The proposed solution combines convolutional neural networks and probabilistic graphical models, two very active areas in machine learning for remote sensing, and approximate a fully connected conditional random field. The proposed method is capable of filling part of the gap which separate a densely trained model from a weakly trained one. Then, the third approach is aimed at the classification of high resolution satellite images for climate change purposes. It consist of a specific formulation of an energy minimization which allows to fuse multisensor information and the application a markov random field in a fast and efficient way for global scale applications. The results obtained in this thesis shows how deep learning methods based on artificial neural networks can be combined with statistical analysis to overcome their limitations, going beyond the classic benchmark environments and addressing practical, real and large-scale application cases.
3-mar-2022
Convolutional Neural Network (CNN), Classification, Deep Learning, Multisensor image registration, Conditional generative adversarial networks (cGANs), Image-to-image translation, Semantic labeling, Conditional Random Field (CRF), Clustering, Semi-Supervised Learning, Multisensor Data fusion, Markov Random Fields, Consensus Theory, Large-scale Land Cover Mapping.
File in questo prodotto:
File Dimensione Formato  
phdunige_3826243_1.pdf

accesso aperto

Descrizione: Table of Content + Chapter 1 + Chapter 2
Tipologia: Tesi di dottorato
Dimensione 8.09 MB
Formato Adobe PDF
8.09 MB Adobe PDF Visualizza/Apri
phdunige_3826243_2.pdf

accesso aperto

Descrizione: Chapter 3
Tipologia: Tesi di dottorato
Dimensione 7.14 MB
Formato Adobe PDF
7.14 MB Adobe PDF Visualizza/Apri
phdunige_3826243_3.pdf

accesso aperto

Descrizione: Chapter 4
Tipologia: Tesi di dottorato
Dimensione 8.71 MB
Formato Adobe PDF
8.71 MB Adobe PDF Visualizza/Apri
phdunige_3826243_4.pdf

accesso aperto

Descrizione: Chapter 5 - Part 1
Tipologia: Tesi di dottorato
Dimensione 14.19 MB
Formato Adobe PDF
14.19 MB Adobe PDF Visualizza/Apri
phdunige_3826243_5.pdf

accesso aperto

Descrizione: Chapter 5 - Part 2 + Appendix
Tipologia: Tesi di dottorato
Dimensione 13.23 MB
Formato Adobe PDF
13.23 MB Adobe PDF Visualizza/Apri
phdunige_3826243_6.pdf

accesso aperto

Descrizione: Conclusion + Bibliography
Tipologia: Tesi di dottorato
Dimensione 3.93 MB
Formato Adobe PDF
3.93 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/1070050
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact