Journal Article

·2021

MultiTempLSTM: prediction and compression of multitemporal hyperspectral images using LSTM networks

Ali Can Karaca YTU , M. Kemal Güllü YTU

Journal of Applied Remote Sensing

Abstract

Since multitemporal hyperspectral imaging has an excellent ability to observe the Earth’s surface over time, it has been used for various remote sensing applications. On the other hand, multitemporal hyperspectral images (HSIs) contain HSI sequences acquired multiple times over the same scene, resulting in large amounts of data. Conventional HSI compression methods cannot benefit from temporal correlation, which can be very high, depending on the acquisition cycle. We propose a prediction and compression framework that directly considers temporal correlation for the compression of HSIs. The main objective of the proposed method is to predict each spectral signature in the target HSI from the corresponding spectral signature of the reference HSI using a long short-term memory network model that supports clustering. Then, the residual image between the predicted HSI and the target HSI is quantized and entropy encoded for the compression purpose. The experiments are conducted on a ground-based multitemporal dataset named Noguiero, which contains nine HSIs, in terms of prediction and compression performances. Experiments show that the proposed method not only provides the best quality metrics from the perspective of prediction but also has convincing compression performances compared to the other methods.

Keywords

Hyperspectral imaging Computer science Artificial intelligence Data compression Residual Pattern recognition (psychology) Entropy (arrow of time) Compression (physics) Artificial neural network Image compression Remote sensing Image processing Image (mathematics) Geology Algorithm

Subject Areas

Remote-Sensing Image Classification ·Media Technology ·Physical Sciences
Advanced Data Compression Techniques ·Computer Vision and Pattern Recognition ·Physical Sciences
Remote Sensing and Land Use ·Atmospheric Science ·Physical Sciences

Citations by Year