Journal Article

·2023

Transferemble: a classification method for the detection of fake satellite images created with deep convolutional generative adversarial network

Selim Sürücü , Banu Di̇ri̇ YTU

Journal of Electronic Imaging

Abstract

As the number of government and commercial satellites increases, there is a large increase in Earth observation (EO) imagery. Using different locations and tools, images can be taken from more than one satellite. Manipulations are carried out on these images using a variety of different methods. The number of studies that have been done on the manipulation of EO images is very small. In recent years, generative adversarial networks (GANs), a major breakthrough in deep learning, have made it very easy to obtain fake images. In this study, scene-by-scene fake images were obtained with the deep convolutional GAN on the EuroSAT dataset, which is one of the EO image sets, and fake scene images were obtained from the original scenes. In this study, a dataset called RF-EuroSAT was created. It consists of 14 classes and 36,000 images. Five transfer learning models (VGG-16, DenseNet201, MobileNetV2, RegNetY320, and ResNet152V2) were used to classify this dataset. Using these models as feature extraction and ensemble models (XGBoost, CatBoost, and LightGBM) as classifiers, the classification process was performed using our proprietary transferemble model. The best result was obtained with an accuracy of 91.55% using our transferemble model, which is developed in a modular structure.

Keywords

Artificial intelligence Computer science Deep learning Feature extraction Pattern recognition (psychology) Convolutional neural network Feature (linguistics) Generative adversarial network Transfer of learning Contextual image classification Computer vision Image (mathematics)

Subject Areas

Digital Media Forensic Detection ·Computer Vision and Pattern Recognition ·Physical Sciences
Anomaly Detection Techniques and Applications ·Artificial Intelligence ·Physical Sciences
Identification and Quantification in Food ·Molecular Biology ·Life Sciences

Citations by Year