satellite-image-deep-learning.com ?
Introduction
Deep learning has revolutionized the analysis and interpretation of satellite and aerial imagery, addressing unique challenges such as vast image sizes and a wide array of object classes. This repository provides an exhaustive overview of deep learning techniques specifically tailored for satellite and aerial image processing. It covers a range of architectures, models, and algorithms suited for key tasks like classification, segmentation, and object detection.
How to use this repository: use Command + F (Mac) or CTRL + F (Windows) to search this page for e.g. 'SAM'
Techniques
Classification
Segmentation
Object detection
Regression
Cloud detection & removal
Change detection
Time series
Crop classification
Crop yield & vegetation forecasting
Generative networks
Autoencoders, dimensionality reduction, image embeddings & similarity search
Few & zero shot learning
Self-supervised, unsupervised & contrastive learning
SAR
Large vision & language models (LLMs & LVMs)
Foundational models
Classification
The UC merced dataset is a well known classification dataset.
Classification is a fundamental task in remote sensing data analysis, where the goal is to assign a semantic label to each image, such as 'urban', 'forest', 'agricultural land', etc. The process of assigning labels to an image is known as image-level classification. However, in some cases, a single image might contain multiple different land cover types, such as a forest with a river running through it, or a city with both residential and commercial areas. In these cases, image-level classification becomes more complex and involves assigning multiple labels to a single image. This can be accomplished using a combination of feature extraction and machine learning algorithms to accurately identify the different land cover types. It is important to note that image-level classification should not be confused with pixel-level classification, also known as semantic segmentation. While image-level classification assigns a single label to an entire image, semantic segmentation assigns a label to each individual pixel in an image, resulting in a highly detailed and accurate representation of the land cover types in an image. Read A brief introduction to satellite image classification with neural networks
EuroSat-Satellite-CNN-and-ResNet -> Classifying custom image datasets by creating Convolutional Neural Networks and Residual Networks from scratch with PyTorch
Detecting Informal Settlements from Satellite Imagery using fine-tuning of ResNet-50 classifier with repo
Land-Cover-Classification-using-Sentinel-2-Dataset -> well written Medium article accompanying this repo but using the EuroSAT dataset
Slums mapping from pretrained CNN network on VHR (Pleiades: 0.5m) and MR (Sentinel: 10m) imagery
Comparing urban environments using satellite imagery and convolutional neural networks -> includes interesting study of the image embedding features extracted for each image on the Urban Atlas dataset
RSI-CB -> A Large Scale Remote Sensing Image Classification Benchmark via Crowdsource Data. See also Remote-sensing-image-classification
WaterNet -> a CNN that identifies water in satellite images
Road-Network-Classification -> Road network classification model using ResNet-34, road classes organic, gridiron, radial and no pattern
SSTN -> Spectral-Spatial Transformer Network for Hyperspectral Image Classification: A FAS Framework
SatellitePollutionCNN -> A novel algorithm to predict air pollution levels with state-of-art accuracy using deep learning and GoogleMaps satellite images
PropertyClassification -> Classifying the type of property given Real Estate, satellite and Street view Images
remote-sense-quickstart -> classification on a number of datasets, including with attention visualization
IGARSS2020_BWMS -> Band-Wise Multi-Scale CNN Architecture for Remote Sensing Image Scene Classification with a novel CNN architecture for the feature embedding of high-dimensional RS images
image.classification.on.EuroSAT -> solution in pure pytorch
hurricane_damage -> Post-hurricane structure damage assessment based on aerial imagery
ISPRS_S2FL -> Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Model
ensemble_LCLU -> Deep neural network ensembles for remote sensing land cover and land use classification
Urban-Analysis-Using-Satellite-Imagery -> classify urban area as planned or unplanned using a combination of segmentation and classification
mining-discovery-with-deep-learning -> Mining and Tailings Dam Detection in Satellite Imagery Using Deep Learning
sentinel2-deep-learning -> Novel Training Methodologies for Land Classification of Sentinel-2 Imagery
Pay-More-Attention -> Remote Sensing Image Scene Classification Based on an Enhanced Attention Module
Remote Sensing Image Classification via Improved Cross-Entropy Loss and Transfer Learning Strategy Based on Deep Convolutional Neural Networks
SKAL -> Looking Closer at the Scene: Multiscale Representation Learning for Remote Sensing Image Scene Classification
SAFF -> Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification
GLNET -> Convolutional Neural Networks Based Remote Sensing Scene Classification under Clear and Cloudy Environments
Remote-sensing-image-classification -> transfer learning using pytorch to classify remote sensing data into three classes: aircrafts, ships, none
remote_sensing_pretrained_models -> as an alternative to fine tuning on models pretrained on ImageNet, here some CNN are pretrained on the RSD46-WHU & AID datasets
OBIC-GCN -> Object-based Classification Framework of Remote Sensing Images with Graph Convolutional Networks
aitlas-arena -> An open-source benchmark framework for evaluating state-of-the-art deep learning approaches for image classification in Earth Observation (EO)
droughtwatch -> Satellite-based Prediction of Forage Conditions for Livestock in Northern Kenya
JSTARS_2020_DPN-HRA -> Deep Prototypical Networks With Hybrid Residual Attention for Hyperspectral Image Classification
SIGNA -> Semantic Interleaving Global Channel Attention for Multilabel Remote Sensing Image Classification
PBDL -> Patch-Based Discriminative Learning for Remote Sensing Scene Classification
EmergencyNet -> identify fire and other emergencies from a drone
satellite-deforestation -> Using Satellite Imagery to Identify the Leading Indicators of Deforestation, applied to the Kaggle Challenge Understanding the Amazon from Space
RSMLC -> Deep Network Architectures as Feature Extractors for Multi-Label Classification of Remote Sensing Images
FireRisk -> A Remote Sensing Dataset for Fire Risk Assessment with Benchmarks Using Supervised and Self-supervised Learning
flood_susceptibility_mapping -> Towards urban flood susceptibility mapping using data-driven models in Berlin, Germany
Building-detection-and-roof-type-recognition -> A CNN-Based Approach for Automatic Building Detection and Recognition of Roof Types Using a Single Aerial Image
SNN4Space -> project which investigates the feasibility of deploying spiking neural networks (SNN) in land cover and land use classification tasks
vessel-classification -> classify vessels and identify fishing behavior based on AIS data
RSMamba -> Remote Sensing Image Classification with State Space Model
BirdSAT -> Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping
EGNNA_WND -> Estimating the presence of the West Nile Disease employing Graph Neural network
cyfi -> Estimate cyanobacteria density based on Sentinel-2 satellite imagery
3DGAN-ViT -> A deep learning framework based on generative adversarial networks and vision transformer for complex wetland classification puplished in International Journal of Applied Earth Observation and Geoinformation
EfficientBigEarthNet -> Code and models from the paper Benchmarking and scaling of deep learning models for land cover image classification.
automatic_solar_pv_detection -> Automatic Solar PV Panel Image Classification with Deep Neural Network Transfer Learning
U-netR -> Land Use Land Cover Classification with U-Net: Advantages of Combining Sentinel-1 and Sentinel-2 Imagery paper
nshaud/DeepNetsForEO -> Deep networks for Earth Observation with PyTorch implementations of state-of-the-art architectures for remote sensing image classification
Segmentation
(left) a satellite image and (right) the semantic classes in the image.
Image segmentation is a crucial step in image analysis and computer vision, with the goal of dividing an image into semantically meaningful segments or regions. The process of image segmentation assigns a class label to each pixel in an image, effectively transforming an image from a 2D grid of pixels into a 2D grid of pixels with assigned class labels. One common application of image segmentation is road or building segmentation, where the goal is to identify and separate roads and buildings from other features within an image. To accomplish this task, single class models are often trained to differentiate between roads and background, or buildings and background. These models are designed to recognize specific features, such as color, texture, and shape, that are characteristic of roads or buildings, and use this information to assign class labels to the pixels in an image. Another common application of image segmentation is land use or crop type classification, where the goal is to identify and map different land cover types within an image. In this case, multi-class models are typically used to recognize and differentiate between multiple classes within an image, such as forests, urban areas, and agricultural land. These models are capable of recognizing complex relationships between different land cover types, allowing for a more comprehensive understanding of the image content. Read A brief introduction to satellite image segmentation with neural networks. Note that many articles which refer to 'hyperspectral land classification' are often actually describing semantic segmentation.
Segmentation - Land use & land cover
Automatic Detection of Landfill Using Deep Learning
laika -> The goal of this repo is to research potential sources of satellite image data and to implement various algorithms for satellite image segmentation
CDL-Segmentation -> Deep Learning Based Land Cover and Crop Type Classification: A Comparative Study. Compares UNet, SegNet & DeepLabv3+
LoveDA -> A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentation
DeepGlobe Land Cover Classification Challenge solution
CNN_Enhanced_GCN -> CNN-Enhanced Graph Convolutional Network With Pixel- and Superpixel-Level Feature Fusion for Hyperspectral Image Classification
LULCMapping-WV3images-CORINE-DLMethods -> Land Use and Land Cover Mapping Using Deep Learning Based Segmentation Approaches and VHR Worldview-3 Images
MCANet -> A joint semantic segmentation framework of optical and SAR images for land use classification. Uses WHU-OPT-SAR-dataset
land-cover -> Model Generalization in Deep Learning Applications for Land Cover Mapping
generalizablersc -> Cross-dataset Learning for Generalizable Land Use Scene Classification
Large-scale-Automatic-Identification-of-Urban-Vacant-Land -> Large-scale automatic identification of urban vacant land using semantic segmentation of high-resolution remote sensing images
SSLTransformerRS -> Self-supervised Vision Transformers for Land-cover Segmentation and Classification
LULCMapping-WV3images-CORINE-DLMethods -> Land Use and Land Cover Mapping Using Deep Learning Based Segmentation Approaches and VHR Worldview-3 Images
DCSA-Net -> Dynamic Convolution Self-Attention Network for Land-Cover Classification in VHR Remote-Sensing Images
CHeGCN-CNN_enhanced_Heterogeneous_Graph -> CNN-Enhanced Heterogeneous Graph Convolutional Network: Inferring Land Use from Land Cover with a Case Study of Park Segmentation
TCSVT_2022_DGSSC -> DGSSC: A Deep Generative Spectral-Spatial Classifier for Imbalanced Hyperspectral Imagery
DeepForest-Wetland-Paper -> Deep Forest classifier for wetland mapping using the combination of Sentinel-1 and Sentinel-2 data, GIScience & Remote Sensing
Wetland_UNet -> UNet models that can delineate wetlands using remote sensing data input including bands from Sentinel-2 LiDAR and geomorphons. By the Conservation Innovation Center of Chesapeake Conservancy and Defenders of Wildlife
DPA -> DPA is an unsupervised domain adaptation (UDA) method applied to different satellite images for larg-scale land cover mapping.
dynamicworld -> Dynamic World, Near real-time global 10 m land use land cover mapping
spada -> Land Cover Segmentation with Sparse Annotations from Sentinel-2 Imagery
M3SPADA -> Multi-Sensor Temporal Unsupervised Domain Adaptation for Land Cover Mapping with spatial pseudo labelling and adversarial learning
GLNet -> Collaborative Global-Local Networks for Memory-Efficient Segmentation of Ultra-High Resolution Images
LoveNAS -> LoveNAS: Towards Multi-Scene Land-Cover Mapping via Hierarchical Searching Adaptive Network
FLAIR-2 challenge -> Semantic segmentation and domain adaptation challenge proposed by the French National Institute of Geographical and Forest Information (IGN)
flair-2 8th place solution
igarss-spada -> Dataset and code for the paper Land Cover Segmentation with Sparse Annotations from Sentinel-2 Imagery IGARSS 2023
cnn-land-cover-eco -> Multi-stage semantic segmentation of land cover in the Peak District using high-resolution RGB aerial imagery
Segmentation - Vegetation, deforestation, crops & crop boundaries
Note that deforestation detection may be treated as a segmentation task or a change detection task
DetecTree -> Tree detection from aerial imagery in Python, a LightGBM classifier of tree/non-tree pixels from aerial imagery
kenya-crop-mask -> Annual and in-season crop mapping in Kenya - LSTM classifier to classify pixels as containing crop or not, and a multi-spectral forecaster that provides a 12 month time series given a partial input. Dataset downloaded from GEE and pytorch lightning used for training
Tree species classification from from airborne LiDAR and hyperspectral data using 3D convolutional neural networks
Find sports fields using Mask R-CNN and overlay on open-street-map
An LSTM to generate a crop mask for Togo
DeepSatModels -> Context-self contrastive pretraining for crop type semantic segmentation
DeepTreeAttention -> Implementation of Hang et al. 2020 "Hyperspectral Image Classification with Attention Aided CNNs" for tree species prediction
Crop-Classification -> crop classification using multi temporal satellite images
crop-mask -> End-to-end workflow for generating high resolution cropland maps, uses GEE & LSTM model
DeepCropMapping -> A multi-temporal deep learning approach with improved spatial generalizability for dynamic corn and soybean mapping, uses LSTM
ResUnet-a -> a deep learning framework for semantic segmentation of remotely sensed data
DSD_paper_2020 -> Crop Type Classification based on Machine Learning with Multitemporal Sentinel-1 Data
MR-DNN -> extract rice field from Landsat 8 satellite imagery
deep_learning_forest_monitoring -> Forest mapping and monitoring of the African continent using Sentinel-2 data and deep learning
global-cropland-mapping -> global multi-temporal cropland mapping
Landuse_DL -> delineate landforms due to the thawing of ice-rich permafrost
canopy -> A Convolutional Neural Network Classifier Identifies Tree Species in Mixed-Conifer Forest from Hyperspectral Imagery
forest_change_detection -> forest change segmentation with time-dependent models, including Siamese, UNet-LSTM, UNet-diff, UNet3D models
cultionet -> segmentation of cultivated land, built on PyTorch Geometric and PyTorch Lightning
sentinel-tree-cover -> A global method to identify trees outside of closed-canopy forests with medium-resolution satellite imagery
crop-type-detection-ICLR-2020 -> Winning Solutions from Crop Type Detection Competition at CV4A workshop, ICLR 2020
S4A-Models -> Various experiments on the Sen4AgriNet dataset
attention-mechanism-unet -> An attention-based U-Net for detecting deforestation within satellite sensor imagery
SummerCrop_Deeplearning -> A Transferable Learning Classification Model and Carbon Sequestration Estimation of Crops in Farmland Ecosystem
DeepForest is a python package for training and predicting individual tree crowns from airborne RGB imagery
Official repository for the "Identifying trees on satellite images" challenge from Omdena
PTDM -> Pomelo Tree Detection Method Based on Attention Mechanism and Cross-Layer Feature Fusion
urban-tree-detection -> Individual Tree Detection in Large-Scale Urban Environments using High-Resolution Multispectral Imagery. With dataset
BioMassters_baseline -> a basic pytorch lightning baseline using a UNet for getting started with the BioMassters challenge (biomass estimation)
Biomassters winners -> top 3 solutions
kbrodt biomassters solution -> 1st place solution
biomass-estimation -> from Azavea, applied to Sentinel 1 & 2
3DUNetGSFormer -> A deep learning pipeline for complex wetland mapping using generative adversarial networks and Swin transformer
SEANet_torch -> Using a semantic edge-aware multi-task neural network to delineate agricultural parcels from remote sensing images
arborizer -> Tree crowns segmentation and classification
ReUse -> REgressive Unet for Carbon Storage and Above-Ground Biomass Estimation
unet-sentinel -> UNet to handle Sentinel-1 SAR images to identify deforestation
MaskedSST -> Masked Vision Transformers for Hyperspectral Image Classification
UNet-defmapping -> master's thesis using UNet to map deforestation using Sentinel-2 Level 2A images, applied to Amazon and Atlantic Rainforest dataset
cvpr-multiearth-deforestation-segmentation -> multimodal Unet entry to the CVPR Multiearth 2023 deforestation challenge
TransUNetplus2 -> TransU-Net++: Rethinking attention gated TransU-Net for deforestation mapping. Uses the Amazon and Atlantic forest dataset
A high-resolution canopy height model of the Earth -> A high-resolution canopy height model of the Earth
Radiant Earth Spot the Crop Challenge -> Winning models from the Radiant Earth Spot the Crop Challenge, uses a time-series of Sentinel-2 multispectral data to classify crops in the Western Cape of South Africa. Another solution
transfer-field-delineation -> Multi-Region Transfer Learning for Segmentation of Crop Field Boundaries in Satellite Images with Limited Labels
mowing-detection -> Automatic detection of mowing and grazing from Sentinel images
PTAViT3D and PTAViT3DCA -> Tackling fluffy clouds: field boundaries detection using time series of S2 and/or S1 imagery
ai4boundaries -> a Python package that facilitates download of the AI4boundaries data set
Nasa_harvest_field_boundary_competition -> Nasa Harvest Rwanda Field Boundary Detection Challenge Tutorial
UTB_codes -> The Urban Tree Canopy Cover in Brazil article
nasa_harvest_boundary_detection_challenge -> the 4th place solution for NASA Harvest Field Boundary Detection Challenge on Zindi.
rainforest-segmentation -> Identifying and tracking deforestation in the Amazon Rainforest using state-of-the-art deep learning models and multispectral satellite imagery.
Delineate Anything: Resolution-Agnostic Field Boundary Delineation on Satellite Imagery
Semantic_segmentation_for_LCLUC -> Semantic Segmentation for Simultaneous Crop and Land Cover Land Use Classification Using Multi-Temporal Landsat Imagery
boundary-sam -> parcel boundary delineation using SAM, image embeddings and detail enhancement filters
Segmentation - Water, coastlines, rivers & floods
Houston_flooding -> labeling each pixel as either flooded or not using data from Hurricane Harvey. Dataset consisted of pre and post flood images, and a ground truth floodwater mask was created using unsupervised clustering (with DBScan) of image pixels with human cluster verification/adjustment
ml4floods -> An ecosystem of data, models and code pipelines to tackle flooding with ML
1st place solution for STAC Overflow: Map Floodwater from Radar Imagery hosted by Microsoft AI for Earth -> combines Unet with Catboostclassifier, taking their maxima, not the average
hydra-floods -> an open source Python application for downloading, processing, and delivering surface water maps derived from remote sensing data
CoastSat -> tool for mapping coastlines which has an extension CoastSeg using segmentation models
deepwatermap -> a deep model that segments water on multispectral images
rivamap -> an automated river analysis and mapping engine
deep-water -> track changes in water level
WatNet -> A deep ConvNet for surface water mapping based on Sentinel-2 image, uses the Earth Surface Water Dataset
A-U-Net-for-Flood-Extent-Mapping
floatingobjects -> TOWARDS DETECTING FLOATING OBJECTS ON A GLOBAL SCALE WITHLEARNED SPATIAL FEATURES USING SENTINEL 2. Uses U-Net & pytorch
SpaceNet8 -> baseline Unet solution to detect flooded roads and buildings
dlsim -> Breaking the Limits of Remote Sensing by Simulation and Deep Learning for Flood and Debris Flow Mapping
Water-HRNet -> HRNet trained on Sentinel 2
semantic segmentation model to identify newly developed or flooded land using NAIP imagery provided by the Chesapeake Conservancy, training on MS Azure
BandNet -> Analysis and application of multispectral data for water segmentation using machine learning. Uses Sentinel-2 data
mmflood -> MMFlood: A Multimodal Dataset for Flood Delineation From Satellite Imagery (Sentinel 1 SAR)
Urban_flooding -> Towards transferable data-driven models to predict urban pluvial flood water depth in Berlin, Germany
MECNet -> Rich CNN features for water-body segmentation from very high resolution aerial and satellite imagery
SWRNET -> A Deep Learning Approach for Small Surface Water Area Recognition Onboard Satellite
elwha-segmentation -> fine-tuning Meta's Segment Anything (SAM) for bird's eye view river pixel segmentation
RiverSnap -> code for paper: A Comparative Performance Analysis of Popular Deep Learning Models and Segment Anything Model (SAM) for River Water Segmentation in Close-Range Remote Sensing Imagery
SAR-water-segmentation -> Deep Learning based Water Segmentation Using KOMPSAT-5 SAR Images
Segmentation - Fire, smoke & burn areas
SatelliteVu-AWS-Disaster-Response-Hackathon -> fire spread prediction using classical ML & deep learning
A Practical Method for High-Resolution Burned Area Monitoring Using Sentinel-2 and VIIRS
IndustrialSmokePlumeDetection -> using Sentinel-2 & a modified ResNet-50
burned-area-detection -> uses Sentinel-2
rescue -> Attention to fires: multi-channel deep-learning models forwildfire severity prediction
smoke_segmentation -> Segmenting smoke plumes and predicting density from GOES imagery
wildfire-detection -> Using Vision Transformers for enhanced wildfire detection in satellite images
Burned_Area_Detection -> Detecting Burned Areas with Sentinel-2 data
burned-area-baseline -> baseline unet model accompanying the Satellite Burned Area Dataset (Sentinel 1 & 2)
burned-area-seg -> Burned area segmentation from Sentinel-2 using multi-task learning
chabud2023 -> Change detection for Burned area Delineation (ChaBuD) ECML/PKDD 2023 challenge
Post Wildfire Burnt-up Detection using Siamese-UNet -> on Chadbud dataset
vit-burned-detection -> Vision transformers in burned area delineation
Segmentation - Landslides
landslide-sar-unet -> Deep Learning for Rapid Landslide Detection using Synthetic Aperture Radar (SAR) Datacubes
landslide-mapping-with-cnn -> A new strategy to map landslides with a generalized convolutional neural network
Landslide-mapping-on-SAR-data-by-Attention-U-Net -> Rapid Mapping of landslide on SAR data by Attention U-net
SAR-landslide-detection-pretraining -> SAR-based landslide classification pretraining leads to better segmentation
Landslide mapping from Sentinel-2 imagery through change detection
landslide4sense-solution -> solution of Tek Kshetri
Segmentation - Glaciers
HED-UNet -> a model for simultaneous semantic segmentation and edge detection, examples provided are glacier fronts and building footprints using the Inria Aerial Image Labeling dataset
glacier_mapping -> Mapping glaciers in the Hindu Kush Himalaya, Landsat 7 images, Shapefile labels of the glaciers, Unet with dropout
GlacierSemanticSegmentation
Antarctic-fracture-detection -> uses UNet with the MODIS Mosaic of Antarctica to detect surface fractures
sentinel_lakeice -> Lake Ice Detection from Sentinel-1 SAR with Deep Learning
Segmentation - methane
Methane-detection-from-hyperspectral-imagery -> Deep Remote Sensing Methods for Methane Detection in Overhead Hyperspectral Imagery
methane-emission-project -> Classification CNNs was combined in an ensemble approach with traditional methods on tabular data
CH4Net -> A fast, simple model for detection of methane plumes using sentinel-2
STARCOP: Semantic Segmentation of Methane Plumes with Hyperspectral Machine Learning models
Project-Eucalyptus -> pipelines for satellite-based methane detection. Includes trained segmentation models, a synthetic plume generator, and benchmarking tools for Sentinel-2, Landsat 8/9, and EMIT.
Segmentation - Other environmental
Detection of Open Landfills -> uses Sentinel-2 to detect large changes in the Normalized Burn Ratio (NBR)
sea_ice_remote_sensing -> Sea Ice Concentration classification
EddyNet -> A Deep Neural Network For Pixel-Wise Classification of Oceanic Eddies
schisto-vegetation -> Deep Learning Segmentation of Satellite Imagery Identifies Aquatic Vegetation Associated with Snail Intermediate Hosts of Schistosomiasis in Senegal, Africa
Earthformer -> Exploring space-time transformers for earth system forecasting
weather4cast-2022 -> Unet-3D baseline model for Weather4cast Rain Movie Prediction competition
WeatherFusionNet -> Predicting Precipitation from Satellite Data. weather4cast-2022 1st place solution
marinedebrisdetector -> Large-scale Detection of Marine Debris in Coastal Areas with Sentinel-2
kaggle-identify-contrails-4th -> 4th place Solution, Google Research - Identify Contrails to Reduce Global Warming
MineSegSAT -> An automated system to evaluate mining disturbed area extents from Sentinel-2 imagery
asos -> Recognizing protected and anthropogenic patterns in landscapes using interpretable machine learning and satellite imagery
SinkSAM -> Knowledge-Driven Self-Supervised Sinkhole Segmentation Using Topographic Priors and Segment Anything Model
Segmentation - Roads & sidewalks
Extracting roads is challenging due to the occlusions caused by other objects and the complex traffic environment
ChesapeakeRSC -> segmentation to extract roads from the background but are additionally evaluated by how they perform on the "Tree Canopy Over Road" class
ML_EPFL_Project_2 -> U-Net in Pytorch to perform semantic segmentation of roads on satellite images
Winning Solutions from SpaceNet Road Detection and Routing Challenge
awesome-deep-map -> A curated list of resources dedicated to deep learning / computer vision algorithms for mapping. The mapping problems include road network inference, building footprint extraction, etc.
RoadTracer: Automatic Extraction of Road Networks from Aerial Images -> uses an iterative search process guided by a CNN-based decision function to derive the road network graph directly from the output of the CNN
road_detection_mtl -> Road Detection using a multi-task Learning technique to improve the performance of the road detection task by incorporating prior knowledge constraints, uses the SpaceNet Roads Dataset
road_connectivity -> Improved Road Connectivity by Joint Learning of Orientation and Segmentation (CVPR2019)
SPIN_RoadMapper -> Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Driving
road_extraction_remote_sensing -> pytorch implementation, CVPR2018 DeepGlobe Road Extraction Challenge submission. See also DeepGlobe-Road-Extraction-Challenge
RoadDetections dataset by Microsoft
CoANet -> Connectivity Attention Network for Road Extraction From Satellite Imagery. The CoA module incorporates graphical information to ensure the connectivity of roads are better preserved
Satellite Imagery Road Segmentation -> intro articule on Medium using the kaggle Massachusetts Roads Dataset
Label-Pixels -> for semantic segmentation of roads and other features
Satellite-image-road-extraction -> Road Extraction by Deep Residual U-Net
road_building_extraction -> Pytorch implementation of U-Net architecture for road and building extraction
RCFSNet -> Road Extraction From Satellite Imagery by Road Context and Full-Stage Feature
SGCN -> Split Depth-Wise Separable Graph-Convolution Network for Road Extraction in Complex Environments From High-Resolution Remote-Sensing Images
ASPN -> Road Segmentation for Remote Sensing Images using Adversarial Spatial Pyramid Networks
cresi -> Road network extraction from satellite imagery, with speed and travel time estimates
D-LinkNet -> LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction
Sat2Graph -> Road Graph Extraction through Graph-Tensor Encoding
RoadTracer-M -> Road Network Extraction from Satellite Images Using CNN Based Segmentation and Tracing
ScRoadExtractor -> Scribble-based Weakly Supervised Deep Learning for Road Surface Extraction from Remote Sensing Images
RoadDA -> Stagewise Unsupervised Domain Adaptation with Adversarial Self-Training for Road Segmentation of Remote Sensing Images
DeepSegmentor -> A Pytorch implementation of DeepCrack and RoadNet projects
Cascaded Residual Attention Enhanced Road Extraction from Remote Sensing Images
NL-LinkNet -> Toward Lighter but More Accurate Road Extraction with Non-Local Operations
IRSR-net -> Lightweight Remote Sensing Road Detection Network
hironex -> A python tool for automatic, fully unsupervised extraction of historical road networks from historical maps
Road_detection_model -> Mapping Roads in the Brazilian Amazon with Artificial Intelligence and Sentinel-2
DTnet -> Road detection via a dual-task network based on cross-layer graph fusion modules
Automatic-Road-Extraction-from-Historical-Maps-using-Deep-Learning-Techniques -> Automatic Road Extraction from Historical Maps using Deep Learning Techniques
Istanbul_Dataset -> segmentation on the Istanbul, Inria and Massachusetts datasets
D-LinkNet -> 1st place solution in DeepGlobe Road Extraction Challenge
PaRK-Detect -> PaRK-Detect: Towards Efficient Multi-Task Satellite Imagery Road Extraction via Patch-Wise Keypoints Detection
tile2net -> Mapping the walk: A scalable computer vision approach for generating sidewalk network datasets from aerial imagery
sam_road -> Segment Anything Model (SAM) for large-scale, vectorized road network extraction from aerial imagery.
LRDNet -> A Lightweight Road Detection Algorithm Based on Multiscale Convolutional Attention Network and Coupled Decoder Head
Fine–Grained Extraction of Road Networks via Joint Learning of Connectivity and Segmentation -> uses SpaceNet 3 dataset
Satellite-Image-Road-Segmentation -> Graph Reasoned Multi-Scale Road Segmentation in Remote Sensing Imagery paper
Segmentation - Buildings & rooftops
Road and Building Semantic Segmentation in Satellite Imagery uses U-Net on the Massachusetts Roads Dataset & keras
find unauthorized constructions using aerial photography -> Dataset creation
SRBuildSeg -> Making low-resolution satellite images reborn: a deep learning approach for super-resolution building extraction
automated-building-detection -> Input: very-high-resolution (<= 0.5 m/pixel) RGB satellite images. Output: buildings in vector format (geojson), to be used in digital map products. Built on top of robosat and robosat.pink.
JointNet-A-Common-Neural-Network-for-Road-and-Building-Extraction
Mapping Africa’s Buildings with Satellite Imagery: Google AI blog post. See the open-buildings dataset
nz_convnet -> A U-net based ConvNet for New Zealand imagery to classify building outlines
polycnn -> End-to-End Learning of Polygons for Remote Sensing Image Classification
spacenet_building_detection solution by motokimura using Unet
Semantic-segmentation repo by fuweifu-vtoo -> uses pytorch and the Massachusetts Buildings & Roads Datasets
Extracting buildings and roads from AWS Open Data using Amazon SageMaker -> With repo
TF-SegNet -> AirNet is a segmentation network based on SegNet, but with some modifications
rgb-footprint-extract -> a Semantic Segmentation Network for Urban-Scale Building Footprint Extraction Using RGB Satellite Imagery, DeepLavV3+ module with a Dilated ResNet C42 backbone
SpaceNetExploration -> A sample project demonstrating how to extract building footprints from satellite images using a semantic segmentation model. Data from the SpaceNet Challenge
Rooftop-Instance-Segmentation -> VGG-16, Instance Segmentation, uses the Airs dataset
solar-farms-mapping -> An Artificial Intelligence Dataset for Solar Energy Locations in India
poultry-cafos -> This repo contains code for detecting poultry barns from high-resolution aerial imagery and an accompanying dataset of predicted barns over the United States
ssai-cnn -> This is an implementation of Volodymyr Mnih's dissertation methods on his Massachusetts road & building dataset
Remote-sensing-building-extraction-to-3D-model-using-Paddle-and-Grasshopper
segmentation-enhanced-resunet -> Urban building extraction in Daejeon region using Modified Residual U-Net (Modified ResUnet) and applying post-processing
Mask RCNN for Spacenet Off Nadir Building Detection
GRSL_BFE_MA -> Deep Learning-based Building Footprint Extraction with Missing Annotations using a novel loss function
FER-CNN -> Detection, Classification and Boundary Regularization of Buildings in Satellite Imagery Using Faster Edge Region Convolutional Neural Networks
Vector-Map-Generation-from-Aerial-Imagery-using-Deep-Learning-GeoSpatial-UNET -> applied to geo-referenced images which are very large size > 10k x 10k pixels
building-footprint-segmentation -> pip installable library to train building footprint segmentation on satellite and aerial imagery, applied to Massachusetts Buildings Dataset and Inria Aerial Image Labeling Dataset
FCNN-example -> overfit to a given single image to detect houses
SAT2LOD2 -> an open-source, python-based GUI-enabled software that takes the satellite images as inputs and returns LoD2 building models as outputs
SatFootprint -> building segmentation on the Spacenet 7 dataset
Building-Detection -> Raster Vision experiment to train a model to detect buildings from satellite imagery in three cities in Latin America
Multi-building-tracker -> Multi-target building tracker for satellite images using deep learning
Boundary Enhancement Semantic Segmentation for Building Extraction
Spacenet-Building-Detection
LGPNet-BCD -> Building Change Detection for VHR Remote Sensing Images via Local-Global Pyramid Network and Cross-Task Transfer Learning Strategy
MTL_homoscedastic_SRB -> A Multi-Task Deep Learning Framework for Building Footprint Segmentation
FDANet -> Full-Level Domain Adaptation for Building Extraction in Very-High-Resolution Optical Remote-Sensing Images
CBRNet -> A Coarse-to-fine Boundary Refinement Network for Building Extraction from Remote Sensing Imagery
ASLNet -> Adversarial Shape Learning for Building Extraction in VHR Remote Sensing Images
BRRNet -> A Fully Convolutional Neural Network for Automatic Building Extraction From High-Resolution Remote Sensing Images
Multi-Scale-Filtering-Building-Index -> A Multi - Scale Filtering Building Index for Building Extraction in Very High - Resolution Satellite Imagery
Models for Remote Sensing -> long list of unets etc applied to building detection
boundary_loss_for_remote_sensing -> Boundary Loss for Remote Sensing Imagery Semantic Segmentation
Open Cities AI Challenge -> Segmenting Buildings for Disaster Resilience. Winning solutions on Github
MAPNet -> Multi Attending Path Neural Network for Building Footprint Extraction from Remote Sensed Imagery
dual-hrnet -> localizing buildings and classifying their damage level
ESFNet -> Efficient Network for Building Extraction from High-Resolution Aerial Images
CVCMFFNet -> Complex-Valued Convolutional and Multifeature Fusion Network for Building Semantic Segmentation of InSAR Images
STEB-UNet -> A Swin Transformer-Based Encoding Booster Integrated in U-Shaped Network for Building Extraction
dfc2020_baseline -> Baseline solution for the IEEE GRSS Data Fusion Contest 2020. Predict land cover labels from Sentinel-1 and Sentinel-2 imagery
Fusing multiple segmentation models based on different datasets into a single edge-deployable model -> roof, car & road segmentation
ground-truth-gan-segmentation -> use Pix2Pix to segment the footprint of a building. The dataset used is AIRS
UNICEF-Giga_Sudan -> Detecting school lots from satellite imagery in Southern Sudan using a UNET segmentation model
building_footprint_extraction -> The project retrieves satellite imagery from Google and performs building footprint extraction using a U-Net.
projectRegularization -> Regularization of building boundaries in satellite images using adversarial and regularized losses
PolyWorldPretrainedNetwork -> Polygonal Building Extraction with Graph Neural Networks in Satellite Images
dl_image_segmentation -> Uncertainty-Aware Interpretable Deep Learning for Slum Mapping and Monitoring. Uses SHAP
UBC-dataset -> a dataset for building detection and classification from very high-resolution satellite imagery with the focus on object-level interpretation of individual buildings
UNetFormer -> A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery
BES-Net -> Boundary Enhancing Semantic Context Network for High-Resolution Image Semantic Segmentation. Applied to Vaihingen and Potsdam datasets
CVNet -> Contour Vibration Network for Building Extraction
CFENet -> A Context Feature Enhancement Network for Building Extraction from High-Resolution Remote Sensing Imagery
HiSup -> Accurate Polygonal Mapping of Buildings in Satellite Imagery
BuildingExtraction -> Building Extraction from Remote Sensing Images with Sparse Token Transformers
CrossGeoNet -> A Framework for Building Footprint Generation of Label-Scarce Geographical Regions
AFM_building -> Building Footprint Generation Through Convolutional Neural Networks With Attraction Field Representation
RAMP (Replicable AI for MicroPlanning) -> building detection in low and middle income countries
Building-instance-segmentation -> Multi-Modal Feature Fusion Network with Adaptive Center Point Detector for Building Instance Extraction
CGSANet -> A Contour-Guided and Local Structure-Aware Encoder–Decoder Network for Accurate Building Extraction From Very High-Resolution Remote Sensing Imagery
building-footprints-update -> Learning Color Distributions from Bitemporal Remote Sensing Images to Update Existing Building Footprints
RAMP -> model and buildings dataset to support a wide variety of humanitarian use cases
Thesis_Semantic_Image_Segmentation_on_Satellite_Imagery_using_UNets -> This master thesis aims to perform semantic segmentation of buildings on satellite images from the SpaceNet challenge 1 dataset using the U-Net architecture
HD-Net -> High-resolution decoupled network for building footprint extraction via deeply supervised body and boundary decomposition
RoofSense -> A novel deep learning solution for the automatic roofing material classification of the Dutch building stock using aerial imagery and laser scanning data fusion
IBS-AQSNet -> Enhanced Automated Quality Assessment Network for Interactive Building Segmentation in High-Resolution Remote Sensing Imagery
DeepMAO -> Deep Multi-scale Aware Overcomplete Network for Building Segmentation in Satellite Imagery
CMGFNet-Building_Extraction -> Deep Learning Code for Building Extraction from very high resolution (VHR) remote sensing images
Segmentation - Solar panels
Deep-Learning-for-Solar-Panel-Recognition -> using both object detection with Yolov5 and Unet segmentation
DeepSolar -> A Machine Learning Framework to Efficiently Construct a Solar Deployment Database in the United States. Dataset on kaggle, actually used a CNN for classification and segmentation is obtained by applying a threshold to the activation map. Original code is tf1 but tf2/kers and a pytorch implementation are available. Also checkout [Visualizations and in-depth analysis .. of the factors that can explain the adoption of solar energy in .. Virginia]
hyperion_solar_net -> trained classificaton & segmentation models on RGB imagery from Google Maps
3D-PV-Locator -> Large-scale detection of rooftop-mounted photovoltaic systems in 3D
PV_Pipeline -> DeepSolar for Germany
solar-panels-detection -> using SegNet, Fast SCNN & ResNet
predict_pv_yield -> Using optical flow & machine learning to predict PV yield
Large-scale-solar-plant-monitoring -> Remote Sensing for Monitoring of Photovoltaic Power Plants in Brazil Using Deep Semantic Segmentation
Panel-Segmentation -> Determine the presence of a solar array in the satellite image (boolean True/False), using a VGG16 classification model
Roofpedia -> an open registry of green roofs and solar roofs across the globe identified by Roofpedia through deep learning
Predicting the Solar Potential of Rooftops using Image Segmentation and Structured Data Medium article, using 20cm imagery & Unet
solar-pv-global-inventory
remote-sensing-solar-pv -> A repository for sharing progress on the automated detection of solar PV arrays in sentinel-2 remote sensing imagery
solar-panel-segmentation) -> Finding solar panels using USGS satellite imagery
solar_plant_detection -> boundary extraction of Photovoltaic (PV) plants using Mask RCNN and Amir dataset
SolarDetection -> unet on satellite image from the USA and France
adopptrs -> Automatic Detection Of Photovoltaic Panels Through Remote Sensing using unet & pytorch
solar-panel-locator -> the number of solar panel pixels was only ~0.2% of the total pixels in the dataset, so solar panel data was upsampled to account for the class imbalance
projects-solar-panel-detection -> List of project to detect solar panels from aerial/satellite images
Satellite_ComputerVision -> UNET to detect solar arrays from Sentinel-2 data, using Google Earth Engine and Tensorflow. Also covers parking lot detection
photovoltaic-detection -> Detecting available rooftop area from satellite images to install photovoltaic panels
Solar_UNet -> U-Net models delineating solar arrays in Sentinel-2 imagery
SolarDetection-solafune -> Solar Panel Detection Using Sentinel-2 for the Solafune Competition
A Comparative Evaluation of Deep Learning Techniques for Photovoltaic Panel Detection from Aerial Images
UCSD_MLBootcamp_Capstone -> Automatic Detection of Photovoltaic Power Stations Using Satellite Imagery and Deep Learning (Sentinel 2)
Segmentation - Ships & vessels
Universal-segmentation-baseline-Kaggle-Airbus-Ship-Detection -> Kaggle Airbus Ship Detection Challenge - bronze medal solution
Airbus-Ship-Segmentation -> unet
contrastive_SSL_ship_detection -> Contrastive self supervised learning for ship detection in Sentinel 2 images
airbus-ship-detection -> using DeepLabV3+
Unet with web-application applied to Airbus ships
Segmentation - Other manmade
Aarsh2001/ML_Challenge_NRSC -> Electrical Substation detection
electrical_substation_detection
MCAN-OilSpillDetection -> Oil Spill Detection with A Multiscale Conditional Adversarial Network under Small Data Training
mining-detector -> detection of artisanal gold mines in Sentinel-2 satellite imagery for Amazon Mining Watch. Also covers clandestine airstrips
EG-UNet Deep Feature Enhancement Method for Land Cover With Irregular and Sparse Spatial Distribution Features: A Case Study on Open-Pit Mining
plastics -> Detecting and Monitoring Plastic Waste Aggregations in Sentinel-2 Imagery
MADOS -> Detecting Marine Pollutants and Sea Surface Features with Deep Learning in Sentinel-2 Imagery on the MADOS dataset
SADMA -> Residual Attention UNet on MARIDA: Marine Debris Archive is a marine debris-oriented dataset on Sentinel-2 satellite images
MAP-Mapper -> Marine Plastic Mapper is a tool for assessing marine macro-plastic density to identify plastic hotspots, underpinned by the MARIDA dataset.
substation-seg -> segmenting substations in Sentinel 2 satellite imagery
SAMSelect -> An Automated Spectral Index Search for Marine Debris using Segment-Anything (SAM)
Panoptic segmentation
Things and stuff or how remote sensing could benefit from panoptic segmentation
utae-paps -> PyTorch implementation of U-TAE and PaPs for satellite image time series panoptic segmentation
pastis-benchmark
Panoptic-Generator -> This module converts GIS data into panoptic segmentation tiles
BSB-Aerial-Dataset -> an example on how to use Detectron2's Panoptic-FPN in the BSB Aerial Dataset
Segmentation - Miscellaneous
seg-eval -> SegEval is a Python library that provides tools for evaluating semantic segmentation models. Generate evaluation regions and to analyze segmentation results within them.
awesome-satellite-images-segmentation
Satellite Image Segmentation: a Workflow with U-Net is a decent intro article
mmsegmentation -> Semantic Segmentation Toolbox with support for many remote sensing datasets including LoveDA, Potsdam, Vaihingen & iSAID
segmentation_gym -> A neural gym for training deep learning models to carry out geoscientific image segmentation
Using a U-Net for image segmentation, blending predicted patches smoothly is a must to please the human eye -> python code to blend predicted patches smoothly. See Satellite-Image-Segmentation-with-Smooth-Blending
DCA -> Deep Covariance Alignment for Domain Adaptive Remote Sensing Image Segmentation
SCAttNet -> Semantic Segmentation Network with Spatial and Channel Attention Mechanism
Efficient-Transformer -> Efficient Transformer for Remote Sensing Image Segmentation
weakly_supervised -> Weakly Supervised Deep Learning for Segmentation of Remote Sensing Imagery
HRCNet-High-Resolution-Context-Extraction-Network -> High-Resolution Context Extraction Network for Semantic Segmentation of Remote Sensing Images
Semantic segmentation of SAR images using a self supervised technique
satellite-segmentation-pytorch -> explores a wide variety of image augmentations to increase training dataset size
Spectralformer -> Rethinking hyperspectral image classification with transformers
Unsupervised Segmentation of Hyperspectral Remote Sensing Images with Superpixels
Semantic-Segmentation-with-Sparse-Labels
SNDF -> Superpixel-enhanced deep neural forest for remote sensing image semantic segmentation
dynamic-rs-segmentation -> Dynamic Multi-Context Segmentation of Remote Sensing Images based on Convolutional Networks
segmentation_models.pytorch -> Segmentation models with pretrained backbones, has been used in multiple winning solutions to remote sensing competitions
SSRN -> Spectral-Spatial Residual Network for Hyperspectral Image Classification: A 3-D Deep Learning Framework
SO-DNN -> Simplified object-based deep neural network for very high resolution remote sensing image classification
SANet -> Scale-Aware Network for Semantic Segmentation of High-Resolution Aerial Images
aerial-segmentation -> Learning Aerial Image Segmentation from Online Maps
IterativeSegmentation -> Recurrent Neural Networks to Correct Satellite Image Classification Maps
Detectron2 FPN + PointRend Model for amazing Satellite Image Segmentation -> 15% increase in accuracy when compared to the U-Net model
HybridSN -> Exploring 3D-2D CNN Feature Hierarchy for Hyperspectral Image Classification
TNNLS_2022_X-GPN -> Semisupervised Cross-scale Graph Prototypical Network for Hyperspectral Image Classification
singleSceneSemSegTgrs2022 -> Unsupervised Single-Scene Semantic Segmentation for Earth Observation
A-Fast-and-Compact-3-D-CNN-for-HSIC -> A Fast and Compact 3-D CNN for Hyperspectral Image Classification
HSNRS -> Hourglass-ShapeNetwork Based Semantic Segmentation for High Resolution Aerial Imagery
GiGCN -> Graph-in-Graph Convolutional Network for Hyperspectral Image Classification
SSAN -> Spectral-Spatial Attention Networks for Hyperspectral Image Classification
drone-images-semantic-segmentation -> Multiclass Semantic Segmentation of Aerial Drone Images Using Deep Learning
Satellite-Image-Segmentation-with-Smooth-Blending -> uses Smoothly-Blend-Image-Patches
BayesianUNet -> Pytorch Bayesian UNet model for segmentation and uncertainty prediction, applied to the Potsdam Dataset
RAANet -> A Residual ASPP with Attention Framework for Semantic Segmentation of High-Resolution Remote Sensing Images
wheelRuts_semanticSegmentation -> Mapping wheel-ruts from timber harvesting operations using deep learning techniques in drone imagery
LWN-for-UAVRSI -> Light-Weight Semantic Segmentation Network for UAV Remote Sensing Images, applied to Vaihingen, UAVid and UDD6 datasets
hypernet -> library which implements hyperspectral image (HSI) segmentation
ST-UNet -> Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation
EDFT -> Efficient Depth Fusion Transformer for Aerial Image Semantic Segmentation
WiCoNet -> Looking Outside the Window: Wide-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images
CRGNet -> Consistency-Regularized Region-Growing Network for Semantic Segmentation of Urban Scenes with Point-Level Annotations
SA-UNet -> Improved U-Net Remote Sensing Classification Algorithm Fusing Attention and Multiscale Features
MANet -> Multi-Attention-Network for Semantic Segmentation of Fine Resolution Remote Sensing Images
BANet -> Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images
MACU-Net -> MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images
DNAS -> Decoupling Neural Architecture Search for High-Resolution Remote Sensing Image Semantic Segmentation
A2-FPN -> A2-FPN for Semantic Segmentation of Fine-Resolution Remotely Sensed Images
MAResU-Net -> Multi-stage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images
RSEN -> Robust Self-Ensembling Network for Hyperspectral Image Classification
MSNet -> multispectral semantic segmentation network for remote sensing images
k-textures -> K-textures, a self-supervised hard clustering deep learning algorithm for satellite image segmentation
Swin-Transformer-Semantic-Segmentation -> Satellite Image Semantic Segmentation
UDA_for_RS -> Unsupervised Domain Adaptation for Remote Sensing Semantic Segmentation with Transformer
A-3D-CNN-AM-DSC-model-for-hyperspectral-image-classification -> Attention Mechanism and Depthwise Separable Convolution Aided 3DCNN for Hyperspectral Remote Sensing Image Classification
contrastive-distillation -> A Contrastive Distillation Approach for Incremental Semantic Segmentation in Aerial Images
SegForestNet -> SegForestNet: Spatial-Partitioning-Based Aerial Image Segmentation
MFVNet -> MFVNet: Deep Adaptive Fusion Network with Multiple Field-of-Views for Remote Sensing Image Semantic Segmentation
Wildebeest-UNet -> detecting wildebeest and zebras in Serengeti-Mara ecosystem from very-high-resolution satellite imagery
segment-anything-eo -> Earth observation tools for Meta AI Segment Anything (SAM - Segment Anyth
下载源码通过命令行克隆项目:
git clone https://github.com/satellite-image-deep-learning/techniques.git