Analysis of multichannel satellite images of urban areas using deep learning methods

This paper examines the problem of land cover classification in densely populated urban environments using ultra-high-resolution Earth observation images. The aim of the study is to develop and validate a neural network algorithm for a high-precision semantic segmentation of urban green spaces using multimodal data. An improved U-Net convolutional neural network architecture, modified for the use with a 7-channel input tensor (RGB, NIR, RedEdge, DSM, and NDVI), is proposed. The approach is based on the Early Fusion strategy, which combines spectral measurements with promising structural characteristics (digital surface model, DSM). Focal Loss is used to overcome the class imbalance. The proposed model reliably separated spectrally identical layers (grass and trees) and eliminated false positives on green anthropogenic objects. The final Mean IoU was 0.725. The recall for detecting forested areas reached 0.93, and for the complex minority class “Shrubs” it reached 0.77. The experiment on an independent test site confirmed the model’s high generalizability (F1-score 0.93). The integration of seven data channels and the use of a modified U-Net are fully justified for the tasks of accurate calculating forest areas and environmental monitoring in the Smart City concept.

1. Neyns, R. Mapping of Urban Vegetation with High-Resolution Remote Sensing: A Review / R. Neyns, F. Canters // Remote Sensing. – 2022. – Vol. 14, № 4. – Art. ID 1031. https://doi.org/10.3390/rs14041031

2. Long, J. Fully convolutional networks for semantic segmentation / J. Long, E. Shelhamer, T. Darrell // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). – Boston, MA, USA, 2015. – P. 3431–3440. https://doi.org/10.1109/cvpr.2015.7298965

3. Semantic Segmentation Using Deep Learning with Vegetation Indices for Rice Lodging Identification in Multi-date UAV Visible Images / M.-D. Yang, H.-H. Tseng, Y.-C. Hsu, H. P. Tsai // Remote Sensing. – 2020. – Vol. 12, № 4. – Art. ID 633. https://doi.org/10.3390/rs12040633

4. U-Net Ensemble for Enhanced Semantic Segmentation in Remote Sensing Imagery / I. Dimitrovski, V. Spasev, S. Loshkovska, I. Kitanovski // Remote Sensing. – 2024. – Vol. 16, № 12. – Art. ID 2077. https://doi.org/10.3390/rs16122077

5. GreenNet: A dual-encoder network for urban green space classification using high-resolution remotely sensed images / Ke Chen, Yang Wang, Cunrui Huang [et al.] // International Journal of Applied Earth Observation and Geoinformation. – 2025. – Vol. 142. – Art. ID 104709. https://doi.org/10.1016/j.jag.2025.104709

6. Khan, B. A. Semantic Segmentation of Aerial Imagery Using U-Net with Self-Attention and Separable Convolutions / B. A. Khan, J.-W. Jung // Applied Sciences. – 2024. – Vol. 14, № 9. – Art. ID 3712. https://doi.org/10.3390/app14093712

7. Li, R. Research on CTSA-DeepLabV3+ Urban Green Space Classification Model Based on GF-2 Images / R. Li, J. Zhao, Y. Fan // Sensors. – 2025. – Vol. 25, № 13. – Art. ID 3862. https://doi.org/10.3390/s25133862

8. Ying Wei. Semantic Segmentation of Urban Green Space and Water Body in High-Resolution Remote Sensing Images Based on Low-Rank Adaptation / Ying Wei, Chen Yang, Tianxing Yin // 37th Chinese Control and Decision Conference (CCDC). – Xiamen, China, 2025. – P. 418–423. https://doi.org/10.1109/ccdc65474.2025.11090983

9. Ronneberger, O. U-Net: Convolutional Networks for Biomedical Image Segmentation / O. Ronneberger, P. Fischer, T. Brox // Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 / eds.: N. Navab, J. Hornegger, W. Wells, A. Frangi. – Springer, Cham, 2015. – P. 234–241. – (Lecture Notes in Computer Science; vol. 9351). – https://doi.org/10.1007/978-3-319-24574-4_28

10. Lee, D. H. A Review on Recent Deep Learning-Based Semantic Segmentation for Urban Greenness Measurement / D. H. Lee, H. Y. Park, J. Lee // Sensors. – 2024. – Vol. 24, № 7. – Art. ID 2245. https://doi.org/10.3390/s24072245

11. Zhang, D. Semantic segmentation of multi-source remote sensing image based on multi-path context module / D. Zhang, Y. Yan // Discover Applied Sciences. – 2026. – Vol. 8. – Art. ID 361. https://doi.org/10.1007/s42452-026-08338-1

12. Focal Loss for Dense Object Detection / Tsung-Yi Lin, P. Goyal, R. Girshick [et al.] // Proceedings of the IEEE International Conference on Computer Vision (ICCV). – Venice, Italy, 2017. – P. 2980–2988. https://doi.org/10.1109/iccv.2017.324

13. Kingma, D. P. Adam: A Method for Stochastic Optimization / D. P. Kingma, J. Ba // Arxiv [Preprint]. – 2014. – URL: https://arxiv.org/abs/1412.6980. https://doi.org/10.48550/arXiv.1412.6980