THE IMPACT OF HIGH AND SUPER SPATIAL RESOLUTION REMOTE SENSING IMAGES DATASETS COMPOSITION ON TRAINING AND ACCURACY OF GEOFIELDS SEMANTIC SEGMENTATION NEURAL NETWORKS ON EXAMPLE OF A DIFFERENT EARTH’S SURFACE CLASSES RECOGNITION
Abstract and keywords
Abstract:
The remote sensing images and masks datasets that are used for different earth’s surface classes recognition tasks can significantly impact neural network models learnability and semantic segmentation results that are received after model training. Datasets composition problematic usually are not investigated from these datasets point of view as it is viewed as neural network data processing problematic in general in each specific remote sensing data semantic segmentation task. In geofields semantic segmentation context general problematic for object semantic segmentation on aerial and satellite data that includes such main problems as images with different spectral characteristics, images with shadows, images with “different object, same spectrum”, images with incorrect annotation and images with class imbalance borderline cases is determined. Mentioned problems are considered as problems of original geofields set representation in datasets. As result of a different earth’s surface classes semantic segmentation experiment with U-Net, STT and MF-CNN it was determined that class imbalance borderline cases and using images with resolution in which class imbalance is higher than using their crops reduce learning ability and recognition accuracy of neural networks and class imbalance borderline cases deletion based data selection in data preprocessing process leads to accuracy increase and models training time decrease.

Keywords:
geofield, geofields set, semantic segmentation, dataset composition, class imbalance, neural network, recognition accuracy
Text
Text (PDF): Read Download
References

1. Kadnichanskiy S.A., Kurkov V.M., Kurkov M.V. i dr. Fotogrammetricheskaya kalibrovka fotokamery dlya aerofotos'emki s bespilotnogo vozdushnogo sudna // Geoprofi. 2019. № 6. S. 35–40.

2. Chibunichev A.G., Kurkov V.M., Govorov A.V. i dr. Issledovanie tochnosti fototriangulyacii s ispol'zovaniem razlichnyh metodov laboratornoy i polevoy kalibrovki // Izvestiya vuzov «Geodeziya i aerofotos'emka». 2016. № 2. S. 42–47.

3. Mihaylov A.P., Chibunichev A.G., Kurkov V.M. i dr. Primenenie cifrovyh nemetricheskih kamer i lazernyh skanerov dlya resheniya zadach fotogrammetrii. [Elektronnyy resurs]. Rezhim dostupa: http://www.racurs.ru/?page=321 (data obrascheniya: 10.02.2019).

4. Lazareva N.S. Kalibrovka nemetricheskih maloformatnyh kamer i ih primenenie dlya resheniya nekotoryh zadach fotogrammetrii // Nauki o Zemle. 2011. № 1. S. 81–92. [Elektronnyy resurs]. Rezhim dostupa: https://geo-science.ru/wp-content/uploads/GeoScience_2011_1-80-91.pdf (data obrascheniya: 29.05.2025).

5. Antipov I.T. Matematicheskie osnovy prostranstvennoy analiticheskoy fototriangulyacii. M.: Kartgeocentr — Geodezizdat, 2003. 297 s.

6. Lunev A.A. Vybor optimal'nyh parametrov kalibrovki cifrovoy kamery. [Elektronnyy resurs]. Rezhim dostupa: https://masters.donntu.ru/2007/ggeo/sagaidak/library/book7.htm (data obrascheniya: 29.05.2025).

7. Cramer M., Przybilla H.-J., Zurhorst A. UAV Cameras: Overview and Geometric Calibration Benchmark // The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences. 2017. Vol. XLII-2/W6. P. 85–92. DOIhttps://doi.org/10.5194/isprs-archives-XLII-2-W6-85-2017. https://isprs-archives.copernicus.org/articles/XLII-2-W6/85/2017/

8. Bykov L.V., Chehlov D.V. Osobennosti mezhevaniya granic zemel'nyh uchastkov po materialam aerofotos'emki s bespilotnogo letatel'nogo apparata // Geodeziya, zemleustroystvo i kadastry: problemy i perspektivy razvitiya: sbornik materialov II Mezhdunarodnoy nauchno-prakticheskoy konferencii, Omsk, 26 marta 2020 g. Omsk: Omskiy GAU im. P.A. Stolypina, 2020. S. 43–47.

9. Anikeeva I.A., Babashkin N.M., Kadnichanskiy S.A. i dr. O vozmozhnosti i effektivnosti ispol'zovaniya bespilotnyh vozdushnyh sudov pri vypolnenii kadastrovyh rabot // Geodeziya i kartografiya. 2018. T. 79, № 8. S. 44–52. DOIhttps://doi.org/10.22389/0016-7126-2018-938-8-44-52. https://geocartography.ru/scientific_article/2018_8_44-52

10. Bykov V.L. Polevaya kalibrovka snimkov s ispol'zovaniem sredstv sputnikovogo pozicionirovaniya // Geodeziya i kartografiya. 2007. № 8. S. 39–43.

11. Biryukov N.A., Mayorov A.A., Lapchinskaya M.P. Semanticheskaya segmentaciya geopoley s ispol'zovaniem neyronnyh setey na primere problematiki vydeleniya zdaniy na kosmo- i aerofotosnimkah // Izvestiya vuzov «Geodeziya i aerofotos'emka». 2024. T. 68, № 1. S. 44–61. DOIhttps://doi.org/10.30533/GiA-2024-004. https://miigaik.ru/journal/archive/2024/2024_68_1_RU/GiA-2024-004.pdf

12. Li J., He W., Cao W., et al. UANet: An Uncertainty-Aware Network for Building Extraction from Remote Sensing Images // IEEE Transactions on Geoscience and Remote Sensing. 2024. Vol. 62. P. 5608513. DOIhttps://doi.org/10.1109/TGRS.2024.3361211. https://ieeexplore.ieee.org/document/10418227

13. Han R., Fan X., Liu J. EUNet: Edge-Unet for Accurate Building Extraction and Edge Emphasis in Gaofen-7 Images // Remote Sensing. 2024. Vol. 16. Iss. 13. P. 2397. DOIhttps://doi.org/10.3390/rs16132397. https://doi.org/10.3390/rs16132397

14. Fenglei W., Xin G., Zongze Z., et al. A Boundary-Enhanced Semantic Segmentation Model for Buildings // IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2025. Vol. 18. P. 5733–5748. DOIhttps://doi.org/10.1109/JSTARS.2025.3529456. https://ieeexplore.ieee.org/document/10840290

15. Chen P., Huang H., Ye F., et al. A Benchmark Gaofen-7 Dataset for Building Extraction from Satellite Images // Scientific Data. 2024. Vol. 11. P. 187. DOIhttps://doi.org/10.1038/s41597-024-03009-5. https://doi.org/10.1038/s41597-024-03009-5

16. Li S., Bao T., Liu H., et al. Multilevel Feature Aggregated Network with Instance Contrastive Learning Constraint for Building Extraction // Remote Sensing. 2023. Vol. 15. Iss. 10. P. 2585. DOIhttps://doi.org/10.3390/rs15102585. https://doi.org/10.3390/rs15102585

17. Lyu X., Jiang W., Li X., et al. MSAFNet: Multiscale Successive Attention Fusion Network for Water Body Extraction of Remote Sensing Images // Remote Sensing. 2023. Vol. 15. Iss. 12. P. 3121. DOIhttps://doi.org/10.3390/rs15123121. https://doi.org/10.3390/rs15123121

18. Li M., Hong L., Guo J., et al. Automated Extraction of Lake Water Bodies in Complex Geographical Environments by Fusing Sentinel-1/2 Data // Water. 2022. Vol. 14. Iss. 1. P. 30. DOIhttps://doi.org/10.3390/w14010030. https://doi.org/10.3390/w14010030

19. Wang Y., Li S., Lin Y., et al. Lightweight Deep Neural Network Method for Water Body Extraction from High-Resolution Remote Sensing Images with Multisensors // Sensors. 2021. Vol. 21. Iss. 21. 7397. DOIhttps://doi.org/10.3390/s21217397. https://doi.org/10.3390/s21217397

20. Wang B., Chen Z., Wu L., et al. SADA-Net: A Shape Feature Optimization and Multiscale Context Information-Based Water Body Extraction Method for High-Resolution Remote Sensing Images // IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2022. Vol. 15. P. 1744–1759. DOIhttps://doi.org/10.1109/JSTARS.2022.3146275. https://ieeexplore.ieee.org/document/9695297

21. Weng Y., Li Z., Tang G., et al. OCNet-Based Water Body Extraction from Remote Sensing Images // Water. 2023. Vol. 15. Iss. 20. P. 3557. DOI:10.3390/ w15203557. https://doi.org/10.3390/w15203557

22. Yu J., Cai Y., Lyu X., et al. Boundary-Guided Semantic Context Network for Water Body Extraction from Remote Sensing Images // Remote Sensing. 2023. Vol. 15. Iss. 17. P. 4325. DOIhttps://doi.org/10.3390/rs15174325. https://doi.org/10.3390/rs15174325

23. Li M., Wu P., Wang B., et al. A Deep Learning Method of Water Body Extraction from High Resolution Remote Sensing Images with Multisensors // IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 2021. Vol. 14. P. 3120–3132. DOIhttps://doi.org/10.1109/JSTARS.2021.3060769. https://ieeexplore.ieee.org/document/9360447

24. Zhao Z., Yang J., Wang M., et al. The PCA-NDWI Urban Water Extraction Model Based on Hyperspectral Remote Sensing // Water. 2024. Vol. 16. Iss. 7. P. 963. DOIhttps://doi.org/10.3390/w16070963. https://doi.org/10.3390/w16070963

25. Sandum H.N., Ørka H.O., Tomic O., et al. Semantic Segmentation of Forest Stands Using Deep Learning // Preprint arXiv.org, 2025. [Elektronnyy resurs]. Rezhim dostupa: https://arxiv.org/pdf/2504.02471 (data obrascheniya: 09.06.2025).

26. Lin N., Quan H., He J., et al. Urban Vegetation Extraction from High-Resolution Remote Sensing Imagery on SD-Unet and Vegetation Spectral Features // Remote Sensing. 2023. Vol. 15. Iss. 18. P. 4488. DOIhttps://doi.org/10.3390/rs15184488. https://doi.org/10.3390/rs15184488

27. Chen P., Li X., Peng Y., et al. WSSGCN: Hyperspectral Forest Image Classification via Watershed Superpixel Segmentation and Sparse Graph Convolutional Networks // Forests. 2025. Vol. 16. Iss. 5. P. 827. DOIhttps://doi.org/10.3390/f16050827. https://doi.org/10.3390/f16050827

28. Chen S., Zhang M., Lei F. Mapping Vegetation Types by Different Fully Convolutional Neural Network Structures with Inadequate Training Labels in Complex Landscape Urban Areas // Forests. 2023. Vol. 14. Iss. 9. P. 1768. DOIhttps://doi.org/10.3390/f14091788. https://doi.org/10.3390/f14091788

29. Li Y., Min S., Song B., et al. Multisource High-Resolution Remote Sensing Image Vegetation Extraction with Comprehensive Multifeature Perception // Remote Sensing. 2024. Vol. 16. Iss. 4. P. 712. DOIhttps://doi.org/10.3390/rs16040712. https://doi.org/10.3390/rs16040712

30. Wang B., Yao Y. Mountain Vegetation Classification Method Based on Multi-Channel Semantic Segmentation Model // Remote Sensing. 2024. Vol. 16. Iss. 2. P. 256. DOIhttps://doi.org/10.3390/rs16020256. https://doi.org/10.3390/rs16020256

31. Tao J., Chen Z., Sun Z., et al. Seg-Road: A Segmentation Network for Road Extraction Based on Transformer and CNN with Connectivity Structures // Remote Sensing. 2023. Vol. 15. Iss. 6. P. 1602. DOIhttps://doi.org/10.3390/rs15061602. https://doi.org/10.3390/rs15061602

32. Lin S., Yao X., Liu X., et al. MS-AGAN: Road Extraction via Multi-Scale Information Fusion and Asymmetric Generative Adversarial Networks from High-Resolution Remote Sensing Images under Complex Backgrounds // Remote Sensing. 2023. Vol. 15. Iss. 13. P. 3367. DOIhttps://doi.org/10.3390/rs15133367. https://doi.org/10.3390/rs15133367

33. Zhong B., Dan H., Liu M., et al. FERDNet: High-Resolution Remote Sensing Road Extraction Network Based on Feature Enhancement of Road Directionality // Remote Sensing. 2025. Vol. 17. Iss. 3. P. 376. DOIhttps://doi.org/10.3390/rs17030376. https://doi.org/10.3390/rs17030376

34. Chen J., Yang L., Wang H., et al. Road Extraction from High-Resolution Remote Sensing Images via Local and Global Context Reasoning // Remote Sensing. 2023. Vol. 15. Iss. 17. P. 4177. DOIhttps://doi.org/10.3390/rs15174177. https://doi.org/10.3390/rs15174177

35. Mahara A., Khan M.R.K., Deng L., et al. Automated Road Extraction from Satellite Imagery Integrating Dense Depthwise Dilated Separable Spatial Pyramid Pooling with DeepLabV3+ // Applied Sciences. 2025. Vol. 15. Iss. 3. P. 1027. DOIhttps://doi.org/10.3390/app15031027. https://doi.org/10.3390/app15031027

36. Li B., Tang X., Xiao R., et al. Dual Convolutional Network Based on Hypergraph and Multilevel Feature Fusion for Road Extraction from High-Resolution Remote Sensing Images // International Journal of Digital Earth. 2024. Vol. 17. No. 1. P. 2303354. DOIhttps://doi.org/10.1080/17538947.2024.2303354. https://doi.org/10.1080/17538947.2024.2303354

37. Zhao S., Feng Z., Chen L., et al. DANet: A Semantic Segmentation Network for Remote Sensing of Roads Based on Dual-ASPP Structure // Electronics. 2023. Vol. 12. Iss. 15. P. 3243. DOIhttps://doi.org/10.3390/electronics12153243. https://doi.org/10.3390/electronics12153243

38. Zhao L., Zhang J., Meng X., et al. Road Extraction Method of Remote Sensing Image Based on Deformable Attention Transformer // Symmetry. 2024. Vol. 16. Iss. 4. P. 468. DOIhttps://doi.org/10.3390/sym16040468. https://doi.org/10.3390/sym16040468

39. Zhang Y., Zhang L., Wang Y., et al. AGF-Net: Adaptive Global Feature Fusion Network for Road Extraction from Remote-Sensing Images // Complex & Intelligent Systems. 2024. Vol. 10. P. 4311–4328. DOIhttps://doi.org/10.1007/s40747-024-01364-9. https://doi.org/10.1007/s40747-024-01364-9

40. Ma D., Jiang L., Li J., et al. Water Index and Swin Transformer (WISTE) for Water Body Extraction from Multispectral Remote Sensing Images // GIScience & Remote Sensing. 2023. Vol. 60. No. 1. P. 2251704. DOIhttps://doi.org/10.1080/15481603.2023.2251704. https://doi.org/10.1080/15481603.2023.2251704

Login or Create
* Forgot password?