基于可变形卷积和注意力机制的SAR图像溢油检测模型

展开
  •  (大连海事大学 航海学院,辽宁 大连 116026) 

收稿日期: 2025-03-17

  修回日期: 2025-03-17

  录用日期: 2025-03-17

  网络出版日期: 2025-03-17

Oil spill detection model for SAR images based on deformable convolution and attention mechanism

Expand
  • (Navigation College, Dalian Maritime University, Dalian 116026, China)

Received date: 2025-03-17

  Revised date: 2025-03-17

  Accepted date: 2025-03-17

  Online published: 2025-03-17

摘要

针对现有的目标检测模型在提取溢油区域复杂特征以及识别不规则形状溢油区域存在的局限性,提出一种改进后的Mask R-CNN模型,使其更好地适应海面溢油检测任务。首先,在该模型特征提取网络中引入可变形卷积模块,提升模型对不规则形状溢油区域的感知能力;其次,在模型中加入改进后的注意力机制,使模型在增强对溢油区域关键特征捕捉能力的同时增加较少的参数;最后,使用完全交并比损失函数(Complete Intersection over Union Loss,CIoU Loss)作为目标框回归损失函数,从而提升模型在边界框回归任务上的性能。在公开的合成孔径雷达(Synthetic Aperture Radar,SAR)海面溢油数据集上的实验表明,改进后的模型检测精度为66.14%,相比原始Mask R-CNN模型提高了5.33%。此外在同一数据集的基础上与目标检测模型Yolov9、Yolov10、Faster R-CNN以及Cascade R-CNN模型相比,精度分别提高了31.79%、 19.01%、30.47%和21.02%;与实例分割模型Yolact和Yolov5-seg模型相比,精度分别提高了22.94%和29.5%。

本文引用格式

张雅, 陈澎, 刘丙新, 刘鹏, 夏辰旭 . 基于可变形卷积和注意力机制的SAR图像溢油检测模型[J]. 大连海事大学学报, 2025 , 51(2) : 106 -114 . DOI: 10.16411/j.cnki.issn1006-7736.2025.02.012

Abstract

In light of the limitations of existing object detection models in extracting complex features of oil spill areas and identifying irregularly shaped oil spill regions, an improved Mask R-CNN model is proposed to better adapt to the task of oil spill detection on the sea surface. Firstly, a deformable convolution module is introduced into the feature extraction network of the model to enhance its perception of irregularly shaped oil spill areas. Secondly, an improved attention mechanism is incorporated into the model, which not only strengthens the model's ability to capture key features of oil spill areas but also adds relatively few parameters. Lastly, the Complete Intersection over Union Loss (CIoU Loss) function is utilized as the bounding box regression loss function, thereby improving the model's performance in the bounding box regression task. Experiments conducted on a publicly available Synthetic Aperture Radar (SAR) sea surface oil spill dataset demonstrate that the detection accuracy of the improved model is 66.14%, representing an increase of 5.33% compared to the original Mask R-CNN model. Moreover, on the same dataset, when compared with object detection models Yolov9, Yolov10, Faster R-CNN, and Cascade R-CNN, the accuracy is respectively enhanced by 31.79%, 19.01%, 30.47%, and 21.02%. In comparison with instance segmentation models Yolact and Yolov5-seg, the accuracy is respectively elevated by 22.94% and 29.5%.

参考文献

[1]任广波, 过杰, 马毅, 等. 海面溢油无人机高光谱遥感检测与厚度估算方法[J]. 海洋学报, 2019, 41(5):  146-158.
REN G B, GUO J, MA Y, et al. Oil spill detection and slick thickness measurement via UAV hyperspectral imaging[J]. Acta Oceanologica Sinica, 2019,41(5): 146-158. (in Chinese)
[2]Al-RUZOUQ R, GIBRIL M.B.A., SHANABLEH A,  et al. Sensors, Features, and Machine Learning for Oil Spill Detection and Monitoring: A Review[J]. Remote Sensing, 2020, 12 (20): 3338.
[3]LIU P, ZHAO C F, LI X F, et al. Identification of ocean oil spills in SAR imagery based on fuzzy logic algorithm[J]. International Journal of Remote Sensing,  2010, 31(17-18): 4819-4833.
[4]OZIGIS M.S., KADUK J.D., JARVIS C.H. Mapping terrestrial oil spill impact using machine learning random forest and Landsat 8 OLI imagery: A case site within the Niger Delta region of Nigeria[J]. Environmental Science and Pollution Research, 2019,  26, 3621–3635. 
[5]LIU P, LI Y, XU J, et al. Oil Spill Extraction by X-Band Marine Radar Using Texture Analysis and Adaptive Thresholding[J]. Remote Sensing Letters, 2019, 10 (6): 583–589.
[6]SHU Y M, LI J, YOUSIF H, et al. Dark-Spot Detection from SAR Intensity Imagery with Spatial Density Thresholding for Oil-Spill Monitoring[J]. Remote Sensing of Environment, 2010, 114 (9): 2026–2035.
[7]WANG W D, SHENG H, LIU S W, et al. An Edge-Preserving Active Contour Model with Bilateral Filter Based on Hyperspectral Image Spectral Information for Oil Spill Segmentation[C]// 2019 10th Workshop on Hyperspectral Imaging and Signal Processing:  Evolution in Remote Sensing (WHISPERS). Amsterdam, Netherlands: IEEE, 2019, 1–5.
[8]CANTORNA D, DAFONTE C, IGLESIAS A, et al. Oil Spill Segmentation in SAR Images Using Convolutional Neural Networks. A Comparative Analysis with Clustering and Logistic Regression Algorithms[J]. Applied Soft Computing, 2019, 84: 105716.
[9]PARK S.H, JUNG H.S, LEE M.J. Oil Spill Mapping from Kompsat-2 High-Resolution Image Using Directional Median Filtering and Artificial Neural Network[J]. Remote Sensing, 2020, 12 (2): 253.
[10]BIANCHI F.M, ESPESETH M.M, BORCH N. Large-Scale Detection and Categorization of Oil Spills from SAR Images with Deep Learning[J]. Remote Sensing, 2020, 12 (14): 2260.
[11]FINGAS M, BROWN C E. A Review of Oil Spill Remote Sensing[J]. Sensors, 2018, 18(1): 91.
[12]CHEN P, ZHOU H, LI Y, et al. Oil Spill Identification in Radar Images Using a Soft Attention Segmentation Model[J]. Remote Sensing, 2022, 14(9): 2180.
[13]YEKEEN S T, BALOGUN A L, WAN YUSOF K B, et al. A novel deep learning instance segmentation model for automated marine oil spill detection[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2020, 167(1): 190-200. 
[14]CAI Y P, CHEN L S, ZHUANG X B, et al. Automated marine oil spill detection algorithm based on single-image generative adversarial network and YOLO-v8 under small samples[J]. Marine Pollution Bulletin, 2024, 203: 116475. 
[15]DAI J F, QI H Z, XIONG Y W, et al. Deformable Convolutional Networks[C]// 2017 IEEE International Conference on Computer Vision (ICCV). Venice: IEEE, 2019: 764-773.
[16]周慧, 朱虹, 陈澎. 基于可变形的多尺度自注意力特征融合SAR影像舰船识别[J]. 大连海事大学学报, 2024, 50(4): 110-118.
ZHOU H, ZHU H, CHEN P. Deformable-based multi-scale self-attentive feature fusion for SAR image ship recognition[J]. Journal of Dalian Maritime University, 2024, 50(4): 110-118. (in Chinese)
[17]CHEN P, ZHOU H, LI Y, et al. A Novel Deep Learning Network with Deformable Convolution and Attention Mechanisms for Complex Scenes Ship Detection in SAR Images[J]. Remote Sensing, 2023, 15(10): 2589.
[18]WOO S H, PARK J C, LEE J Y, et al. CBAM: Convolutional Block Attention Module [C]// Computer Vision- ECCV 2018. Berlin, Heidelberg: Springer-Verlag, 2018: 3-19.
[19]付国栋, 黄进, 杨涛, 等. 改进CBAM的轻量级注意力模型[J]. 计算机工程与应用,2021,57(20):150-156.
FU G D, HUANG J, YANG T, et al. Improved Lightweight Attention Model Based on CBAM[J]. Computer Engineering and Application, 2021, 57(20): 150-156. (in Chinese)
[20]雷浩, 苑迎春, 许楠, 等. 基于改进注意力机制和多语义特征增强的自然环境下枣品种识别方法[J]. 农业机械学报, 2024, 55(7): 270-279+324. 
LIE H, YUAN Y C, XU N, et al. Jujube Variety Recognition Based on Improved Attention Mechanism and Multi-semantic Feature Enhancement[J]. Transactions of the Chinese Society of Agricultural Machinery, 2024, 55(7): 270-279+324. (in Chinese)
[21]丘锐聪, 周海峰, 陈颖, 等. 融合可切换空洞卷积的上下文信息增强船舶目标检测算法[J]. 大连海事大学学报, 2023, 49(4): 116-125. 
QIU R C, ZHOU H F, CHEN Y, et al. Ship target detection algorithm based on context augmentation information with switchable dilated convolution[J]. Journal of Dalian Maritime University, 2023, 49(4): 116-125. (in Chinese)
[22]方鹏, 郝宏运, 李腾飞, 等. 基于注意力机制和可变形卷积的鸡只图像实例分割提取[J]. 农业机械学报, 2021, 52(4): 257-265.
FANG P, HAO H Y, LI T F, et al. Instance Segmentation of Broiler Image Based on Attention Mechanism and Deformable Convolution[J]. Transactions of the Chinese Society of Agricultural Machinery, 2021, 52(4): 257-265. (in Chinese)
[23]GIRSHICK R. Fast R-CNN[C]// Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV). Santiago, Chile: IEEE, 2015: 1440-1448. 
[24]ZHENG Z H, WANG P, LIU W, et al. Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2020, 34(07): 12993-13000.
[25] ZHU Q Q, ZHANG Y N, LI Z Q, et al. Oil Spill Contextual and Boundary-Supervised Detection Network Based on Marine SAR Images[J]. IEEE Transactions on Geoscience and Remote Sensing, 2022, 60: 5213910. 
[26]王延平, 张泗文, 王志强, 等. 墨西哥湾“深水地平线”钻井平台事故分析与反思[J]. 安全、健康和环境, 2011, 11(8): 5-8.
WANG Y P, ZHANG S W, WANG Z Q, et al. Analysis and Reflection of Deep Horizon Rig Incident in Mexico Gulf [J]. Safety, Health, and Environment, 2011, 11(8): 5-8. (in Chinese)
[27]NAZ S, IQBAL M F, MAHMOOD I, et al. Marine oil spill detection using Synthetic Aperture Radar over Indian Ocean[J]. Marine Pollution Bulletin, 2021,162: 111921. 
[28]PADILLA R, NETTO S L, Eduardo A. B. da Silva. A Survey on Performance Metrics for Object-Detection Algorithms[C]// 2020 International Conference on Systems, Signals and Image Processing (IWSSIP). Niteroi, Brazil, IEEE, 2020: 237-242.
[29]周璇, 易剑平. 基于优化CBAM改进ResNet50的异常行为识别方法[J]. 国外电子测量技术, 2024, 43(5): 36-41.
ZHOU X, YI J P. Improved abnormal behavior recognition method of ResNet50 based on optimized CBAM[J]. Foreign Electronic Measurement Technology, 2024, 43(5): 36-41. (in Chinese)

文章导航

/