基于改进YOLOv5l的轻量化水面目标检测模型

展开
  •  (1.大连海事大学  a.航海学院;b.人工智能学院,辽宁 大连 116026;2.中国科学院大学 人工智能学院,北京 100049) 
李正忠(1996 — ),男,博士生,研究方向:交通运输,E-mail:centerli24@dlmu.edu.cn。 任鸿翔*(1974 — ),男,博士,教授,博士生导师,E-mail:dmu_rhx@dlmu.edu.cn。 邱绍杨(1992 — ),男,博士后,研究方向:交通信息工程及控制。 杨晓(1983 — ),男,博士,副教授,研究方向:船舶运动数值模拟。 唐海娜(1977 — ),女,博士,副教授,研究方向:交通运输人工智能。

收稿日期: 2024-08-21

  修回日期: 2024-08-21

  录用日期: 2024-08-21

  网络出版日期: 2024-08-21

基金资助

国家自然科学基金(52071312);交通运输行业重点科技项目(2022-ZD3-035);辽宁省应用基础研究计划(2023JH2/101300144);广西科技重大专项(桂科AA23062053);大连市科技创新基金项目(2022JJ12GX035)。

Lightweight surface object detection model based on improved YOLOv5l

Expand
  • (1a.College of Navigation;1b.College of Artificial Intelligence,Dalian Maritime University, Dalian 116026, China;2.School of Artificial Intelligence, University of Chinese Academy of Science, Beijing 100049, China)

Received date: 2024-08-21

  Revised date: 2024-08-21

  Accepted date: 2024-08-21

  Online published: 2024-08-21

摘要

为提升内河航行场景下水面小目标的检测效果,降低模型复杂度,本文提出了一种基于改进YOLOv5l的轻量化水面目标检测模型。该模型以YOLOv5l作为基础模型,首先对定位损失函数进行改进,提出了NWD-CIoU函数,提升模型对小目标的召回率,增加模型的多尺度目标检测能力;其次,将FasterBlock模块与C3模块进行结合提出了C3_Faster模块,对YOLOv5l模型的主干网络进行优化,减少网络参数,降低模型复杂度;再次,基于Slimming方法对模型进行剪枝,大幅修剪冗余连接,减少模型参数和运算复杂度,提升推理速度;最后,基于通道知识蒸馏方法,以YOLOv5x作为教师模型对剪枝后模型进行蒸馏,以提升模型的检测效果。实验结果证明,本文所提出模型对内河航行场景下的水面目标具有较好的检测效果和检测速度,且相比于原YOLOv5l模型参数量减少了81.48%,GFLOPs减少了80.69%,更适合计算资源受限的移动设备上部署,具有一定的工程意义。

本文引用格式

李正忠, 任鸿翔, 邱绍杨, 杨晓, 唐海娜 . 基于改进YOLOv5l的轻量化水面目标检测模型[J]. 大连海事大学学报, 2025 , 51(1) : 71 -81 . DOI: 10.16411/j.cnki.issn1006-7736.2025.01.008

Abstract

In order to improve the detection effect of water surface small objects in inland navigation scenarios and reduce the model’s complexity, a lightweight water surface object detection model based on improved YOLOv5l is proposed in this paper. The model takes YOLOv5l as the base model, firstly, the positioning loss function is improved, and the NWD-CIoU function is proposed to improve the recall rate of the model for small objects and increase the multi-scale object detection capability of the model. Secondly, combining FasterBlock module and C3 module, C3_Faster module is proposed to optimize the backbone network of YOLOv5l model, reducing network’s parameters and reducing model’s complexity. Thirdly, the slimming method is used to prune the model, greatly trim the redundant connections, reduce the model’s parameters and operational complexity, and improve the inference speed. Finally, based on the channel knowledge distillation method, the YOLOv5x was used as the teacher model to distill the pruned model to improve the detection effect of the model. The experimental results show that the proposed model has a better detection effect and speed for water surface objects in inland navigation scenarios, and compared with the original YOLOv5l model, the number of parameters decreases by 81.48%, and GFLOPs decreases by 80.69%, which is more suitable for deployment on mobile devices with limited computing resources, and thereby offering practical engineering significance.

参考文献

[1] 任思羽,黄琦麟,左良栋,等.面向智能航道巡检的水面目标检测算法[J].重庆大学学报,2024,47(4):114-126.
REN S Y, HUANG Q L, ZUO L D, et al. Surface object detection algorithm for intelligent waterway inspection [J]. Journal of Chongqing University, 2024,47(4):114-126. (in Chinese)
[2] 郭保坤.AIS在当代航海技术中的应用研究[J].中国水运,2024(2):83-86.
GUO B K. Application of AIS in contemporary navigation technology [J]. China Maritime Transport,2024(2):83-86. (in Chinese)
[3] 吴文静,王中训,但波,等.多模态信息融合舰船目标识别研究进展[J].探测与控制学报,2024,46(2):1-12.
WU W J, WANG ZH X, DAN B, et al. Research progress of ship target recognition with multi-modal information fusion [J]. Journal of Detection and Control, 2024,46(2):1-12. (in Chinese)
[4] KRIZHEVSKY A, SUTSKEVER I, HINTON GE. 2012. ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst. 25(2):84–90.
[5] ER M J, ZHANG Y N, CHEN J, et al. Ship detection with deep learning: a survey[J]. Artificial Intelligence Review, 2023, 56(10): 11825-11865. 
[6] HAN X, ZHAO L N, NING Y, et al. ShipYolo: an enhanced model for ship detection[J]. Journal of Advanced Transportation, 2021, 2021: 1-11.
[7] YU C, YOAN S. SAR ship detection based on improved YOLOv5 and BiFPN. ICT Express 10.1 (2024): 28-33.
[8] NING Y, ZHAO L N, ZHANG C, et al. STD-Yolov5: a ship-type detection model based on improved Yolov5[J]. Ships and Offshore Structures, 2022: 1-10.
[9] WANG, G H, RUI Q, YING X. M-FSDistill: A Feature Map Knowledge Distillation Algorithm for SAR Ship Detection. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (2024).
[10] 丘锐聪,周海峰,陈颖,等.基于轻量化YOLOv7-tiny的船舶目标检测算法[J].大连海事大学学报,2024,50(2):31-40.
QIU R C, ZHOU H F, CHEN Y, et al. Ship target detection algorithm based on lightweight YOLOv7-tiny [J]. Journal of Dalian Maritime University,2024,50(2):31-40. (in Chinese)
[11] 张跃博,郑元洲,李果,等.基于改进YOLOv5s的轻量化船舶检测算法[J].武汉理工大学学报(交通科学与工程版),2024,48(3):596-602.
ZHANG Y B, ZHENG Y Z, LI G, et al. Lightweight ship detection algorithm based on improved YOLOv5s [J]. Journal of Wuhan University of Technology (Transportation Science and Engineering Edition), 2024,48(3):596-602. (in Chinese)
[12] REN X Z, BAI Y W, LIU G, et al. YOLO-Lite: An efficient lightweight network for SAR ship detection. Remote Sensing 15.15 (2023): 3771.
[13] JIANG ZH J, CHEN X, GU Y, et al. Model Pruning and Deployment Optimization for Ship Detection. 2023 8th International Conference on Intelligent Computing and Signal Processing (ICSP). IEEE, 2023.
[14] XU C, WANG J W, YANG W, et al. Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark[J]. ISPRS Journal of Photogrammetry and Remote Sensing, 2022, 190: 79-93.
[15] HAN K, WANG Y H, TIAN Q, et al. Ghostnet: More features from cheap operations[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2020: 1580-1589.
[16] CHEN J R, KAO S H, HE H, et al. Run, don't walk: chasing higher FLOPS for faster neural networks. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2023.
[17] LIU ZH, LI J G, SHEN Z Q, et al. Learning efficient convolutional networks through network slimming[C]//Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 2736-2744. 
[18] SHU CH Y, LIU Y F, GAO J F, et al. Channel-wise knowledge distillation for dense prediction. Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021.
[19] ZHOU ZH G, SUN J EN, YU J B, et al. An image-based benchmark dataset and a novel object detector for water surface object detection. Front. Neurorobot. 2021, 15, 723336.
[20] YANG ZH D, LI ZH, SHAO M Q, et al. Masked generative distillation. European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2022.
[21] WEI Y, PAN X Y, QIN H W, et al. Quantization mimic: Towards very tiny cnn for object detection. Proceedings of the European conference on computer vision (ECCV). 2018.
文章导航

/