Research status and prospects of infrared ship detection&nbsp;

WANG Yong, WANG Bairong, MU Dongdong

doi:10.16411/j.cnki.issn1006-7736.2023.04.012

Journal of Dalian Maritime University >

2023 , Vol. 49 >Issue 4: 103 - 115

DOI: https://doi.org/10.16411/j.cnki.issn1006-7736.2023.04.012

Research status and prospects of infrared ship detection

Expand

(Marine Electrical Engineering College, Dalian Maritime University, Dalian 116026, China)

Received date: 2023-06-20

Revised date: 2023-09-04

Accepted date: 2023-09-04

Online published: 2023-09-04

Fold

Abstract

The characteristics of various traditional infrared detection algorithms and deep learning detection algorithms were summarized, the current research status of infrared based ship detection applications was analyzed, and the publicly available infrared ship dataset was organized. The challenges faced by infrared ship detection were analyzed, and future development trends were proposed, which can provide reference for the development of ship intelligent perception.

Key words： infrared image; ship detection; status/prospect

Cite this article

WANG Yong, WANG Bairong, MU Dongdong . Research status and prospects of infrared ship detection [J]. Journal of Dalian Maritime University, 2023 , 49(4) : 103 -115 . DOI: 10.16411/j.cnki.issn1006-7736.2023.04.012

References

[1]ZOU Z X, CHEN K Y, SHI Z W, et al. Object detection in 20 years: a survey [J]. Proceedings of the IEEE, 2023, 111(3): 257-276.

[2]HOU F J, ZHANG Y, ZHOU Y, et al. Review on infrared imaging technology [J]. Sustainability, 2022, 14(18): 11161.

[3]InfiRray Ships Datasets[OL]. [2023-03-15] http://iray.iraytek.com:7813/apply/Sea_shipping.html/.

[4]杨雪锋, 张英俊, 刘文, 等. 海上远距离目标探测中的红外图像增强算法[J]. 大连海事大学学报, 2015,41(4): 102-107.

ZHANG X F, ZHANG Y J, LIU W, et al. Algorithm of infrared image enhancement for detecting far target at sea[J]. Journal of Dalian Maritime University, 2015, 41(4): 102-107. (in Chinese)

[5]DENG L, XU G, ZHANG J, et al. Entropy-driven morphological top-hat transformation for infrared small target detection[J]. IEEE Transactions on Aerospace and Electronic Systems, 2021, 58(2): 962-975.

[6]TAN H, OU D, ZHANG L, et al. Infrared Sensation-Based Salient Targets Enhancement Methods in Low-Visibility Scenes[J]. Sensors, 2022, 22(15): 5835.

[7]WANG X, LV G, XU L. Infrared dim target detection based on visual attention[J]. Infrared Physics & Technology, 2012, 55(6): 513-521.

[8]CHEN C L P, LI H, WEI Y, et al. A local contrast method for small infrared target detection[J]. IEEE transactions on geoscience and remote sensing,2013,52(1):574-581.

[9]CHEN Y, ZHANG G, MA Y, et al. Small infrared target detection based on fast adaptive masking and scaling with iterative segmentation[J]. IEEE Geoscience and Remote Sensing Letters,2021,19:1-5.

[10]NIE J, QU S, WEI Y, et al. An infrared small target detection method based on multiscale local homogeneity measure[J]. Infrared Physics & Technology, 2018,90:186-194.

[11]DU P, HAMDULLA A. Infrared small target detection using homogeneity-weighted local contrast measure[J]. IEEE Geoscience and Remote Sensing Letters,2019,17(3):514-518.

[12]ZHAO J, CHEN J, CHEN Y, et al. Sparse-representation -based automatic target detection in infrared imagery[J]. Infrared Physics & Technology,2013,56:85-92.

[13]LU Y, HUANG S, ZHAO W. Sparse representation based infrared small target detection via an online-learned double sparse background dictionary[J]. Infrared Physics & Technology,2019,99:14-27.

[14]LIU D, LI Z, LIU B, et al. Infrared small target detection in heavy sky scene clutter based on sparse representation[J]. Infrared Physics & Technology, 2017,85:13-31.

[15]GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition, 2014: 580-587.

[16]孙海蓉, 周映杰. 基于散点图-AlexNet网络的光伏红外热图像识别方法[J].太阳能学报,2023,44(1):55-61.

SUN H R, ZHOU Y J. Photovoltaic infrared thermal image recognition method based on scatter Plot-AlexNet network[J]. Acta Energiae Solaris Sinica, 2023,44(1):55-61. (in Chinese)

[17]赵蓬辉, 孟春宁, 常胜江. 基于改进VGG网络的单阶段船舶检测算法[J]. 光电子·激光, 2019,30(7):719-730.

ZHAO P H, MENG C N, CHANG S J. Single stage ship detection algorithm based on improved VGG network[J]. Journal of Optoelectronics Laser, 2019,30(7):719-730.(in Chinese)

[18]HE K M, ZHANG X Y, REN S Q, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015,37(9):1904-1916.

[19]REN S Q, He K M, GIRSHICK R, et al. Faster r-cnn: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):1137-1149.

[20]DENG Z P, SUN H, ZHOU S L, et al. Multi-scale object detection in remote sensing imagery with convolutional neural networks[J]. ISPRS Journal of Photogrammetry and Remote Sensing,2018, 145:3-22.

[21]LI Z M, PENG C, YU G, et al. Light-head r-cnn: In defense of two-stage object detector[J]. Arxiv, 2017,1711:07264.

[22]顾佼佼, 李炳臻, 刘克, 等. 基于改进Faster R-CNN的红外舰船目标检测算法[J]. 红外技术,2021,43(2):170-178.

GU J J, LI B Z, LIU K, et al. Infrared ship target detection algorithm based on improved faster R-CNN[J]. Infrared Technology, 2021,43(2):170-178.(in Chinese)

[23]李文璞, 谢可, 廖逍, 等. 基于Faster RCNN变电设备红外图像缺陷识别方法[J].南方电网技术, 2019,13(12):79-84.

LI W P, XIE K, LIAO X, Intelligent diagnosis method of infrared image for transformer equipment based on improved faster RCNN[J]. Southern Power System Technology,2019,13(12):79-84.(in Chinese)

[24]YANG S, JIAO D, WANG T, et al. Tire speckle interference bubble defect detection based on improved faster RCNN-FPN[J]. Sensors,2022,22(10):3907.

[25]LIU W, ANGUELOV D, ERHAN D, et al. SSD: Single shot multibox detector[C]//Lecture notes in computer science, Berlin, 2016:21-37.

[26]FU C Y, LIU W, RANGA A, et al. Dssd: Deconvolutional single shot detector[J]. arXiv,2017,1701.06659.

[27]HUANG G, LIU Z, MAATEN L V D, et al. Densely connected convolutional networks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,2017:4700-4708.

[28]SHEN Z, LIU Z, LI J, et al. Dsod: Learning deeply supervised object detectors from scratch[C] //Proceedings of the IEEE international conference on computer vision. 2017:1919-1927.

[29]HOWARD A G, ZHU M, CHEN B, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications[J]. arXiv,2017,1704.04861.

[30]CHEN Z C, GUO H Q, YANG J, et al. Fast vehicle detection algorithm in traffic scene based on improved SSD[J]. Measurement, 2022,201:111655.

[31]徐先峰, 赵万福, 邹浩泉, 等. 基于MobileNet-SSD的安全帽佩戴检测算法[J]. 计算机工程, 2021,47(10):298-305.

XU X F, ZHAO W F, ZOU H Q, et al. Detection algorithm of safety helmet wear based on MobileNet-SSD[J]. Computer Engineering,2021,47(10):298-305.(in Chinese)

[32]WANG X, LI K, SHI B, et al. Single shot multibox detector object detection based on attention mechanism and feature fusion[J]. Journal of Electronic Imaging, 2023, 32(2): 023032.

[33]吴珊, 周凤. 基于改进SSD算法的小目标检测[J]. 计算机工程,2023,49(7):179-188.

WU S, ZHOU F. Small target detection based on improved SSD algorithm[J]. Computer Engineering,2023,49(7):179-188. (in Chinese)

[34]LU X, JI J, XING Z, et al. Attention and feature fusion SSD for remote sensing object detection[J]. IEEE Transactions on Instrumentation and Measurement,2021,70:1-9.

[35]REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection[C]// Proceedings of the IEEE conference on computer vision and pattern recognition,2016:779-788.

[36]REDMON J , FARHADI A. YOLO9000: better, faster, stronger[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,2017:7263-7271.

[37]REDMON J, FARHADI A. Yolov3: An incremental improvement[J]. arXiv,2018,1804.02767.

[38]BOCHKOVSKIY A, WANG C Y, LIAO H Y M. Yolov4: Optimal speed and accuracy of object detection[J]. arXiv,2020, 2004.10934.

[39]Yolov5[OL], [2023-8-5]https://github.com/ultralytics/yolov5.

[40]QI J T, LIU X N, LIU K, et al. An improved YOLOv5 model based on visual attention mechanism: Application to recognition of tomato virus disease[J]. Computers and Electronics in Agriculture,2022,194:106780.

[41]DONG X D, YAN S, DUAN C Q. A lightweight vehicles detection network model based on YOLOv5[J]. Engineering Applications of Artificial Intelligence,2022,113:104914.

[42]李海军, 孔繁程, 林云. 基于改进的YOLOv5s红外舰船检测算法[J].系统工程与电子技术,2023,45(8):2415-2422.

LI H J, KONG F C, LIN Y. Infrared ship detection algorithm based on improved YOLOv5s[J]. Systems Engineering and Electronics,2023,45(8):2415-2422.(in Chinese)

[43]ROY A M, BHADURI J. A computer vision enabled damage detection model with improved yolov5 based on transformer prediction head[J]. arXiv, 2023, 2303. 04275.

[44]陈范凯, 李士心. 改进yolov5的无人机目标检测算法[J]. 计算机工程与应用, 2023: 1-9.

CHEN F K, LI S X. UAV target detection algorithm with improved yolov5[J]. Computer Engineering and Applications, 2023: 1-9.(in Chinese)

[45]Illegal Fishers Datasets[OL]. [2023-04-16]https://data.mendeley.com/datasets/69ncy4nxsg/1.

[46]IPATCH Datasets[OL]. [2022-10-15]http://www.cvg.reading.ac.uk/PETS2016/a.html.

[47]IRShips Datasets[OL]. [2023-03-16]https://cord.cranfield.ac.uk/articles/dataset/IRShips/12800324?file=25473653.

[48]SG-Ship Datasets[OL]. [2023-3-16]https://sites.google. com/site/dilipprasad/home/singapore-maritime-dataset.

[49]VAIS Datasets[OL]. [2022-11-03]http://vcipl-okstate.org/pbvs/bench/.

[50]YE J, YUAN Z Y, QIAN C, et al. CAA-YOLO: Combined-attention-augmented YOLO for infrared ocean ships detection[J]. Sensors, 2022,22(10):3782.

[51]LI Y S, LI Z Z, ZHU Y, et al. Thermal infrared small ship detection in sea clutter based on morphological reconstruction and multi-feature analysis[J]. Applied Science,2019,9(18):3786.

[52]FU J N, ZHANG H, WEI H G, et al. Small bounding-box filter for small target detection[J]. Optical Engineering,2021, 60(3):033107.

[53]MOON Y S, ZHANG T X, ZUO Z R, et al. Detection of sea surface small targets in infrared images based on multilevel filter and minimum risk Bayes test[J]. International Journal of Pattern Recognition and Artificial Intelligence,2000,14(7):907-918.

[54]TIAN X Q, LI S Y, YANG X, et al. Joint spatio-temporal features and sea background prior for infrared dim and small target detection[J]. Infrared Physics & Technology, 2023,130:104612.

[55]朱勇, 肖沁, 李正周, 等. 基于海面场景感知的红外小目标检测方法[J]. 光子学报,2022,51(12):294-311.

ZHU Y, XIAO Q, LI Z Z, et al. Infrared small target detection method based on maritime scene perception[J]. Acta Photonica Sinica, 2022, 51(12): 294-311.(in Chinese)

[56]MIAO R, JIANG H X, TIAN F Z. Robust ship detection in infrared images through multiscale feature extraction and lightweight CNN[J]. Sensors,2022,22(3):1226.

[57]ZHOU M, JING M H, LIU D G, et al. Multi-resolution networks for ship detection in infrared remote sensing images[J]. Infrared Physics & Technology,2018,92:183-189.

[58]LI L Y, JIANG L Y, ZHANG J W, et al. A complete YOLO-based ship detection method for thermal infrared remote sensing images under complex backgrounds[J]. Remote Sensing,2022,14(7):1534.

[59]ZHANG Y L, GUO L H, WANG Z F, et al. Intelligent ship detection in remote sensing images based on multi-layer convolutional feature fusion[J]. Remote Sensing,2020,12(20):3316.

[60]WANG W X, FU Y T, DONG F, et al. Remote sensing ship detection technology based on DoG preprocessing and shape features[C]//Proceedings of 2017 3rd IEEE International Conference on Computer and Communications,2017:1702-1706.

[61]MIAO R, JIANG H X, TIAN F Z, et al. Real-time ship detection from infrared images through multi-feature fusion[C]//IEEE International Symposium on Parallel and Distributed Processing with Applications,2021:533-538.

[62]AGHDAMI-NIA M, SHAH-HOSSEINI R, ROSTAMI A, et al. Automatic coastline extraction through enhanced sea-land segmentation by modifying Standard U-Net[J]. International Journal of Applied Earth Observation and Geoinformation,2022, 109:102785.

[63]SCHWARTZ C, SANDER I, BRUHN F, et al. Satellite image compression guided by regions of interest[J]. Sensors,2023, 23(2):730.

[64]DRIGGERS R, POLLAK E, GRIMMING R, et al. Detection of small targets in the infrared: an infrared search and track tutorial[J]. Applied Optics,2021,60(16):4762-4777.

[65]HELGESEN H H, LERIA F S, FOSSEN T I, et al. Tracking of ocean surface objects from unmanned aerial vehicles with a pan/tilt unit using a thermal camera[J]. Journal of Intelligent & Robotic Systems,2018,91(3-4):775-793.

[66]LI C M, CAI C T. A calibration and real-time object matching method for heterogeneous multi-camera system[J]. IEEE Transactions on Instrumentation and Measurement,2023,72:5010512.

[67]JAYAMOHAN C B, RAJESH R, SHARMA R, et al. Airborne compact electro optic infrared (EO/IR) system for maritime surveillance mission[C]//2nd International Conference on Range Technology,2021:21415699.

[68]LI Y S, LI Z Z, DING Z Q, et al. Automatic infrared ship target segmentation based on structure tensor and maximum histogram entropy[J]. IEEE Access,2020,8:44798-44820.

[69]MO W Y, PEI J H. Sea-sky line detection in the infrared image based on the vertical grayscale distribution feature[J]. Visual Computer, 2022,39(5):1915-1927.

[70]FU J, ZHAO J H, LI F. Infrared sea-sky line detection utilizing self-adaptive laplacian of gaussian filter and visual-saliency-based probabilistic hough transform[J]. IEEE Geoscience and Remote Sensing Letters,2021,19:7002605.

[71]DENG H, SUN X P, ZHOU X. Multiscale fuzzy metric for detecting small infrared targets against chaotic cloudy/sea-sky backgrounds[J]. IEEE Transactions on Cybernetics,2019,49(5):1694-1707.

Options

Outlines

模态框（Modal）标题

Abstract

Cite this article

References