Deep learning for autonomous ship-oriented small ship detection

Zhijun Chen, Depeng Chen, Yishi Zhang*, Xiaozhao Cheng, Mingyang Zhang, Chaozhong Wu

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review


Small ship detection is an important topic in autonomous ship technology and plays an essential role in shipping safety. Since traditional object detection techniques based on the shipborne radar are not qualified for the task of near and small ship detection, deep learning-based image recognition methods based on video surveillance systems can be naturally utilized on autonomous vessels to effectively detect near and small ships. However, a limited number of real-world samples of small ships may fail to train a learning method that can accurately detect small ships in most cases. To address this, a novel hybrid deep learning method that combines a modified Generative Adversarial Network (GAN) and a Convolutional Neural Network (CNN)-based detection approach is proposed for small ship detection. Specifically, a Gaussian Mixture Wasserstein GAN with Gradient Penalty is utilized to first directly generate sufficient informative artificial samples of small ships based on the zero-sum game between a generator and a discriminator, and then an improved CNN-based real-time detection method is trained on both the original and the generated data for accurate small ship detection. Experimental results show that the proposed deep learning method (a) is competent to generate sufficient informative small ship samples and (b) can obtain significantly improved and robust results of small ship detection. The results also indicate that the proposed method can be effectively applied to ensuring autonomous ship safety.

Original languageEnglish
Article number104812
Number of pages9
JournalSafety Science
Early online date18 Jun 2020
Publication statusE-pub ahead of print - 18 Jun 2020
MoE publication typeA1 Journal article-refereed


  • Autonomous ship
  • Convolutional neural network
  • Ship safety
  • Small ship detection
  • Wasserstein generative adversarial network

Fingerprint Dive into the research topics of 'Deep learning for autonomous ship-oriented small ship detection'. Together they form a unique fingerprint.

  • Cite this