An improved ORB_SLAM2 in dynamic scene with semantic segmentation

  • WANG Zhao-dong ,
  • GUO Chen
Expand
  • Marine Electrical Engineering College,Dalian Maritime University, Dalian 116026, China)

Received date: 2018-06-19

  Revised date: 2018-07-21

  Online published: 2018-07-21

Abstract

In order to improve the accuracy of ORB_SLAM2 in dynamic scene, this paper proposed a method of using semantic segmentation to eliminate the mobile feature points distributed on the human body to improve the accuracy of pose. This method extracted ORB feature points from the input image, semantically segmented the image to obtain the position of the pixels in the image, and then eliminated these feature points distributed on the top of the human body, and estimated the pose using the relatively stable feature points after eliminating. The improved method was tested on the TUM data set, and results show that it can reduce absolute error and relative drift under dynamic environment, which proves that the method is more accurate in pose estimation than the traditional in the dynamic scene.

Cite this article

WANG Zhao-dong , GUO Chen . An improved ORB_SLAM2 in dynamic scene with semantic segmentation[J]. Journal of Dalian Maritime University, 2018 , 44(4) : 121 -126 . DOI: 10.16411/j.cnki.issn1006-7736.2018.04.018

References

[1]余杰. 基于ORB关键帧闭环检测算法的SLAM方法研究[D]. 浙江工业大学, 2016.
Yu Jie. Realization of SLAM Based on Improved ORB Key Frame Detection and Matching[D]. Zhejiang University of Technology, 2016.
[2]Cheng M M, Zheng S, Lin W Y, et al. ImageSpirit:Verbal Guided Image Parsing[J]. Acm Transactions on Graphics, 2014, 34(1):1-11.
[3]Jiang F, Gu Q, Hao HZ, Li N, Guo YW, Chen DX. Survey on content-based image segmentation methods. Ruan Jian Xue Bao/Journal of Software, 2017,28(1):160-183 (in Chinese). http://www.jos.org.cn/1000-9825/5136.htm
姜枫,顾庆,郝慧珍,李娜,郭延文,陈道蓄.基于内容的图像分割方法综述.软件学报,2017,28(1):160?183.
http:// www.jos.org.cn/1000-9825/5136.htm
[4]Salehi A, Gay-Bellile V, Bourgeois S, et al. Improving Constrained Bundle Adjustment Through Semantic Scene Labeling[J]. 2016.
[5]An L, Zhang X, Gao H, et al. Semantic segmentation–aided visual odometry for urban autonomous driving[J]. 2017, 14(5):172988141773566.
[6]Papon J, Schoeler M. Semantic Pose Using Deep Networks Trained on Synthetic RGB-D[C]// IEEE International Conference on Computer Vision. IEEE, 2016:774-782.
[7]高翔,张涛.视觉SLAM十四讲[M].北京:电子工业出版社,2017:26-20.
Xiang Gao, Tao Zhang. 视觉SLAM十四讲[M].Beijing: Publishing House of Electronics Industry, 2017:26-20.
[8]Mur-Artal R, Tardós J D. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras[J]. IEEE Transactions on Robotics, 2017, 33(5):1255-1262
[9]Badrinarayanan V, Kendall A, Cipolla R. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2015, PP(99):1-1.
[10]K. Simonyan and A. Zisserman, “Very deep convolutional networks forlarge-scale image recognition,” arXiv preprint arXiv:1409.1556, 2014.
Outlines

/