tzutalin/awesome-visual-slam

:books: The list of vision-based SLAM / Visual Odometry open source, blogs, and papers

The list of vision-based SLAM / Visual Odometry open source projects, libraries, dataset, tools, and studies

Index

• Libraries
• Dataset
• Tools
• Projects
• Learn
• Miscellaneous

Libraries

Basic vision and trasformation libraries

• OpenCV
• Eigen
• Sophus
• ROS
• PointCloud

Thread-safe queue libraries

• concurrentqueue
• Intel® TBB
• Facebook folly PC

Loop detection

• dorian3d

Graph Optimization

• ceres-solver
• g2o
• gtsam
• Vertigo

Map library

• ETHZ ASL/Grid Map
• OmniMapper
• OctoMap

Dataset

Dataset for benchmark/test/experiment/evalutation

• TUM University
• KITTI Vision benchmark
• UNI-Freiburg
• ADVIO
• Oxford RobotCar Dataset
• HRI (Honda Research Institute) Driving Datasets
• Argoverse
• nuScenes
• Waymo Open Dataset
• Lyft Level 5 AV Dataset 2019
• KAIST Urban Dataset

Tools

• rgbd-dataset tool from TUM
• evo - evaluation tool for different trajectory formats
• VDO_SLAM - A Visual Object-aware Dynamic SLAM library

Projects

RGB (Monocular):

• Kimera. Available on ROS

A. Rosinol, M. Abate, Y. Chang, L. Carlone. Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mapping. arXiv preprint arXiv:1910.02490.

• PTAM

[1] Georg Klein and David Murray, "Parallel Tracking and Mapping for Small AR Workspaces", Proc. ISMAR 2007 [2] Georg Klein and David Murray, "Improving the Agility of Keyframe-based SLAM", Proc. ECCV 2008

• DSO. Available on ROS

Direct Sparse Odometry, J. Engel, V. Koltun, D. Cremers, In arXiv:1607.02565, 2016 A Photometrically Calibrated Benchmark For Monocular Visual Odometry, J. Engel, V. Usenko, D. Cremers, In arXiv:1607.02555, 2016

• LSD-SLAM. Available on ROS

LSD-SLAM: Large-Scale Direct Monocular SLAM, J. Engel, T. Schöps, D. Cremers, ECCV '14 Semi-Dense Visual Odometry for a Monocular Camera, J. Engel, J. Sturm, D. Cremers, ICCV '13

• ORB-SLAM. Available on ROS

[1] Raúl Mur-Artal, J. M. M. Montiel and Juan D. Tardós. ORB-SLAM: A Versatile and Accurate Monocular SLAM System. IEEE > Transactions on Robotics, vol. 31, no. 5, pp. 1147-1163, 2015. (2015 IEEE Transactions on Robotics Best Paper Award). PDF. [2] Dorian Gálvez-López and Juan D. Tardós. Bags of Binary Words for Fast Place Recognition in Image Sequences. IEEE > Transactions on Robotics, vol. 28, no. 5, pp. 1188-1197, 2012. PDF.

• Nister's Five Point Algorithm for Essential Matrix estimation, and FAST features, with a KLT tracker

D. Nister, “An efficient solution to the five-point relative pose problem,” Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 26, no. 6, pp. 756–770, 2004.

• SVO-SLAM. Available on ROS

Christian Forster, Matia Pizzoli, Davide Scaramuzza, "SVO: Fast Semi-direct Monocular Visual Odometry," IEEE International Conference on Robotics and Automation, 2014.

RGB and Depth (Called RGBD):

• OpenCV RGBD-Odometry (Visual Odometry based RGB-D images)

Real-Time Visual Odometry from Dense RGB-D Images, F. Steinbucker, J. Strum, D. Cremers, ICCV, 2011

• Dense Visual SLAM for RGB-D Cameras. Available on ROS

[1]Dense Visual SLAM for RGB-D Cameras (C. Kerl, J. Sturm, D. Cremers), In Proc. of the Int. Conf. on Intelligent Robot Systems (IROS), 2013. [2]Robust Odometry Estimation for RGB-D Cameras (C. Kerl, J. Sturm, D. Cremers), In Proc. of the IEEE Int. Conf. on Robotics and Automation (ICRA), 2013 [3]Real-Time Visual Odometry from Dense RGB-D Images (F. Steinbruecker, J. Sturm, D. Cremers), In Workshop on Live Dense Reconstruction with Moving Cameras at the Intl. Conf. on Computer Vision (ICCV), 2011.

• RTAB MAP - Real-Time Appearance-Based Mapping. Available on ROS

Online Global Loop Closure Detection for Large-Scale Multi-Session Graph-Based SLAM, 2014 Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation, 2013

• ORB2-SLAM. Available on ROS

[1] Raúl Mur-Artal, J. M. M. Montiel and Juan D. Tardós. ORB-SLAM: A Versatile and Accurate Monocular SLAM System. IEEE > Transactions on Robotics, vol. 31, no. 5, pp. 1147-1163, 2015. (2015 IEEE Transactions on Robotics Best Paper Award). [2] Dorian Gálvez-López and Juan D. Tardós. Bags of Binary Words for Fast Place Recognition in Image Sequences. IEEE Transactions on Robotics, vol. 28, no. 5, pp. 1188-1197, 2012.

• InfiniTAM∞ v2

Kahler, O. and Prisacariu, V.~A. and Ren, C.~Y. and Sun, X. and Torr, P.~H.~S and Murray, D.~W. Very High Frame Rate Volumetric Integration of Depth Images on Mobile Device. IEEE Transactions on Visualization and Computer Graphics (Proceedings International Symposium on Mixed and Augmented Reality 2015

• Kintinuous

Real-time Large Scale Dense RGB-D SLAM with Volumetric Fusion, T. Whelan, M. Kaess, H. Johannsson, M.F. Fallon, J. J. Leonard and J.B. McDonald, IJRR '14

• ElasticFusion

[1] ElasticFusion: Real-Time Dense SLAM and Light Source Estimation, T. Whelan, R. F. Salas-Moreno, B. Glocker, A. J. Davison and S. Leutenegger, IJRR '16 [2] ElasticFusion: Dense SLAM Without A Pose Graph, T. Whelan, S. Leutenegger, R. F. Salas-Moreno, B. Glocker and A. J. Davison, RSS '15

• Co-Fusion

Martin Rünz and Lourdes Agapito. Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objects. 2017 IEEE International Conference on Robotics and Automation (ICRA)

RGBD and LIDAR:

• Google's cartographer. Available on ROS

Other open source projects

DynaSLAM A SLAM system robust in dynamic environments for monocular, stereo and RGB-D setups

openvslam A Versatile Visual SLAM Framework

License

awesome-visual-slam's Issues

VDO_SLAM is not included in your list

Hi @tzutalin, I've noticed VDO_SLAM is not in your list of SLAM libraries
https://github.com/halajun/vdo_slam

Want to add link

Hello,

I want to share this link. I find it very helpful. I don't know which category to add it.
Real Time Monocular 3D Reconstruction

Best regards,
Ahmed Abdel Aal

GNSS-RGBD-IMU-Wheel SLAM method： Ground-Fusion

Welcome to https://github.com/SJTU-ViSYS/Ground-Fusion ！

Some SLAM libraries are not included in the list

I noticed that OpenVSLAM and DynaSLAM are not included on this list. Should they be listed here?

Kimera-VIO is not for monocular camera

The README file of Kimera-VIO shows that the algorithm presented works using setero camera and not monocular camera. You have included it in the list of monocular slam.

Anyways, thanks a lot for compiling the resources. It is very useful.

VI-SLAM for android (ARCore/ARKit/Vuforia like)

ARCore is able to run VI-SLAM in real time on many Android phones through its package ARCore accesible when downloading Google Play Services for AR.

This solution is perfectly running on Android phones, however I cannot find a paper that proposes a 30fps solution like ARCore.

Has anyone found a paper about a similar solution?