carloszhang999/image-matching-webui

🤗 image matching toolbox webui

Image Matching WebUI
find matches between 2 images

Description

This simple tool efficiently matches image pairs using multiple famous image matching algorithms. The tool features a Graphical User Interface (GUI) designed using gradio. You can effortlessly select two images and a matching algorithm and obtain a precise matching result. Note: the images source can be either local images or webcam images.

Here is a demo of the tool:

The tool currently supports various popular image matching algorithms, namely:

• LightGlue, ICCV 2023
• DeDoDe, TBD
• DarkFeat, AAAI 2023
• ASTR, CVPR 2023
• SEM, CVPR 2023
• DeepLSD, CVPR 2023
• GlueStick, ArXiv 2023
• ConvMatch, AAAI 2023
• SOLD2, CVPR 2021
• LineTR, RA-L 2021
• DKM, CVPR 2023
• RoMa, Arxiv 2023
• NCMNet, CVPR 2023
• TopicFM, AAAI 2023
• AspanFormer, ECCV 2022
• LANet, ACCV 2022
• LISRD, ECCV 2022
• REKD, CVPR 2022
• ALIKE, ArXiv 2022
• SGMNet, ICCV 2021
• SuperPoint, CVPRW 2018
• SuperGlue, CVPR 2020
• D2Net, CVPR 2019
• R2D2, NeurIPS 2019
• DISK, NeurIPS 2020
• Key.Net, ICCV 2019
• OANet, ICCV 2019
• SOSNet, CVPR 2019
• SIFT, IJCV 2004

How to use

HuggingFace

Just try it on HF

or deploy it locally following the instructions below.

Requirements

git clone --recursive https://github.com/Vincentqyw/image-matching-webui.git
cd image-matching-webui
conda env create -f environment.yaml
conda activate imw

Run demo

python3 ./app.py

then open http://localhost:7860 in your browser.

Add your own feature / matcher

I provide an example to add local feature in hloc/extractors/example.py. Then add feature settings in confs in file hloc/extract_features.py. Last step is adding some settings to model_zoo in file extra_utils/utils.py.

Contributions welcome!

External contributions are very much welcome. Please follow the PEP8 style guidelines using a linter like flake8 (reformat using command python -m black .). This is a non-exhaustive list of features that might be valuable additions:

• add webcam support
• add line feature matching algorithms
• example to add a new feature extractor / matcher
• ransac to filter outliers
• support export matches to colmap (#issue 6)
• add config file to set default parameters
• dynamically load models and reduce GPU overload

Adding local features / matchers as submodules is very easy. For example, to add the GlueStick:

git submodule add https://github.com/cvg/GlueStick.git third_party/GlueStick

If remote submodule repositories are updated, don't forget to pull submodules with git submodule update --remote, if you only want to update one submodule, use git submodule update --remote third_party/GlueStick.

Resources

• Image Matching: Local Features & Beyond
• Long-term Visual Localization

Acknowledgement

This code is built based on Hierarchical-Localization. We express our gratitude to the authors for their valuable source code.