Comments (6)
Given that there's now a demo provided for image similarity search, I am closing this issue. Any further development may reopen it.
from deepdetect.
Good initiative! Link to the paper: http://www.iis.sinica.edu.tw/~kevinlin311.tw/cvprw15.pdf
Original implementation, using an old version of Caffe: https://github.com/kevinlin311tw/caffe-cvprw15
I believe this can be achieved in a few steps:
- Setup the appropriate
.prototxt
file with added latent layer, see https://gist.github.com/kevinlin311tw/266d4150a1db5810398e for replicate of the original on CIFAR - Getting access to the net's inner layers through the API, and this is already on our todolist in a dedicated ticket, see #56
- Implement thresholding into dd for creating the binary features out of any layer. I believe that it makes sense to have this right into deepdetect, typically with a boolean
binarized
passed to theoutput
connector - Figure out what proper format is needed for indexing into ES: Hamming distance is a comparison metric of choise, I am not sure yet how ES can be configured to appropriately compute the nearest neighbors based on Hamming (or any other non-textual) distance
- Optionally, create a simple Web interface for looking at the results. An example to start from lies in the
demo/imgdetect
repository
Note that some other works like visual search from Pinterest do not rely on an additional latent layer but use binarized features from the existing net's layers directly. This means that an intermediary step for testing the whole pipeline does not forcely require the additional latent layer.
I understand that getting access to Caffe's inner layer is a blocker here. Depending on your C++ skills you can dig into the caffelib::predict
function and gather preliminary thoughts and/or code, or let that to me, but I won't be able to work on it till after the week-end.
from deepdetect.
@masakinakada PR #59 implements most of #56 and you should now be able to move forward. Visual search should not be far. Please let me know of any progress and difficulties, if any.
from deepdetect.
Hi Em,
Thank you so much for this update. You are my life saver. I was trying to modify other part of the code but was a bit struggling.
I will try to complete it with your awesome update!
Thank you very much. I will give you update on my progress.
Masaki
Sent from iPhone
On Feb 3, 28 Heisei, at 11:14 PM, Emmanuel Benazera [email protected] wrote:
@masakinakada PR #59 implements most of #56 and you should now be able to move forward. Visual search should not be far. Please let me know of any progress and difficulties, if any.
―
Reply to this email directly or view it on GitHub.
from deepdetect.
PR #73 gives a full example of both indexing and searching of similar images with good performances.
from deepdetect.
Awesome! Thanks a lot Ema!
On Fri, Feb 26, 2016 at 11:38 PM, Emmanuel Benazera <
[email protected]> wrote:
PR #73 https://github.com/beniz/deepdetect/pull/73 gives a full example
of both indexing and searching of similar images with good performances.—
Reply to this email directly or view it on GitHub
https://github.com/beniz/deepdetect/issues/55#issuecomment-189600748.
from deepdetect.
Related Issues (20)
- Inconsistent predictons using refinedet model HOT 12
- Memory leak on constant /predict requests HOT 8
- Refinedet Tensorrt prediction fails HOT 7
- Memory leak on compressed predict requests with oatpp HOT 7
- Different prediction with tensorrt on refinedet model for the version v0.18.0 HOT 3
- getting error while training, .solverstate HOT 23
- Chain predictions swapped between images HOT 2
- Simsearch query segfault when using IVF indexes, but not default/flat index HOT 6
- On object detect training call, missing either test or train list causes a segfault
- dd_client not find in this path anyone help HOT 2
- How do I do a face recognition using this? HOT 2
- DeepDetect full rewrite in Pure Java
- 'OCR' object has no attribute 'histogram_equalization' HOT 13
- "best: -1" in predict behaves differently in torch models HOT 2
- Torch v1.12 requires libcupti* but nvidia/cuda:11.6.0-cudnn8-runtime-ubuntu20.04 doesn't include it
- Race condition / pthread error when predicting
- I have error build xgboost HOT 1
- Using `true` or `false` instead of `1` or `0` for query params for status or labels returns a internal server error HOT 1
- Question about hosting the docker image HOT 4
- Graphics problem with tsne algorithm HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from deepdetect.