Giter Site home page Giter Site logo

umbertogriffo / fast-near-duplicate-image-search Goto Github PK

View Code? Open in Web Editor NEW
142.0 7.0 20.0 29.16 MB

Fast Near-Duplicate Image Search and Delete using pHash, t-SNE and KDTree.

License: Apache License 2.0

Python 98.84% Shell 0.73% Makefile 0.43%
phash kd-tree kdtree nearest-neighbor-search nearest-neighbors near-duplicate duplicate-detection duplicates-removed perceptual-hashing t-sne

fast-near-duplicate-image-search's Issues

Installation fails for scipy on Ubuntu 20.10

I can't install this either using option 1 or option 2 from the instructions with the same error while building scipy. I'm using python 3.8.6 on Ubuntu 20.10. I've tried installing the following dependencies: sudo apt install python3-testresources gfortran python3-dev libblas3 liblapack3 liblapack-dev libblas-dev libatlas-base-dev python3-scipy

Here's a snippet of the error output (there's a lot of it):

  Building wheel for scipy (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: /home/daniel/Documents/GitHub/fast-near-duplicate-image-search/.pyenv/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-vdc1x7x4/scipy/setup
.py'"'"'; __file__='"'"'/tmp/pip-install-vdc1x7x4/scipy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(c
ompile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-y7tlt6cn
       cwd: /tmp/pip-install-vdc1x7x4/scipy/
  Complete output (9458 lines):
  /tmp/pip-install-vdc1x7x4/scipy/setup.py:114: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    import imp
  Running from scipy source directory.
  lapack_opt_info:
  lapack_mkl_info:
  customize UnixCCompiler
    libraries mkl_rt not found in ['/home/daniel/Documents/GitHub/fast-near-duplicate-image-search/.pyenv/lib', '/usr/local/lib', '/usr/lib', '/usr/lib/x86_64-linux-gnu']
    NOT AVAILABLE
  
  openblas_lapack_info:
  customize UnixCCompiler
  customize UnixCCompiler
    libraries openblas not found in ['/home/daniel/Documents/GitHub/fast-near-duplicate-image-search/.pyenv/lib', '/usr/local/lib', '/usr/lib', '/usr/lib/x86_64-linux-gnu']
    NOT AVAILABLE
  
  openblas_clapack_info:
  customize UnixCCompiler
  customize UnixCCompiler
    libraries openblas,lapack not found in ['/home/daniel/Documents/GitHub/fast-near-duplicate-image-search/.pyenv/lib', '/usr/local/lib', '/usr/lib', '/usr/lib/x86_64-linux-gnu']
    NOT AVAILABLE
  
  atlas_3_10_threads_info:
  Setting PTATLAS=ATLAS
  customize UnixCCompiler
    libraries lapack_atlas not found in /home/daniel/Documents/GitHub/fast-near-duplicate-image-search/.pyenv/lib
  customize UnixCCompiler
    libraries tatlas,tatlas not found in /home/daniel/Documents/GitHub/fast-near-duplicate-image-search/.pyenv/lib
  customize UnixCCompiler
    libraries lapack_atlas not found in /usr/local/lib
  customize UnixCCompiler
    libraries tatlas,tatlas not found in /usr/local/lib
  customize UnixCCompiler
    libraries lapack_atlas not found in /usr/lib
  customize UnixCCompiler
    libraries tatlas,tatlas not found in /usr/lib
  customize UnixCCompiler
    libraries lapack_atlas not found in /usr/lib/x86_64-linux-gnu/atlas
  customize UnixCCompiler
    libraries tatlas,tatlas not found in /usr/lib/x86_64-linux-gnu/atlas

installation

Hi! Thank you very much for making this open-source!

I tried installing the package using multiple ways (Option 1 in INSTALL.md: ./install.sh, option 3 in INSTALL.md, and make all) but I still get: -bash: deduplication: command not found.

Option 1 was mostly successful with the exception of the installation of mkl-ftt. make all failed with the following error:

which: no activate in (/home/arjung2/.conda/envs/fast_near_duplicate_img_src_py3/bin:/opt/apps/swsuite/bin:/usr/local/cuda-10.1/bin:/opt/apps/openmpi-4.0.0-gcc-4.8.5/bin:/usr/local/cuda/bin:/usr/lib64/qt-3.3/bin:/opt/apps/anaconda3/condabin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/ibutils/bin:/home/arjung2/.local/bin:/home/arjung2/bin)
echo 

source  && conda env create -f environment.yml && conda deactivate
/bin/bash: line 0: source: filename argument required
source: usage: source filename [arguments]
make: *** [setup] Error 2

Any ideas? Thank you once again for making this work open-source!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.