I have repeatedly tried to relizar the installation following the instructions. The problem is that I always get the same errors and although I have individually looked for how to solve some of the errors, I still have not succeeded.
During installation, I get the following errors:
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. xformers 0.0.16rc425 requires pyre-extensions==0.0.23, which is not installed. numba 0.56.4 requires numpy<1.24,>=1.18, but you have numpy 1.24.3 which is incompatible. clean-fid 0.1.29 requires requests==2.25.1, but you have requests 2.28.2 which is incompatible.
Finally, despite the above errors the installation continues, appearing at the end the following message:
C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running bdist_egg
running egg_info
creating quant_cuda.egg-info
writing quant_cuda.egg-info\PKG-INFO
writing dependency_links to quant_cuda.egg-info\dependency_links.txt
writing top-level names to quant_cuda.egg-info\top_level.txt
writing manifest file 'quant_cuda.egg-info\SOURCES.txt'
reading manifest file 'quant_cuda.egg-info\SOURCES.txt'
writing manifest file 'quant_cuda.egg-info\SOURCES.txt'
installing library code to build\bdist.win-amd64\egg
running install_lib
running build_ext
C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py:358: UserWarning: Error checking compiler version for cl: [WinError 2] El sistema no puede encontrar el archivo especificado
warnings.warn(f'Error checking compiler version for {compiler}: {error}')
Traceback (most recent call last):
File "C:\AI\oobabooga\text-generation-webui\repositories\GPTQ-for-LLaMa\setup_cuda.py", line 4, in <module>
setup(
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\__init__.py", line 87, in setup
return distutils.core.setup(**attrs)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 185, in setup
return run_commands(dist)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\core.py", line 201, in run_commands
dist.run_commands()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 969, in run_commands
self.run_command(cmd)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 74, in run
self.do_egg_install()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install.py", line 123, in do_egg_install
self.run_command('bdist_egg')
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\bdist_egg.py", line 165, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\bdist_egg.py", line 151, in call_command
self.run_command(cmdname)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\install_lib.py", line 11, in run
self.build()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\install_lib.py", line 112, in build
self.run_command('build_ext')
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\dist.py", line 1208, in run_command
super().run_command(command)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\dist.py", line 988, in run_command
cmd_obj.run()
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\command\build_ext.py", line 84, in run
_build_ext.run(self)
File "C:\AI\oobabooga\installer_files\env\lib\site-packages\setuptools\_distutils\command\build_ext.py", line 346, in run
self.build_extensions()
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 499, in build_extensions
_check_cuda_version(compiler_name, compiler_version)
File "C:\Users\bissop\AppData\Roaming\Python\Python310\site-packages\torch\utils\cpp_extension.py", line 386, in _check_cuda_version
raise RuntimeError(CUDA_MISMATCH_MESSAGE.format(cuda_str_version, torch.version.cuda))
RuntimeError:
The detected CUDA version (12.1) mismatches the version that was used to compile
PyTorch (11.7). Please make sure to use the same CUDA versions.
CUDA kernel compilation failed.
Attempting installation with wheel.
Collecting quant-cuda==0.0.0
Using cached https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/raw/main/quant_cuda-0.0.0-cp310-cp310-win_amd64.whl (398 kB)
Installing collected packages: quant-cuda
Successfully installed quant-cuda-0.0.0
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent