kai422/covos

[CVPR 2022] Accelerating Video Object Segmentation with Compressed Video

covos's Issues

Hello, may I know how to train this neural network model?

I have looked through the code, but I couldn't find how to train the network. Could you please tell me how to train the network?

About the meaning of cvf

Hi! Could you tell me the meaning of cvf in your code?
cvf = decode_compressed_video(video) # cvf: compressed video features

I am confused with the code in line 106 to 114, decoder.py.

cvf["residual"] = cvf["residual"]-0.5
x_rescale = 0.25 * (mv_shape[0] / cvf["height"])
y_rescale = 0.25 * (mv_shape[1] / cvf["width"])

Thanks!

I meet some error issues

Hello,Sorry to bother you.I encountered some issues while running this command" python setup.py build_ext --inplace install"
Can you help me see what the reason is,thank you!(the environment settings pytorch=1.1 cuda=11.3virtual environment python=3.10,annaconda python=3.9)
(CoVOS) WA22201024@bimk-TRX40-DESIGNARE:~/code/CoVOS-main$ python setup.py build_ext --inplace install
running build_ext
building 'mv_warp_func_gpu' extension
Emitting ninja build file /home/WA22201024/code/CoVOS-main/build/temp.linux-x86_64-cpython-310/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
ninja: error: '/home/WA22201024/code/CoVOS-main/code/CoVOS-main/lib/csrc/mv_warp_func_gpu.cpp', needed by '/home/WA22201024/code/CoVOS-main/build/temp.linux-x86_64-cpython-310/code/CoVOS-main/lib/csrc/mv_warp_func_gpu.o', missing and no known rule to make it
Traceback (most recent call last):
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1740, in _run_ninja_build
subprocess.run(
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/subprocess.py", line 526, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/WA22201024/code/CoVOS-main/setup.py", line 4, in
setup(
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/init.py", line 107, in setup
return distutils.core.setup(**attrs)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/dist.py", line 1244, in run_command
super().run_command(command)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 84, in run
_build_ext.run(self)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
self.build_extensions()
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 741, in build_extensions
build_ext.build_extensions(self)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
self._build_extensions_serial()
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
self.build_extension(ext)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/command/build_ext.py", line 246, in build_extension
_build_ext.build_extension(self, ext)
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
objects = self.compiler.compile(
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 562, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1419, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/home/WA22201024/anaconda3/envs/CoVOS/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1756, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension