Giter Site home page Giter Site logo

alibaba-damo-academy / funclip Goto Github PK

View Code? Open in Web Editor NEW
2.1K 19.0 192.0 42.99 MB

Open-source, accurate and easy-to-use video speech recognition & clipping tool, LLM based AI clipping intergrated.

License: MIT License

Python 98.74% Shell 1.26%
speech-recognition video-clip video-subtitles subtitles-generator speech-to-text gradio gradio-python-llm llm

funclip's Issues

运行imagemagick_test.py报错,FileNotFoundError: [WinError 2] 系统找不到指定的文件

PS D:\model\FunClip-main\funclip> ..\runtime\python.exe .\imagemagick_test.py
Traceback (most recent call last):
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\video\VideoClip.py", line 1137, in init
subprocess_call(cmd, logger=None)
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\tools.py", line 46, in subprocess_call
proc = sp.Popen(cmd, **popen_params)
File "D:\model\FunClip-main\runtime\lib\subprocess.py", line 969, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "D:\model\FunClip-main\runtime\lib\subprocess.py", line 1438, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] 系统找不到指定的文件。

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\model\FunClip-main\funclip\imagemagick_test.py", line 10, in
subtitles = SubtitlesClip(subs, generator)
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\video\tools\subtitles.py", line 86, in init
hasmask = bool(self.make_textclip('T').mask)
File "D:\model\FunClip-main\funclip\imagemagick_test.py", line 4, in
generator = lambda txt: TextClip(txt, font='./font/STHeitiMedium.ttc', fontsize=48, color='white')
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\video\VideoClip.py", line 1146, in init
raise IOError(error)
OSError: MoviePy Error: creation of None failed because of the following error:

[WinError 2] 系统找不到指定的文件。.

.This error can be due to the fact that ImageMagick is not installed on your computer, or (for Windows users) that you didn't specify the path to the ImageMagick binary in file conf.py, or that the path you specified is incorrect

ImageMagick确实是已经安装了, 字体文件也在那个目录,还有其它原因会导致这个问题么?
PS D:\model\FunClip-main\funclip> magick --version
Version: ImageMagick 7.1.1-29 Q16-HDRI x64 0deac72:20240225 https://imagemagick.org
Copyright: (C) 1999 ImageMagick Studio LLC
License: https://imagemagick.org/script/license.php
Features: Channel-masks(64-bit) Cipher DPC HDRI Modules OpenCL OpenMP(2.0)
Delegates (built-in): bzlib cairo flif freetype gslib heic jng jp2 jpeg jxl lcms lqr lzma openexr pangocairo png ps raqm raw rsvg tiff webp xml zip zlib

TypeError: generate() missing 1 required positional argument: 'input'

funasr == 1.0.10
modelscope == 1.12.0


Traceback (most recent call last):
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 330, in
main()
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 326, in main
runner(**kwargs)
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 276, in runner
res_text, res_srt, state = audio_clipper.recog((sr, wav), sd_switch)
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 35, in recog
rec_result = self.asr_pipeline(audio_in=data)
File "/data/home/yaokj5/anaconda3/envs/geneface/lib/python3.9/site-packages/modelscope/pipelines/audio/funasr_pipeline.py", line 73, in call
output = self.model(*args, **kwargs)
File "/data/home/yaokj5/anaconda3/envs/geneface/lib/python3.9/site-packages/modelscope/models/base/base_model.py", line 35, in call
return self.postprocess(self.forward(*args, **kwargs))
File "/data/home/yaokj5/anaconda3/envs/geneface/lib/python3.9/site-packages/modelscope/models/audio/funasr/model.py", line 61, in forward
output = self.model.generate(*args, **kwargs)
TypeError: generate() missing 1 required positional argument: 'input'

启动报错ClusterBackend is not defined

启动之后报错NameError: name 'ClusterBackend' is not defined

Traceback (most recent call last):
File "C:\PyCharmProject\FunClip-main\funclip\launch.py", line 7, in
funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
File "C:\Users\10379\AppData\Local\Programs\Python\Python310\lib\site-packages\funasr\auto\auto_model.py", line 138, in init
self.cb_model = ClusterBackend().to(kwargs["device"])
NameError: name 'ClusterBackend' is not defined

NameError: name 'ClusterBackend' is not defined

Traceback (most recent call last):
File "D:\2 github\FunClip\funclipper\launch.py", line 7, in
funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
File "C:\Users\whyuan\anaconda3\envs\py39\lib\site-packages\funasr\auto\auto_model.py", line 129, in init
self.cb_model = ClusterBackend().to(kwargs["device"])
NameError: name 'ClusterBackend' is not defined

请问上述报错该如何解决呢?

报错NameError: name 'ClusterBackend' is not defined

1.平台:vmware虚拟机下的

Linux version 6.5.0-21-generic (buildd@lcy02-amd64-091) (x86_64-linux-gnu-gcc-12 (Ubuntu 12.3.0-1ubuntu122.04) 12.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #2122.04.1-Ubuntu SMP PREEMPT_DYNAMIC Fri Feb 9 13:32:52 UTC 2

2.报错情况:

(ParaClipper) $ python paraclipper/launch.py
If you want to use the speaker diarization, please `pip install hdbscan`
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
2024-03-02 22:31:26,478 - modelscope - INFO - PyTorch version 2.2.1 Found.
2024-03-02 22:31:26,483 - modelscope - INFO - TensorFlow version 2.13.1 Found.
2024-03-02 22:31:26,485 - modelscope - INFO - Loading ast index from /home/lzo/.cache/modelscope/ast_indexer
2024-03-02 22:31:26,909 - modelscope - INFO - Loading done! Current index file version is 1.12.0, with md5 a986dd5e37b563e607171cc5fb7e9553 and a total number of 964 components indexed
2024-03-02 22:31:27,715 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/model.pt
2024-03-02 22:31:41,582 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch/model.pt
2024-03-02 22:31:42,485 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch/model.pt
2024-03-02 22:31:44,738 - modelscope - INFO - Use user-specified model revision: v2.0.2
ckpt: /home/lzo/.cache/modelscope/hub/damo/speech_campplus_sv_zh-cn_16k-common/campplus_cn_common.bin
Traceback (most recent call last):
  File "paraclipper/launch.py", line 7, in <module>
    funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
  File "/home/lzo/anaconda3/envs/ParaClipper/lib/python3.8/site-packages/funasr/auto/auto_model.py", line 126, in __init__
    self.cb_model = ClusterBackend().to(kwargs["device"])
NameError: name 'ClusterBackend' is not defined

3.虚拟环境下的包

_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
absl-py                   2.1.0                    pypi_0    pypi
accelerate                0.27.2                   pypi_0    pypi
addict                    2.4.0                    pypi_0    pypi
aiofiles                  23.2.1                   pypi_0    pypi
aiohttp                   3.9.3                    pypi_0    pypi
aiosignal                 1.3.1                    pypi_0    pypi
albumentations            1.3.1                    pypi_0    pypi
aliyun-python-sdk-core    2.14.0                   pypi_0    pypi
aliyun-python-sdk-kms     2.16.2                   pypi_0    pypi
altair                    5.2.0                    pypi_0    pypi
annotated-types           0.6.0                    pypi_0    pypi
antlr4-python3-runtime    4.8                      pypi_0    pypi
anyio                     4.3.0                    pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
async-timeout             4.0.3                    pypi_0    pypi
attrs                     23.2.0                   pypi_0    pypi
audioread                 3.0.1                    pypi_0    pypi
av                        11.0.0                   pypi_0    pypi
backports-zoneinfo        0.2.1                    pypi_0    pypi
bitarray                  2.9.2                    pypi_0    pypi
black                     24.2.0                   pypi_0    pypi
blas                      1.0                         mkl  
blis                      0.7.11                   pypi_0    pypi
blobfile                  2.1.1                    pypi_0    pypi
bmt-clipit                1.0                      pypi_0    pypi
boto3                     1.34.54                  pypi_0    pypi
botocore                  1.34.54                  pypi_0    pypi
brotli-python             1.0.9            py38h6a678d5_7  
bzip2                     1.0.8                h5eee18b_5  
ca-certificates           2023.12.12           h06a4308_0  
cachetools                5.3.3                    pypi_0    pypi
catalogue                 2.0.10                   pypi_0    pypi
certifi                   2024.2.2         py38h06a4308_0  
cffi                      1.16.0                   pypi_0    pypi
chardet                   5.2.0                    pypi_0    pypi
charset-normalizer        3.3.2                    pypi_0    pypi
chumpy                    0.70                     pypi_0    pypi
click                     8.1.7                    pypi_0    pypi
clip                      1.0                      pypi_0    pypi
cloudpathlib              0.16.0                   pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
coloredlogs               15.0.1                   pypi_0    pypi
confection                0.1.4                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.1.1                    pypi_0    pypi
control-ldm               0.0.1                    pypi_0    pypi
cpuonly                   2.0                           0    pytorch
crcmod                    1.7                      pypi_0    pypi
cryptography              42.0.5                   pypi_0    pypi
cycler                    0.12.1                   pypi_0    pypi
cymem                     2.0.8                    pypi_0    pypi
cython                    3.0.8                    pypi_0    pypi
datasets                  2.18.0                   pypi_0    pypi
ddpm-guided-diffusion     0.0.0                    pypi_0    pypi
decorator                 4.4.2                    pypi_0    pypi
descartes                 1.1.0                    pypi_0    pypi
diffusers                 0.26.3                   pypi_0    pypi
dill                      0.3.8                    pypi_0    pypi
easydict                  1.12                     pypi_0    pypi
easyrobust                0.2.4                    pypi_0    pypi
edit-distance             1.0.6                    pypi_0    pypi
editdistance              0.8.1                    pypi_0    pypi
einops                    0.7.0                    pypi_0    pypi
embeddings                0.0.8                    pypi_0    pypi
emoji                     2.10.1                   pypi_0    pypi
exceptiongroup            1.2.0                    pypi_0    pypi
face-alignment            1.4.1                    pypi_0    pypi
fairscale                 0.4.13                   pypi_0    pypi
fairseq                   0.12.2                   pypi_0    pypi
fastai                    2.7.14                   pypi_0    pypi
fastapi                   0.110.0                  pypi_0    pypi
fastcore                  1.5.29                   pypi_0    pypi
fastdownload              0.0.7                    pypi_0    pypi
fastprogress              1.0.3                    pypi_0    pypi
ffmpeg                    1.4                      pypi_0    pypi
ffmpeg-python             0.2.0                    pypi_0    pypi
ffmpy                     0.3.2                    pypi_0    pypi
filelock                  3.13.1           py38h06a4308_0  
fire                      0.5.0                    pypi_0    pypi
flake8                    7.0.0                    pypi_0    pypi
flatbuffers               23.5.26                  pypi_0    pypi
fonttools                 4.49.0                   pypi_0    pypi
freetype                  2.12.1               h4a9f257_0  
frozenlist                1.4.1                    pypi_0    pypi
fsspec                    2024.2.0                 pypi_0    pypi
ftfy                      6.1.3                    pypi_0    pypi
funasr                    1.0.11                   pypi_0    pypi
future                    1.0.0                    pypi_0    pypi
fvcore                    0.1.5.post20221221          pypi_0    pypi
gast                      0.4.0                    pypi_0    pypi
gmp                       6.2.1                h295c915_3  
gmpy2                     2.1.2            py38heeb90bb_0  
gnutls                    3.6.15               he1e5248_0  
google-auth               2.28.1                   pypi_0    pypi
google-auth-oauthlib      1.0.0                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
gradio                    4.19.2                   pypi_0    pypi
gradio-client             0.10.1                   pypi_0    pypi
grpcio                    1.62.0                   pypi_0    pypi
h11                       0.14.0                   pypi_0    pypi
h5py                      3.10.0                   pypi_0    pypi
httpcore                  1.0.4                    pypi_0    pypi
httpx                     0.27.0                   pypi_0    pypi
huggingface-hub           0.21.3                   pypi_0    pypi
humanfriendly             10.0                     pypi_0    pypi
hydra-core                1.0.7                    pypi_0    pypi
idna                      3.6                      pypi_0    pypi
imageio                   2.34.0                   pypi_0    pypi
imageio-ffmpeg            0.4.9                    pypi_0    pypi
imgaug                    0.4.0                    pypi_0    pypi
importlib-metadata        7.0.1                    pypi_0    pypi
importlib-resources       6.1.2                    pypi_0    pypi
iniconfig                 2.0.0                    pypi_0    pypi
intel-openmp              2023.1.0         hdb19cb5_46306  
iopath                    0.1.10                   pypi_0    pypi
jaconv                    0.3.4                    pypi_0    pypi
jamo                      0.4.1                    pypi_0    pypi
jieba                     0.42.1                   pypi_0    pypi
jinja2                    3.1.3            py38h06a4308_0  
jmespath                  0.10.0                   pypi_0    pypi
joblib                    1.3.2                    pypi_0    pypi
jpeg                      9e                   h5eee18b_1  
jsonschema                4.21.1                   pypi_0    pypi
jsonschema-specifications 2023.12.1                pypi_0    pypi
kaldiio                   2.18.0                   pypi_0    pypi
keras                     2.13.1                   pypi_0    pypi
kiwisolver                1.4.5                    pypi_0    pypi
kornia                    0.7.1                    pypi_0    pypi
lame                      3.100                h7b6447c_0  
langcodes                 3.3.0                    pypi_0    pypi
lap                       0.4.0                    pypi_0    pypi
lazy-loader               0.3                      pypi_0    pypi
lcms2                     2.12                 h3be6417_0  
ld_impl_linux-64          2.38                 h1181459_1  
lerc                      3.0                  h295c915_0  
libclang                  16.0.6                   pypi_0    pypi
libdeflate                1.17                 h5eee18b_1  
libffi                    3.4.4                h6a678d5_0  
libgcc-ng                 11.2.0               h1234567_1  
libgomp                   11.2.0               h1234567_1  
libiconv                  1.16                 h7f8727e_2  
libidn2                   2.3.4                h5eee18b_0  
libjpeg-turbo             2.0.0                h9bf148f_0    pytorch
libpng                    1.6.39               h5eee18b_0  
librosa                   0.10.1                   pypi_0    pypi
libstdcxx-ng              11.2.0               h1234567_1  
libtasn1                  4.19.0               h5eee18b_0  
libtiff                   4.5.1                h6a678d5_0  
libunistring              0.9.10               h27cfd23_0  
libwebp-base              1.3.2                h5eee18b_0  
lightning-utilities       0.10.1                   pypi_0    pypi
llvm-openmp               14.0.6               h9e868ea_0  
llvmlite                  0.41.1                   pypi_0    pypi
lmdb                      1.4.1                    pypi_0    pypi
lpips                     0.1.4                    pypi_0    pypi
lxml                      4.9.4                    pypi_0    pypi
lyft-dataset-sdk          0.0.8                    pypi_0    pypi
lz4-c                     1.9.4                h6a678d5_0  
markdown                  3.5.2                    pypi_0    pypi
markdown-it-py            3.0.0                    pypi_0    pypi
markupsafe                2.1.5                    pypi_0    pypi
matplotlib                3.5.3                    pypi_0    pypi
mccabe                    0.7.0                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
megatron-util             1.3.2                    pypi_0    pypi
mkl                       2023.1.0         h213fc3f_46344  
mkl-service               2.4.0            py38h5eee18b_1  
mkl_fft                   1.3.8            py38h5eee18b_0  
mkl_random                1.2.4            py38hdb19cb5_0  
ml-collections            0.1.1                    pypi_0    pypi
mmcls                     0.25.0                   pypi_0    pypi
mmdet                     2.28.2                   pypi_0    pypi
mmdet3d                   1.0.0a1                  pypi_0    pypi
mmsegmentation            0.30.0                   pypi_0    pypi
mock                      5.1.0                    pypi_0    pypi
modelscope                1.12.0                   pypi_0    pypi
moviepy                   1.0.3                    pypi_0    pypi
mpc                       1.1.0                h10f8cd9_1  
mpfr                      4.0.2                hb69a4c5_1  
mpmath                    1.3.0            py38h06a4308_0  
msgpack                   1.0.8                    pypi_0    pypi
multidict                 6.0.5                    pypi_0    pypi
multiprocess              0.70.16                  pypi_0    pypi
murmurhash                1.0.10                   pypi_0    pypi
mypy-extensions           1.0.0                    pypi_0    pypi
ncurses                   6.4                  h6a678d5_0  
nerfacc                   0.2.2                    pypi_0    pypi
nettle                    3.7.3                hbbd107a_1  
networkx                  3.1              py38h06a4308_0  
ninja                     1.11.1.1                 pypi_0    pypi
nltk                      3.8.1                    pypi_0    pypi
numba                     0.58.1                   pypi_0    pypi
numpy                     1.24.4                   pypi_0    pypi
numpy-base                1.24.3           py38h060ed82_1  
nuscenes-devkit           1.1.11                   pypi_0    pypi
oauthlib                  3.2.2                    pypi_0    pypi
omegaconf                 2.0.6                    pypi_0    pypi
onnx                      1.15.0                   pypi_0    pypi
onnxruntime               1.17.1                   pypi_0    pypi
onnxsim                   0.4.35                   pypi_0    pypi
open-clip-torch           2.24.0                   pypi_0    pypi
opencv-python             4.9.0.80                 pypi_0    pypi
opencv-python-headless    4.9.0.80                 pypi_0    pypi
openh264                  2.1.1                h4ff587b_0  
openjpeg                  2.4.0                h3ad879b_0  
openssl                   3.0.13               h7f8727e_0  
opt-einsum                3.3.0                    pypi_0    pypi
orjson                    3.9.15                   pypi_0    pypi
oss2                      2.18.4                   pypi_0    pypi
packaging                 23.2                     pypi_0    pypi
paint-ldm                 0.0.0                    pypi_0    pypi
pandas                    2.0.3                    pypi_0    pypi
panopticapi               0.1                      pypi_0    pypi
pathspec                  0.12.1                   pypi_0    pypi
pillow                    10.2.0           py38h5eee18b_0  
pip                       23.3.1           py38h06a4308_0  
pkgutil-resolve-name      1.3.10                   pypi_0    pypi
platformdirs              4.2.0                    pypi_0    pypi
plotly                    5.19.0                   pypi_0    pypi
pluggy                    1.4.0                    pypi_0    pypi
plyfile                   1.0.3                    pypi_0    pypi
pooch                     1.8.1                    pypi_0    pypi
portalocker               2.8.2                    pypi_0    pypi
preshed                   3.0.9                    pypi_0    pypi
prettytable               3.10.0                   pypi_0    pypi
proglog                   0.1.10                   pypi_0    pypi
protobuf                  3.20.3                   pypi_0    pypi
psutil                    5.9.8                    pypi_0    pypi
pyarrow                   15.0.0                   pypi_0    pypi
pyarrow-hotfix            0.6                      pypi_0    pypi
pyasn1                    0.5.1                    pypi_0    pypi
pyasn1-modules            0.3.0                    pypi_0    pypi
pybind11                  2.11.1                   pypi_0    pypi
pyclipper                 1.3.0.post5              pypi_0    pypi
pycocotools               2.0.7                    pypi_0    pypi
pycodestyle               2.11.1                   pypi_0    pypi
pycparser                 2.21                     pypi_0    pypi
pycryptodome              3.20.0                   pypi_0    pypi
pycryptodomex             3.20.0                   pypi_0    pypi
pydantic                  2.6.3                    pypi_0    pypi
pydantic-core             2.16.3                   pypi_0    pypi
pydub                     0.25.1                   pypi_0    pypi
pyflakes                  3.2.0                    pypi_0    pypi
pygments                  2.17.2                   pypi_0    pypi
pymcubes                  0.1.4                    pypi_0    pypi
pynndescent               0.5.11                   pypi_0    pypi
pyparsing                 3.1.1                    pypi_0    pypi
pyquaternion              0.9.9                    pypi_0    pypi
pysocks                   1.7.1            py38h06a4308_0  
pytest                    8.0.2                    pypi_0    pypi
pythainlp                 5.0.1                    pypi_0    pypi
python                    3.8.18               h955ad1f_0  
python-crfsuite           0.9.10                   pypi_0    pypi
python-dateutil           2.9.0.post0              pypi_0    pypi
python-multipart          0.0.9                    pypi_0    pypi
pytorch                   2.2.1               py3.8_cpu_0    pytorch
pytorch-lightning         2.2.0.post0              pypi_0    pypi
pytorch-mutex             1.0                         cpu    pytorch
pytorch-wpe               0.0.1                    pypi_0    pypi
pytz                      2024.1                   pypi_0    pypi
pyvi                      0.1.1                    pypi_0    pypi
pywavelets                1.4.1                    pypi_0    pypi
pyyaml                    6.0.1            py38h5eee18b_0  
qudida                    0.0.4                    pypi_0    pypi
readline                  8.2                  h5eee18b_0  
referencing               0.33.0                   pypi_0    pypi
regex                     2023.12.25               pypi_0    pypi
requests                  2.31.0           py38h06a4308_1  
requests-oauthlib         1.3.1                    pypi_0    pypi
rich                      13.7.1                   pypi_0    pypi
rouge                     1.0.1                    pypi_0    pypi
rpds-py                   0.18.0                   pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
ruff                      0.3.0                    pypi_0    pypi
s3transfer                0.10.0                   pypi_0    pypi
sacrebleu                 2.4.0                    pypi_0    pypi
sacremoses                0.1.1                    pypi_0    pypi
safetensors               0.4.2                    pypi_0    pypi
scikit-image              0.19.3                   pypi_0    pypi
scikit-learn              1.3.2                    pypi_0    pypi
scipy                     1.10.1                   pypi_0    pypi
semantic-version          2.10.0                   pypi_0    pypi
sentencepiece             0.2.0                    pypi_0    pypi
seqeval                   1.2.2                    pypi_0    pypi
setuptools                68.2.2           py38h06a4308_0  
setuptools-scm            8.0.4                    pypi_0    pypi
shapely                   1.8.5.post1              pypi_0    pypi
shellingham               1.5.4                    pypi_0    pypi
shotdetect-scenedetect-lgss 0.0.4                    pypi_0    pypi
simplejson                3.19.2                   pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
sklearn-crfsuite          0.3.6                    pypi_0    pypi
smart-open                6.4.0                    pypi_0    pypi
smplx                     0.1.28                   pypi_0    pypi
sniffio                   1.3.1                    pypi_0    pypi
sortedcontainers          2.4.0                    pypi_0    pypi
soundfile                 0.12.1                   pypi_0    pypi
soxr                      0.3.7                    pypi_0    pypi
spacy                     3.7.4                    pypi_0    pypi
spacy-legacy              3.0.12                   pypi_0    pypi
spacy-loggers             1.0.5                    pypi_0    pypi
sqlite                    3.41.2               h5eee18b_0  
srsly                     2.4.8                    pypi_0    pypi
stanza                    1.8.1                    pypi_0    pypi
starlette                 0.36.3                   pypi_0    pypi
subword-nmt               0.3.8                    pypi_0    pypi
sympy                     1.12             py38h06a4308_0  
tabulate                  0.9.0                    pypi_0    pypi
tbb                       2021.8.0             hdb19cb5_0  
tenacity                  8.2.3                    pypi_0    pypi
tensorboard               2.13.0                   pypi_0    pypi
tensorboard-data-server   0.7.2                    pypi_0    pypi
tensorboardx              2.6.2.2                  pypi_0    pypi
tensorflow                2.13.1                   pypi_0    pypi
tensorflow-estimator      2.13.0                   pypi_0    pypi
tensorflow-io-gcs-filesystem 0.34.0                   pypi_0    pypi
termcolor                 2.4.0                    pypi_0    pypi
terminaltables            3.1.10                   pypi_0    pypi
tf-slim                   1.1.0                    pypi_0    pypi
thinc                     8.2.3                    pypi_0    pypi
thop                      0.1.1-2209072238          pypi_0    pypi
threadpoolctl             3.3.0                    pypi_0    pypi
tifffile                  2023.7.10                pypi_0    pypi
timm                      0.5.4                    pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
tokenizers                0.15.2                   pypi_0    pypi
toml                      0.10.2                   pypi_0    pypi
tomli                     2.0.1                    pypi_0    pypi
tomlkit                   0.12.0                   pypi_0    pypi
toolz                     0.12.1                   pypi_0    pypi
torch-complex             0.4.3                    pypi_0    pypi
torch-scatter             2.1.2                    pypi_0    pypi
torchaudio                2.2.1                  py38_cpu    pytorch
torchmetrics              1.3.1                    pypi_0    pypi
torchsummary              1.5.1                    pypi_0    pypi
torchvision               0.17.1                 py38_cpu    pytorch
tqdm                      4.66.2                   pypi_0    pypi
transformers              4.38.2                   pypi_0    pypi
trimesh                   2.35.39                  pypi_0    pypi
typer                     0.9.0                    pypi_0    pypi
typing-extensions         4.10.0                   pypi_0    pypi
typing_extensions         4.9.0            py38h06a4308_1  
tzdata                    2024.1                   pypi_0    pypi
ujson                     5.9.0                    pypi_0    pypi
umap-learn                0.5.5                    pypi_0    pypi
urllib3                   2.2.1                    pypi_0    pypi
utils                     1.0.2                    pypi_0    pypi
uvicorn                   0.27.1                   pypi_0    pypi
videofeatures-clipit      1.0                      pypi_0    pypi
wasabi                    1.1.2                    pypi_0    pypi
wcwidth                   0.2.13                   pypi_0    pypi
weasel                    0.3.4                    pypi_0    pypi
websockets                11.0.3                   pypi_0    pypi
werkzeug                  3.0.1                    pypi_0    pypi
wheel                     0.41.2           py38h06a4308_0  
wrapt                     1.16.0                   pypi_0    pypi
xxhash                    3.4.1                    pypi_0    pypi
xz                        5.4.6                h5eee18b_0  
yacs                      0.1.8                    pypi_0    pypi
yaml                      0.2.5                h7b6447c_0  
yapf                      0.40.2                   pypi_0    pypi
yarl                      1.9.4                    pypi_0    pypi
zhconv                    1.4.3                    pypi_0    pypi
zipp                      3.17.0                   pypi_0    pypi
zlib                      1.2.13               h5eee18b_0  
zstd                      1.5.5                hc292b87_0  

window环境裁剪+字幕报错

Traceback (most recent call last):
File "D:\anaconda3\envs\funclip\lib\site-packages\gradio\queueing.py", line 527, in process_events
response = await route_utils.call_process_api(
File "D:\anaconda3\envs\funclip\lib\site-packages\gradio\route_utils.py", line 270, in call_process_api
output = await app.get_blocks().process_api(
File "D:\anaconda3\envs\funclip\lib\site-packages\gradio\blocks.py", line 1847, in process_api
result = await self.call_function(
File "D:\anaconda3\envs\funclip\lib\site-packages\gradio\blocks.py", line 1433, in call_function
prediction = await anyio.to_thread.run_sync(
File "D:\anaconda3\envs\funclip\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "D:\anaconda3\envs\funclip\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
File "D:\anaconda3\envs\funclip\lib\site-packages\anyio_backends_asyncio.py", line 851, in run
result = context.run(func, *args)
File "D:\anaconda3\envs\funclip\lib\site-packages\gradio\utils.py", line 805, in wrapper
response = f(*args, **kwargs)
File "F:\ai\FunClip\funclip\launch.py", line 82, in video_clip_addsub
return audio_clipper.video_clip(
File "F:\ai\FunClip\funclip\videoclipper.py", line 237, in video_clip
os.makedirs(output_dir, exist_ok=True)
File "D:\anaconda3\envs\funclip\lib\os.py", line 225, in makedirs
mkdir(name, mode)
FileNotFoundError: [WinError 3] 系统找不到指定的路径。: ' '

安装报错,有谁知道咋肥事不

安装报错
Preparing metadata (pyproject.toml) ... error
error: subprocess-exited-with-error

× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [6 lines of output]

  Cargo, the Rust package manager, is not installed or is not on PATH.
  This package requires Rust and Cargo to compile extensions. Install it through
  the system's package manager or via https://rustup.rs/
  
  Checking for Rust toolchain....
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details

"None" appears on the subtitle timeline

I have batch tested several videos and found a substantial amount of 'None' instances on the timelines, for example,

169
00:08:20,650 --> None
他在七岁以后再去接受人类语言和学习口语的时候

KeyError: 'sd_sentences' in write_state()

在写入状态的时候未检查key是否存在导致抛出异常。https://github.com/alibaba-damo-academy/FunASR-APP/blob/main/ClipVideo/clipvideo/trans_utils.py#L59

WARNING:root:Write total subtitile to ./output/total.srt
Traceback (most recent call last):
  File "clipvideo/videoclipper.py", line 329, in <module>
    main()
  File "clipvideo/videoclipper.py", line 325, in main
    runner(**kwargs)
  File "clipvideo/videoclipper.py", line 283, in runner
    write_state(output_dir, state)
  File "/data/playground/funasr/FunASR-APP/ClipVideo/clipvideo/trans_utils.py", line 59, in write_state
    fout.write(str(state[key[1:]]))
KeyError: 'sd_sentences'

Stuck at 'loading punctuation model'

I wrote this DockerFile to compose the environment:

FROM nvidia/cuda:12.0.0-cudnn8-runtime-ubuntu20.04 RUN apt-get update && apt-get install -y git python3 python3-pip python3-dev libsndfile1 RUN git clone https://github.com/alibaba-damo-academy/FunASR-APP.git WORKDIR /FunASR-APP RUN pip3 install "modelscope[audio_asr]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html RUN pip3 install -r ClipVideo/requirments.txt RUN pip3 install torch torchvision torchaudio EXPOSE 7860 CMD ["python3", "ClipVideo/clipvideo/gradio_service.py"]

When the container ran, it stuck at ' loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch'. Output following:

==========
== CUDA ==

CUDA Version 12.0.0

Container image Copyright (c) 2016-2022, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

2023-07-23 16:35:47,819 - modelscope - INFO - PyTorch version 2.0.1 Found.
2023-07-23 16:35:47,819 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-07-23 16:35:47,840 - modelscope - INFO - Loading done! Current index file version is 1.7.1, with md5 25e329753dff2bc06f1af41a30e22094 and a total number of 861 components indexed
2023-07-23 16:35:48,718 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.4
2023-07-23 16:35:49,087 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-07-23 16:35:49,087 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
2023-07-23 16:35:49,087 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-07-23 16:35:49,089 - modelscope - WARNING - No preprocessor field found in cfg.
2023-07-23 16:35:49,089 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-07-23 16:35:49,089 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
2023-07-23 16:35:49,089 - modelscope - WARNING - No preprocessor key ('generic-asr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
2023-07-23 16:35:49,689 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.0
2023-07-23 16:35:49,893 - modelscope - INFO - loading vad model from /root/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch ...
2023-07-23 16:35:50,090 - modelscope - INFO - Model revision not specified, use the latest revision: v1.1.7
2023-07-23 16:35:50,423 - modelscope - INFO - loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch ...

gradio试用问题

  1. 使用多说话人示例视频 | Multi-speaker Demo Video 这个示例,点击识别+区分说话人,生成的结果和识别生成的一样
  2. 使用文本\说话人裁剪时,待裁剪说话人 | Speaker to Clip (多个说话人使用'#'连接)这栏里该填什么内容?我除非不填,要不后台报
    if str(d['spk']) == spkid and d_end-d_start>999:
    KeyError: 'spk'
    这个错误

🌟 太惊喜!无需专业知识,快速科学上网的小技巧大公开

科学上网/翻墙梯子 ChatGPT可用机场

【最新推荐】2024年必备的超值推荐神器来啦!WgetCloud机场绝对是你不容错过的宝贝!不仅提供多线BGP中转+双程CN2高品质线路,还设有位于香港的私家机房,稳定性和安全性无可挑剔!更棒的是,机场的团队成员分布在海外,为你提供无忧的安全保障!听说运营人员都拥有着5年的机场行业经验,技术可靠到极致!

【最新技术】WgetCloud机场采用Shadowsocks协议,最新新增支持SSR、V2ray和Trojan协议,各大平台软件对SS协议的支持程度也相当高!而且,机场还支持所有主流的代理订阅格式——Clash、Shadowrocket、Quantumult X、Surge 4,应有尽有!机场更有一项强项:采用分组制管理线路节点,一组人数满400即停止增加,并追加动态限速,确保线路高速稳定!

赶快点击下方链接注册成为新用户吧!全员无门槛8折优惠券等你来领取!立即体验WgetCloud机场,享受一场高速、稳定的网络之旅吧!💻💸🎉

WgetCloud官网链接

以下为晚高峰测速:

image

no module named funclip

(venv) C:\Users\namiachy\FunClip>python funclip/launch.py
Traceback (most recent call last):
File "C:\Users\namiachy\FunClip\funclip\launch.py", line 9, in
from funclip.videoclipper import VideoClipper
ModuleNotFoundError: No module named 'funclip'

please help me。。。

there is no sound in the output video(clipped video).

OS: linux
Python Version:3.8.16
Package Version:pytorch=1.12.1、torchaudio=0.12.1、modelscope=1.6.1、funasr version=0.5.8
Model:clipvideo
Command:

  1. python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 -output_dir output
  2. python videoclipper.py --stage 2 --file ../examples/2022云栖大会_片段.mp4 --output_dir output/ --dest_text '需要的一个社会的基础能力' --start_ost 0 --end_ost 100 --output_file 'output/audioclip.mp4'
    Details:
    stage 1's output is normal; but stage 2's output file audioclip.mp4 is quiet, there is no sound in this file!

tips: there was an error when running stage1, so I changed one line in videoclipper.py, the change is:

  •    wav = librosa.load(audio_file, 16000)[0]
    
  •    wav = librosa.load(audio_file, sr=16000)[0]
    

Error log:
there is no error log.

(1)stage 1's log:
2023-06-09 02:28:27,527 - modelscope - INFO - PyTorch version 1.12.1 Found.
2023-06-09 02:28:27,528 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-06-09 02:28:27,561 - modelscope - INFO - Loading done! Current index file version is 1.6.1, with md5 9d90e25216aa22a0c83204f1426d282d and a total number of 849 components indexed
/root/anaconda3/envs/wenet/bin/python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 -output_dir output
usage: videoclipper.py [-h] [--config CONFIG] --stage {1,2} --file FILE [--output_dir OUTPUT_DIR] [--dest_text DEST_TEXT]
[--start_ost START_OST] [--end_ost END_OST] [--output_file OUTPUT_FILE]
videoclipper.py: error: unrecognized arguments: -output_dir output
(wenet) root@tjtx162-39-101:/home/work/wangyaru05/workspace/E2E/GIT/videoclip_20230608/FunASR-APP/ClipVideo/clipvideo# python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 --output_dir output
2023-06-09 02:28:36,929 - modelscope - INFO - PyTorch version 1.12.1 Found.
2023-06-09 02:28:36,931 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-06-09 02:28:36,963 - modelscope - INFO - Loading done! Current index file version is 1.6.1, with md5 9d90e25216aa22a0c83204f1426d282d and a total number of 849 components indexed
/root/anaconda3/envs/wenet/bin/python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 --output_dir output
WARNING:root:Initializing modelscope asr pipeline.
2023-06-09 02:28:38,535 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.4
INFO:modelscope:Model revision not specified, use the latest revision: v1.2.4
2023-06-09 02:28:38,889 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
INFO:modelscope:initiate model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-06-09 02:28:38,890 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
INFO:modelscope:initiate model from location /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
2023-06-09 02:28:38,890 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
INFO:modelscope:initialize model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-06-09 02:28:38,894 - modelscope - WARNING - No preprocessor field found in cfg.
WARNING:modelscope:No preprocessor field found in cfg.
2023-06-09 02:28:38,894 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
WARNING:modelscope:No val key and type key found in preprocessor domain of configuration.json file.
2023-06-09 02:28:38,894 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
WARNING:modelscope:Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
2023-06-09 02:28:38,894 - modelscope - WARNING - No preprocessor key ('generic-asr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
WARNING:modelscope:No preprocessor key ('generic-asr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
2023-06-09 02:28:40,032 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.0
INFO:modelscope:Model revision not specified, use the latest revision: v1.2.0
2023-06-09 02:28:40,222 - modelscope - INFO - loading vad model from /root/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch ...
INFO:modelscope:loading vad model from /root/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch ...
2023-06-09 02:28:40,470 - modelscope - INFO - Model revision not specified, use the latest revision: v1.1.7
INFO:modelscope:Model revision not specified, use the latest revision: v1.1.7
2023-06-09 02:28:40,789 - modelscope - INFO - loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch ...
INFO:modelscope:loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch ...
Initializing VideoClipper.
Recognizing video file: ../examples/2022云栖大会_片段.mp4
MoviePy - Writing audio in ../examples/2022云栖大会_片段.wav
MoviePy - Done.
2023-06-09 02:29:12,960 - modelscope - INFO - Decoding with pcm files ...
INFO:modelscope:Decoding with pcm files ...
batch_size_token: 6000
time cost vad: 1.8394007682800293
batch: 5
time cost asr: 2.206648588180542
time cost punc: 0.42623400688171387
2023-06-09 02:29:17,719 - modelscope - INFO - Computing the result of ASR ...
INFO:modelscope:Computing the result of ASR ...
Write total subtitile to output/total.srt
Recognition successed. You can copy the text segment from below and use stage 2.
呃,尊敬的刘书记,那个卢省长,各位领导,各位院士,各位合作伙伴现场的和在线上的所有的伙伴们,大家好啊,这个又站在这个舞台上,又是一年的这个云栖大会非常的激动。这个今年是第十四年了,确实这个这个云栖大会因阿里而生啊,在因阿里的云计算而生,但到今天也是成为了一个**。这个产业界的盛会成为我们这个数字时代。我们大家讨论共同话题的一个场所啊,非常的开心。尤其是刚才我们这个青晨奖的这个颁奖,也是阿里这个近五年来的我们的一个新举措。我们也是希望啊通过这个实世代在的努力,能够啊这个结识更多的啊**的这个青年科学家在他们各自的赛道上能够助力他们去攀登科学的高峰。啊,这个我想也是对阿里巴巴来讲,就像今天我讲的主题一样,就是阿里巴巴的技术责任在哪里?对阿阿里巴巴的技术责任来讲,还是首先是不仅是自身啊去追求我们技术的先进性,同时也用阿里这样的一个平台,一个舞台能够更好的来助力。我们这个更多的青年科学家去多的面向未来的科学家们能够去追求这个科学的高峰,去追求他们的技术的先进性,科学的先进性。所以这个是我们办这个奖的初心啊,我们也会一届一届的办下去,也是希望我们有更多的啊青年科学家参与进来。并且我们在过去五年当中结识的各位的伙伴们啊,能够在各自的赛道上能够有新的建树,能够为**的科技的发展站在世界之巅啊,站在这个先进性的世界之巅,能够做出自己的贡献。这个青春奖就是一个缩影啊,背后我刚才说了也是阿里追求先进性的一个不断的一个努力的结果。今天的整个的伴随着云这个云栖大会的召开,这十四年阿里的这个云计算,包括阿里的这个数字生态也在不断的发展,这也是整个**啊全面的走向这个数字化的一个缩影。啊,今天这个在前面这个包括我们张叶峰的主题这个演讲当中也分享了我们在整个的云计算方面,我们的阿里云的这个过去几年的努力,特别是在今年啊面向未来的发向,我们提出的观点啊,我们努力的方向。这个确实今这十几年来,我们是一代又一代的我们的我们的阿里云的技术人,阿里巴巴的技术人们啊通过自己的努力实践,希望能够在一个全新的赛道上,就是计算。当这个数字字济济代代计算成为一个包需要的一个基础设施,需要的一个社会的基础能力。这样一个全新的赛道上,能够站在世界之巅,同世界各国的所有的这个伙伴们同场竞技。

(2)
stage 2's log:
2023-06-09 02:30:59,346 - modelscope - INFO - PyTorch version 1.12.1 Found.
2023-06-09 02:30:59,348 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-06-09 02:30:59,380 - modelscope - INFO - Loading done! Current index file version is 1.6.1, with md5 9d90e25216aa22a0c83204f1426d282d and a total number of 849 components indexed
/root/anaconda3/envs/wenet/bin/python videoclipper.py --stage 2 --file ../examples/2022云栖大会_片段.mp4 --output_dir output/ --dest_text 需要的一个社会的基础能力 --start_ost 0 --end_ost 100 --output_file output/audioclip.mp4
WARNING:root:Initializing VideoClipper.
Moviepy - Building video output/audioclip.mp4.
MoviePy - Writing audio in audioclipTEMP_MPY_wvf_snd.mp3
MoviePy - Done.
Moviepy - Writing video output/audioclip.mp4

Moviepy - Done !
Moviepy - video ready output/audioclip.mp4
WARNING:root:Save clipped mp4 file to output/audioclip.mp4
WARNING:root:Write clipped subtitile to output/audioclip.srt

安装时候找不到文件

Traceback (most recent call last):
File "E:\剪辑筛选\funclip\launch.py", line 6, in
funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
File "E:\剪辑筛选\env\lib\site-packages\funasr\auto\auto_model.py", line 137, in init
spk_model, spk_kwargs = self.build_model(**spk_kwargs)
File "E:\剪辑筛选\env\lib\site-packages\funasr\auto\auto_model.py", line 158, in build_model
kwargs = download_model(**kwargs)
File "E:\剪辑筛选\env\lib\site-packages\funasr\download\download_from_hub.py", line 11, in download_model
kwargs = download_from_ms(**kwargs)
File "E:\剪辑筛选\env\lib\site-packages\funasr\download\download_from_hub.py", line 79, in download_from_ms
install_requirements(requirements)
File "E:\剪辑筛选\env\lib\site-packages\funasr\utils\install_model_requirements.py", line 21, in install_requirements
result = subprocess.run(
File "E:\剪辑筛选\env\lib\subprocess.py", line 503, in run
with Popen(*popenargs, **kwargs) as process:
File "E:\剪辑筛选\env\lib\subprocess.py", line 971, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "E:\剪辑筛选\env\lib\subprocess.py", line 1456, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] 系统找不到指定的文件。
Press any key to continue . . .

出现[WinError 3]并不是config_defaults.py没有配置好,原因不得而解。

Traceback (most recent call last):
File "D:\Python\Python310\lib\site-packages\gradio\queueing.py", line 528, in process_events
response = await route_utils.call_process_api(
File "D:\Python\Python310\lib\site-packages\gradio\route_utils.py", line 270, in call_process_api
output = await app.get_blocks().process_api(
File "D:\Python\Python310\lib\site-packages\gradio\blocks.py", line 1908, in process_api
result = await self.call_function(
File "D:\Python\Python310\lib\site-packages\gradio\blocks.py", line 1485, in call_function
prediction = await anyio.to_thread.run_sync(
File "D:\Python\Python310\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "D:\Python\Python310\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
File "D:\Python\Python310\lib\site-packages\anyio_backends_asyncio.py", line 851, in run
result = context.run(func, *args)
File "D:\Python\Python310\lib\site-packages\gradio\utils.py", line 808, in wrapper
response = f(*args, **kwargs)
File "E:\FunASR\FunClip\funclip\launch.py", line 86, in video_clip_addsub
return audio_clipper.video_clip(
File "E:\FunASR\FunClip\funclip\videoclipper.py", line 246, in video_clip
os.makedirs(output_dir, exist_ok=True)
File "D:\Python\Python310\lib\os.py", line 225, in makedirs
mkdir(name, mode)
FileNotFoundError: [WinError 3] 系统找不到指定的路径。: ' '
Keyboard interruption in main thread... closing server.

要多大的显存?1070显卡8G不够用

RuntimeError: CUDA error: out of memory
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

这个是需要配置openai账号吗

这个错误不太懂

Traceback (most recent call last):
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 69, in map_httpcore_exceptions
yield
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 233, in handle_request
resp = self._pool.handle_request(req)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/connection_pool.py", line 216, in handle_request
raise exc from None
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/connection_pool.py", line 196, in handle_request
response = connection.handle_request(
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/http_proxy.py", line 207, in handle_request
return self._connection.handle_request(proxy_request)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/connection.py", line 101, in handle_request
return self._connection.handle_request(request)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 143, in handle_request
raise exc
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 113, in handle_request
) = self._receive_response_headers(**kwargs)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 186, in _receive_response_headers
event = self._receive_event(timeout=timeout)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 238, in _receive_event
raise RemoteProtocolError(msg)
httpcore.RemoteProtocolError: Server disconnected without sending a response.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/xqls/app/FunClip/funclip/launch.py", line 251, in
funclip_service.launch()
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/gradio/blocks.py", line 2324, in launch
httpx.get(
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_api.py", line 198, in get
return request(
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_api.py", line 106, in request
return client.request(
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_client.py", line 827, in request
return self.send(request, auth=auth, follow_redirects=follow_redirects)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_client.py", line 914, in send
response = self._send_handling_auth(
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_client.py", line 942, in _send_handling_auth
response = self._send_handling_redirects(
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_client.py", line 979, in _send_handling_redirects
response = self._send_single_request(request)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_client.py", line 1015, in _send_single_request
response = transport.handle_request(request)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 232, in handle_request
with map_httpcore_exceptions():
File "/usr/lib/python3.10/contextlib.py", line 153, in exit
self.gen.throw(typ, value, traceback)
File "/home/xqls/app/FunClip/venv/lib/python3.10/site-packages/httpx/_transports/default.py", line 86, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.RemoteProtocolError: Server disconnected without sending a response.

Exception in ASGI application Traceback (most recent call last): File "D:\lq\anaconda3\envs\Funclip\lib\site-packages\gradio\queueing.py", line 223, in push event_queue = self.event_queue_per_concurrency_id[event.concurrency_id] KeyError: '2760507316400'

Exception in ASGI application
Traceback (most recent call last):
File "D:\lq\anaconda3\envs\Funclip\lib\site-packages\gradio\queueing.py", line 223, in push
event_queue = self.event_queue_per_concurrency_id[event.concurrency_id]
KeyError: '2760507316400'

TypeError: GenericFunASR: 'NoneType' object is not callable

windos 下 使用funasr-1.0.2 modelscope-1.11.1版本报错如下

Traceback (most recent call last):
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\utils\registry.py", line 212, in build_from_cfg
return obj_cls(**args)
^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\pipelines\audio\funasr_pipeline.py", line 62, in init
super().init(model=model, **kwargs)
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\pipelines\base.py", line 100, in init
self.model = self.initiate_single_model(model, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\pipelines\base.py", line 53, in initiate_single_model
return Model.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\models\base\base_model.py", line 183, in from_pretrained
model = build_model(model_cfg, task_name=task_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\models\builder.py", line 35, in build_model
model = build_from_cfg(
^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\utils\registry.py", line 215, in build_from_cfg
raise type(e)(f'{obj_cls.name}: {e}')
TypeError: GenericFunASR: 'NoneType' object is not callable

上传视频不显示画面

上传本地的视频,不会马上显示画面,需要等一会才能看到。
有时候甚至很长时间都不会显示,这个是什么问题啊?

requirement单词拼写错误

当我用习惯的命令pip install -r requirements.txt安装依赖的时候,发现文件不存在,原来是仓库的requirement拼写错误,建议修改。

视频识别没问题,音频识别报错,好像是要求16k采样率才能用?

prediction = await anyio.to_thread.run_sync(

File "C:\Python310\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "C:\Python310\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
File "C:\Python310\lib\site-packages\anyio_backends_asyncio.py", line 851, in run
result = context.run(func, *args)
File "C:\Python310\lib\site-packages\gradio\utils.py", line 689, in wrapper
response = f(*args, **kwargs)
File "D:\gopath\src\ParaClipper\paraclipper\launch.py", line 22, in audio_recog
return audio_clipper.recog(audio_input, sd_switch, hotwords=hotwords)
File "D:\gopath\src\ParaClipper\paraclipper\videoclipper.py", line 28, in recog
assert sr == 16000, "16kHz sample rate required, {} given.".format(sr)
AssertionError: 16kHz sample rate required, 32000 given.

占用低怎么修改

效果很棒 速度还行但是显卡和cpu占用都很低 有没有参数可以改

python funclip/launch.py报错:AttributeError: module 'torch' has no attribute '_utils'

Notice: ffmpeg is not installed. torchaudio is used to load audio
If you want to use ffmpeg backend to load audio, please install it by:
sudo apt install ffmpeg # ubuntu
# brew install ffmpeg # mac
2024-04-25 15:48:05,179 - modelscope - INFO - PyTorch version 2.3.0 Found.
2024-04-25 15:48:05,180 - modelscope - INFO - Loading ast index from C:\Users\33787.cache\modelscope\ast_indexer
2024-04-25 15:48:05,253 - modelscope - INFO - Loading done! Current index file version is 1.14.0, with md5 84bbff1b93e4bc20c6d5e3e3f4d4927d and a total number of 976 components indexed
2024-04-25 15:48:05,609 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: C:\Users\33787.cache\modelscope\hub\iic\speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch\model.pt
Traceback (most recent call last):
File "D:\study\code-space\FunClip\funclip\launch.py", line 7, in
funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\funasr\auto\auto_model.py", line 107, in init
model, kwargs = self.build_model(**kwargs)
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\funasr\auto\auto_model.py", line 205, in build_model
load_pretrained_model(
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\funasr\train_utils\load_pretrained_model.py", line 67, in load_pretrained_model
src_state = torch.load(path, map_location=map_location)
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\serialization.py", line 1025, in load
return _load(opened_zipfile,
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\serialization.py", line 1446, in _load
result = unpickler.load()
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\serialization.py", line 1415, in persistent_load
nbytes = numel * torch._utils.element_size(dtype)
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch_init
.py", line 2003, in getattr
raise AttributeError(f"module '{name}' has no attribute '{name}'")
AttributeError: module 'torch' has no attribute '_utils'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.