Giter Site home page Giter Site logo

alibaba-damo-academy / funclip Goto Github PK

View Code? Open in Web Editor NEW
963.0 13.0 109.0 36.24 MB

Open-source, accurate and easy-to-use video clipping tool | 开源、精准、方便的视频切片工具

License: MIT License

Python 38.84% Shell 61.16%
speech-recognition video-clip video-subtitles subtitles-generator speech-to-text gradio gradio-python-llm llm

funclip's People

Contributors

alibaba-oss avatar charslee013 avatar lauragpt avatar r1ckshi avatar season4675 avatar wanghuii1 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

funclip's Issues

python funclip/launch.py报错:AttributeError: module 'torch' has no attribute '_utils'

Notice: ffmpeg is not installed. torchaudio is used to load audio
If you want to use ffmpeg backend to load audio, please install it by:
sudo apt install ffmpeg # ubuntu
# brew install ffmpeg # mac
2024-04-25 15:48:05,179 - modelscope - INFO - PyTorch version 2.3.0 Found.
2024-04-25 15:48:05,180 - modelscope - INFO - Loading ast index from C:\Users\33787.cache\modelscope\ast_indexer
2024-04-25 15:48:05,253 - modelscope - INFO - Loading done! Current index file version is 1.14.0, with md5 84bbff1b93e4bc20c6d5e3e3f4d4927d and a total number of 976 components indexed
2024-04-25 15:48:05,609 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: C:\Users\33787.cache\modelscope\hub\iic\speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch\model.pt
Traceback (most recent call last):
File "D:\study\code-space\FunClip\funclip\launch.py", line 7, in
funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\funasr\auto\auto_model.py", line 107, in init
model, kwargs = self.build_model(**kwargs)
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\funasr\auto\auto_model.py", line 205, in build_model
load_pretrained_model(
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\funasr\train_utils\load_pretrained_model.py", line 67, in load_pretrained_model
src_state = torch.load(path, map_location=map_location)
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\serialization.py", line 1025, in load
return _load(opened_zipfile,
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\serialization.py", line 1446, in _load
result = unpickler.load()
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\serialization.py", line 1415, in persistent_load
nbytes = numel * torch._utils.element_size(dtype)
File "C:\Users\33787\AppData\Local\Programs\Python\Python39\lib\site-packages\torch_init
.py", line 2003, in getattr
raise AttributeError(f"module '{name}' has no attribute '{name}'")
AttributeError: module 'torch' has no attribute '_utils'

视频识别没问题,音频识别报错,好像是要求16k采样率才能用?

prediction = await anyio.to_thread.run_sync(

File "C:\Python310\lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
File "C:\Python310\lib\site-packages\anyio_backends_asyncio.py", line 2144, in run_sync_in_worker_thread
return await future
File "C:\Python310\lib\site-packages\anyio_backends_asyncio.py", line 851, in run
result = context.run(func, *args)
File "C:\Python310\lib\site-packages\gradio\utils.py", line 689, in wrapper
response = f(*args, **kwargs)
File "D:\gopath\src\ParaClipper\paraclipper\launch.py", line 22, in audio_recog
return audio_clipper.recog(audio_input, sd_switch, hotwords=hotwords)
File "D:\gopath\src\ParaClipper\paraclipper\videoclipper.py", line 28, in recog
assert sr == 16000, "16kHz sample rate required, {} given.".format(sr)
AssertionError: 16kHz sample rate required, 32000 given.

占用低怎么修改

效果很棒 速度还行但是显卡和cpu占用都很低 有没有参数可以改

Stuck at 'loading punctuation model'

I wrote this DockerFile to compose the environment:

FROM nvidia/cuda:12.0.0-cudnn8-runtime-ubuntu20.04 RUN apt-get update && apt-get install -y git python3 python3-pip python3-dev libsndfile1 RUN git clone https://github.com/alibaba-damo-academy/FunASR-APP.git WORKDIR /FunASR-APP RUN pip3 install "modelscope[audio_asr]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html RUN pip3 install -r ClipVideo/requirments.txt RUN pip3 install torch torchvision torchaudio EXPOSE 7860 CMD ["python3", "ClipVideo/clipvideo/gradio_service.py"]

When the container ran, it stuck at ' loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch'. Output following:

==========
== CUDA ==

CUDA Version 12.0.0

Container image Copyright (c) 2016-2022, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions of this license:
https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.

2023-07-23 16:35:47,819 - modelscope - INFO - PyTorch version 2.0.1 Found.
2023-07-23 16:35:47,819 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-07-23 16:35:47,840 - modelscope - INFO - Loading done! Current index file version is 1.7.1, with md5 25e329753dff2bc06f1af41a30e22094 and a total number of 861 components indexed
2023-07-23 16:35:48,718 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.4
2023-07-23 16:35:49,087 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-07-23 16:35:49,087 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
2023-07-23 16:35:49,087 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-07-23 16:35:49,089 - modelscope - WARNING - No preprocessor field found in cfg.
2023-07-23 16:35:49,089 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
2023-07-23 16:35:49,089 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
2023-07-23 16:35:49,089 - modelscope - WARNING - No preprocessor key ('generic-asr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
2023-07-23 16:35:49,689 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.0
2023-07-23 16:35:49,893 - modelscope - INFO - loading vad model from /root/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch ...
2023-07-23 16:35:50,090 - modelscope - INFO - Model revision not specified, use the latest revision: v1.1.7
2023-07-23 16:35:50,423 - modelscope - INFO - loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch ...

报错NameError: name 'ClusterBackend' is not defined

1.平台:vmware虚拟机下的

Linux version 6.5.0-21-generic (buildd@lcy02-amd64-091) (x86_64-linux-gnu-gcc-12 (Ubuntu 12.3.0-1ubuntu122.04) 12.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #2122.04.1-Ubuntu SMP PREEMPT_DYNAMIC Fri Feb 9 13:32:52 UTC 2

2.报错情况:

(ParaClipper) $ python paraclipper/launch.py
If you want to use the speaker diarization, please `pip install hdbscan`
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
If you want use mossformer, lease install rotary_embedding_torch by: 
 pip install -U rotary_embedding_torch
2024-03-02 22:31:26,478 - modelscope - INFO - PyTorch version 2.2.1 Found.
2024-03-02 22:31:26,483 - modelscope - INFO - TensorFlow version 2.13.1 Found.
2024-03-02 22:31:26,485 - modelscope - INFO - Loading ast index from /home/lzo/.cache/modelscope/ast_indexer
2024-03-02 22:31:26,909 - modelscope - INFO - Loading done! Current index file version is 1.12.0, with md5 a986dd5e37b563e607171cc5fb7e9553 and a total number of 964 components indexed
2024-03-02 22:31:27,715 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/model.pt
2024-03-02 22:31:41,582 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch/model.pt
2024-03-02 22:31:42,485 - modelscope - INFO - Use user-specified model revision: v2.0.4
ckpt: /home/lzo/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch/model.pt
2024-03-02 22:31:44,738 - modelscope - INFO - Use user-specified model revision: v2.0.2
ckpt: /home/lzo/.cache/modelscope/hub/damo/speech_campplus_sv_zh-cn_16k-common/campplus_cn_common.bin
Traceback (most recent call last):
  File "paraclipper/launch.py", line 7, in <module>
    funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
  File "/home/lzo/anaconda3/envs/ParaClipper/lib/python3.8/site-packages/funasr/auto/auto_model.py", line 126, in __init__
    self.cb_model = ClusterBackend().to(kwargs["device"])
NameError: name 'ClusterBackend' is not defined

3.虚拟环境下的包

_libgcc_mutex             0.1                        main  
_openmp_mutex             5.1                       1_gnu  
absl-py                   2.1.0                    pypi_0    pypi
accelerate                0.27.2                   pypi_0    pypi
addict                    2.4.0                    pypi_0    pypi
aiofiles                  23.2.1                   pypi_0    pypi
aiohttp                   3.9.3                    pypi_0    pypi
aiosignal                 1.3.1                    pypi_0    pypi
albumentations            1.3.1                    pypi_0    pypi
aliyun-python-sdk-core    2.14.0                   pypi_0    pypi
aliyun-python-sdk-kms     2.16.2                   pypi_0    pypi
altair                    5.2.0                    pypi_0    pypi
annotated-types           0.6.0                    pypi_0    pypi
antlr4-python3-runtime    4.8                      pypi_0    pypi
anyio                     4.3.0                    pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
async-timeout             4.0.3                    pypi_0    pypi
attrs                     23.2.0                   pypi_0    pypi
audioread                 3.0.1                    pypi_0    pypi
av                        11.0.0                   pypi_0    pypi
backports-zoneinfo        0.2.1                    pypi_0    pypi
bitarray                  2.9.2                    pypi_0    pypi
black                     24.2.0                   pypi_0    pypi
blas                      1.0                         mkl  
blis                      0.7.11                   pypi_0    pypi
blobfile                  2.1.1                    pypi_0    pypi
bmt-clipit                1.0                      pypi_0    pypi
boto3                     1.34.54                  pypi_0    pypi
botocore                  1.34.54                  pypi_0    pypi
brotli-python             1.0.9            py38h6a678d5_7  
bzip2                     1.0.8                h5eee18b_5  
ca-certificates           2023.12.12           h06a4308_0  
cachetools                5.3.3                    pypi_0    pypi
catalogue                 2.0.10                   pypi_0    pypi
certifi                   2024.2.2         py38h06a4308_0  
cffi                      1.16.0                   pypi_0    pypi
chardet                   5.2.0                    pypi_0    pypi
charset-normalizer        3.3.2                    pypi_0    pypi
chumpy                    0.70                     pypi_0    pypi
click                     8.1.7                    pypi_0    pypi
clip                      1.0                      pypi_0    pypi
cloudpathlib              0.16.0                   pypi_0    pypi
colorama                  0.4.6                    pypi_0    pypi
coloredlogs               15.0.1                   pypi_0    pypi
confection                0.1.4                    pypi_0    pypi
contextlib2               21.6.0                   pypi_0    pypi
contourpy                 1.1.1                    pypi_0    pypi
control-ldm               0.0.1                    pypi_0    pypi
cpuonly                   2.0                           0    pytorch
crcmod                    1.7                      pypi_0    pypi
cryptography              42.0.5                   pypi_0    pypi
cycler                    0.12.1                   pypi_0    pypi
cymem                     2.0.8                    pypi_0    pypi
cython                    3.0.8                    pypi_0    pypi
datasets                  2.18.0                   pypi_0    pypi
ddpm-guided-diffusion     0.0.0                    pypi_0    pypi
decorator                 4.4.2                    pypi_0    pypi
descartes                 1.1.0                    pypi_0    pypi
diffusers                 0.26.3                   pypi_0    pypi
dill                      0.3.8                    pypi_0    pypi
easydict                  1.12                     pypi_0    pypi
easyrobust                0.2.4                    pypi_0    pypi
edit-distance             1.0.6                    pypi_0    pypi
editdistance              0.8.1                    pypi_0    pypi
einops                    0.7.0                    pypi_0    pypi
embeddings                0.0.8                    pypi_0    pypi
emoji                     2.10.1                   pypi_0    pypi
exceptiongroup            1.2.0                    pypi_0    pypi
face-alignment            1.4.1                    pypi_0    pypi
fairscale                 0.4.13                   pypi_0    pypi
fairseq                   0.12.2                   pypi_0    pypi
fastai                    2.7.14                   pypi_0    pypi
fastapi                   0.110.0                  pypi_0    pypi
fastcore                  1.5.29                   pypi_0    pypi
fastdownload              0.0.7                    pypi_0    pypi
fastprogress              1.0.3                    pypi_0    pypi
ffmpeg                    1.4                      pypi_0    pypi
ffmpeg-python             0.2.0                    pypi_0    pypi
ffmpy                     0.3.2                    pypi_0    pypi
filelock                  3.13.1           py38h06a4308_0  
fire                      0.5.0                    pypi_0    pypi
flake8                    7.0.0                    pypi_0    pypi
flatbuffers               23.5.26                  pypi_0    pypi
fonttools                 4.49.0                   pypi_0    pypi
freetype                  2.12.1               h4a9f257_0  
frozenlist                1.4.1                    pypi_0    pypi
fsspec                    2024.2.0                 pypi_0    pypi
ftfy                      6.1.3                    pypi_0    pypi
funasr                    1.0.11                   pypi_0    pypi
future                    1.0.0                    pypi_0    pypi
fvcore                    0.1.5.post20221221          pypi_0    pypi
gast                      0.4.0                    pypi_0    pypi
gmp                       6.2.1                h295c915_3  
gmpy2                     2.1.2            py38heeb90bb_0  
gnutls                    3.6.15               he1e5248_0  
google-auth               2.28.1                   pypi_0    pypi
google-auth-oauthlib      1.0.0                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
gradio                    4.19.2                   pypi_0    pypi
gradio-client             0.10.1                   pypi_0    pypi
grpcio                    1.62.0                   pypi_0    pypi
h11                       0.14.0                   pypi_0    pypi
h5py                      3.10.0                   pypi_0    pypi
httpcore                  1.0.4                    pypi_0    pypi
httpx                     0.27.0                   pypi_0    pypi
huggingface-hub           0.21.3                   pypi_0    pypi
humanfriendly             10.0                     pypi_0    pypi
hydra-core                1.0.7                    pypi_0    pypi
idna                      3.6                      pypi_0    pypi
imageio                   2.34.0                   pypi_0    pypi
imageio-ffmpeg            0.4.9                    pypi_0    pypi
imgaug                    0.4.0                    pypi_0    pypi
importlib-metadata        7.0.1                    pypi_0    pypi
importlib-resources       6.1.2                    pypi_0    pypi
iniconfig                 2.0.0                    pypi_0    pypi
intel-openmp              2023.1.0         hdb19cb5_46306  
iopath                    0.1.10                   pypi_0    pypi
jaconv                    0.3.4                    pypi_0    pypi
jamo                      0.4.1                    pypi_0    pypi
jieba                     0.42.1                   pypi_0    pypi
jinja2                    3.1.3            py38h06a4308_0  
jmespath                  0.10.0                   pypi_0    pypi
joblib                    1.3.2                    pypi_0    pypi
jpeg                      9e                   h5eee18b_1  
jsonschema                4.21.1                   pypi_0    pypi
jsonschema-specifications 2023.12.1                pypi_0    pypi
kaldiio                   2.18.0                   pypi_0    pypi
keras                     2.13.1                   pypi_0    pypi
kiwisolver                1.4.5                    pypi_0    pypi
kornia                    0.7.1                    pypi_0    pypi
lame                      3.100                h7b6447c_0  
langcodes                 3.3.0                    pypi_0    pypi
lap                       0.4.0                    pypi_0    pypi
lazy-loader               0.3                      pypi_0    pypi
lcms2                     2.12                 h3be6417_0  
ld_impl_linux-64          2.38                 h1181459_1  
lerc                      3.0                  h295c915_0  
libclang                  16.0.6                   pypi_0    pypi
libdeflate                1.17                 h5eee18b_1  
libffi                    3.4.4                h6a678d5_0  
libgcc-ng                 11.2.0               h1234567_1  
libgomp                   11.2.0               h1234567_1  
libiconv                  1.16                 h7f8727e_2  
libidn2                   2.3.4                h5eee18b_0  
libjpeg-turbo             2.0.0                h9bf148f_0    pytorch
libpng                    1.6.39               h5eee18b_0  
librosa                   0.10.1                   pypi_0    pypi
libstdcxx-ng              11.2.0               h1234567_1  
libtasn1                  4.19.0               h5eee18b_0  
libtiff                   4.5.1                h6a678d5_0  
libunistring              0.9.10               h27cfd23_0  
libwebp-base              1.3.2                h5eee18b_0  
lightning-utilities       0.10.1                   pypi_0    pypi
llvm-openmp               14.0.6               h9e868ea_0  
llvmlite                  0.41.1                   pypi_0    pypi
lmdb                      1.4.1                    pypi_0    pypi
lpips                     0.1.4                    pypi_0    pypi
lxml                      4.9.4                    pypi_0    pypi
lyft-dataset-sdk          0.0.8                    pypi_0    pypi
lz4-c                     1.9.4                h6a678d5_0  
markdown                  3.5.2                    pypi_0    pypi
markdown-it-py            3.0.0                    pypi_0    pypi
markupsafe                2.1.5                    pypi_0    pypi
matplotlib                3.5.3                    pypi_0    pypi
mccabe                    0.7.0                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
megatron-util             1.3.2                    pypi_0    pypi
mkl                       2023.1.0         h213fc3f_46344  
mkl-service               2.4.0            py38h5eee18b_1  
mkl_fft                   1.3.8            py38h5eee18b_0  
mkl_random                1.2.4            py38hdb19cb5_0  
ml-collections            0.1.1                    pypi_0    pypi
mmcls                     0.25.0                   pypi_0    pypi
mmdet                     2.28.2                   pypi_0    pypi
mmdet3d                   1.0.0a1                  pypi_0    pypi
mmsegmentation            0.30.0                   pypi_0    pypi
mock                      5.1.0                    pypi_0    pypi
modelscope                1.12.0                   pypi_0    pypi
moviepy                   1.0.3                    pypi_0    pypi
mpc                       1.1.0                h10f8cd9_1  
mpfr                      4.0.2                hb69a4c5_1  
mpmath                    1.3.0            py38h06a4308_0  
msgpack                   1.0.8                    pypi_0    pypi
multidict                 6.0.5                    pypi_0    pypi
multiprocess              0.70.16                  pypi_0    pypi
murmurhash                1.0.10                   pypi_0    pypi
mypy-extensions           1.0.0                    pypi_0    pypi
ncurses                   6.4                  h6a678d5_0  
nerfacc                   0.2.2                    pypi_0    pypi
nettle                    3.7.3                hbbd107a_1  
networkx                  3.1              py38h06a4308_0  
ninja                     1.11.1.1                 pypi_0    pypi
nltk                      3.8.1                    pypi_0    pypi
numba                     0.58.1                   pypi_0    pypi
numpy                     1.24.4                   pypi_0    pypi
numpy-base                1.24.3           py38h060ed82_1  
nuscenes-devkit           1.1.11                   pypi_0    pypi
oauthlib                  3.2.2                    pypi_0    pypi
omegaconf                 2.0.6                    pypi_0    pypi
onnx                      1.15.0                   pypi_0    pypi
onnxruntime               1.17.1                   pypi_0    pypi
onnxsim                   0.4.35                   pypi_0    pypi
open-clip-torch           2.24.0                   pypi_0    pypi
opencv-python             4.9.0.80                 pypi_0    pypi
opencv-python-headless    4.9.0.80                 pypi_0    pypi
openh264                  2.1.1                h4ff587b_0  
openjpeg                  2.4.0                h3ad879b_0  
openssl                   3.0.13               h7f8727e_0  
opt-einsum                3.3.0                    pypi_0    pypi
orjson                    3.9.15                   pypi_0    pypi
oss2                      2.18.4                   pypi_0    pypi
packaging                 23.2                     pypi_0    pypi
paint-ldm                 0.0.0                    pypi_0    pypi
pandas                    2.0.3                    pypi_0    pypi
panopticapi               0.1                      pypi_0    pypi
pathspec                  0.12.1                   pypi_0    pypi
pillow                    10.2.0           py38h5eee18b_0  
pip                       23.3.1           py38h06a4308_0  
pkgutil-resolve-name      1.3.10                   pypi_0    pypi
platformdirs              4.2.0                    pypi_0    pypi
plotly                    5.19.0                   pypi_0    pypi
pluggy                    1.4.0                    pypi_0    pypi
plyfile                   1.0.3                    pypi_0    pypi
pooch                     1.8.1                    pypi_0    pypi
portalocker               2.8.2                    pypi_0    pypi
preshed                   3.0.9                    pypi_0    pypi
prettytable               3.10.0                   pypi_0    pypi
proglog                   0.1.10                   pypi_0    pypi
protobuf                  3.20.3                   pypi_0    pypi
psutil                    5.9.8                    pypi_0    pypi
pyarrow                   15.0.0                   pypi_0    pypi
pyarrow-hotfix            0.6                      pypi_0    pypi
pyasn1                    0.5.1                    pypi_0    pypi
pyasn1-modules            0.3.0                    pypi_0    pypi
pybind11                  2.11.1                   pypi_0    pypi
pyclipper                 1.3.0.post5              pypi_0    pypi
pycocotools               2.0.7                    pypi_0    pypi
pycodestyle               2.11.1                   pypi_0    pypi
pycparser                 2.21                     pypi_0    pypi
pycryptodome              3.20.0                   pypi_0    pypi
pycryptodomex             3.20.0                   pypi_0    pypi
pydantic                  2.6.3                    pypi_0    pypi
pydantic-core             2.16.3                   pypi_0    pypi
pydub                     0.25.1                   pypi_0    pypi
pyflakes                  3.2.0                    pypi_0    pypi
pygments                  2.17.2                   pypi_0    pypi
pymcubes                  0.1.4                    pypi_0    pypi
pynndescent               0.5.11                   pypi_0    pypi
pyparsing                 3.1.1                    pypi_0    pypi
pyquaternion              0.9.9                    pypi_0    pypi
pysocks                   1.7.1            py38h06a4308_0  
pytest                    8.0.2                    pypi_0    pypi
pythainlp                 5.0.1                    pypi_0    pypi
python                    3.8.18               h955ad1f_0  
python-crfsuite           0.9.10                   pypi_0    pypi
python-dateutil           2.9.0.post0              pypi_0    pypi
python-multipart          0.0.9                    pypi_0    pypi
pytorch                   2.2.1               py3.8_cpu_0    pytorch
pytorch-lightning         2.2.0.post0              pypi_0    pypi
pytorch-mutex             1.0                         cpu    pytorch
pytorch-wpe               0.0.1                    pypi_0    pypi
pytz                      2024.1                   pypi_0    pypi
pyvi                      0.1.1                    pypi_0    pypi
pywavelets                1.4.1                    pypi_0    pypi
pyyaml                    6.0.1            py38h5eee18b_0  
qudida                    0.0.4                    pypi_0    pypi
readline                  8.2                  h5eee18b_0  
referencing               0.33.0                   pypi_0    pypi
regex                     2023.12.25               pypi_0    pypi
requests                  2.31.0           py38h06a4308_1  
requests-oauthlib         1.3.1                    pypi_0    pypi
rich                      13.7.1                   pypi_0    pypi
rouge                     1.0.1                    pypi_0    pypi
rpds-py                   0.18.0                   pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
ruff                      0.3.0                    pypi_0    pypi
s3transfer                0.10.0                   pypi_0    pypi
sacrebleu                 2.4.0                    pypi_0    pypi
sacremoses                0.1.1                    pypi_0    pypi
safetensors               0.4.2                    pypi_0    pypi
scikit-image              0.19.3                   pypi_0    pypi
scikit-learn              1.3.2                    pypi_0    pypi
scipy                     1.10.1                   pypi_0    pypi
semantic-version          2.10.0                   pypi_0    pypi
sentencepiece             0.2.0                    pypi_0    pypi
seqeval                   1.2.2                    pypi_0    pypi
setuptools                68.2.2           py38h06a4308_0  
setuptools-scm            8.0.4                    pypi_0    pypi
shapely                   1.8.5.post1              pypi_0    pypi
shellingham               1.5.4                    pypi_0    pypi
shotdetect-scenedetect-lgss 0.0.4                    pypi_0    pypi
simplejson                3.19.2                   pypi_0    pypi
six                       1.16.0                   pypi_0    pypi
sklearn-crfsuite          0.3.6                    pypi_0    pypi
smart-open                6.4.0                    pypi_0    pypi
smplx                     0.1.28                   pypi_0    pypi
sniffio                   1.3.1                    pypi_0    pypi
sortedcontainers          2.4.0                    pypi_0    pypi
soundfile                 0.12.1                   pypi_0    pypi
soxr                      0.3.7                    pypi_0    pypi
spacy                     3.7.4                    pypi_0    pypi
spacy-legacy              3.0.12                   pypi_0    pypi
spacy-loggers             1.0.5                    pypi_0    pypi
sqlite                    3.41.2               h5eee18b_0  
srsly                     2.4.8                    pypi_0    pypi
stanza                    1.8.1                    pypi_0    pypi
starlette                 0.36.3                   pypi_0    pypi
subword-nmt               0.3.8                    pypi_0    pypi
sympy                     1.12             py38h06a4308_0  
tabulate                  0.9.0                    pypi_0    pypi
tbb                       2021.8.0             hdb19cb5_0  
tenacity                  8.2.3                    pypi_0    pypi
tensorboard               2.13.0                   pypi_0    pypi
tensorboard-data-server   0.7.2                    pypi_0    pypi
tensorboardx              2.6.2.2                  pypi_0    pypi
tensorflow                2.13.1                   pypi_0    pypi
tensorflow-estimator      2.13.0                   pypi_0    pypi
tensorflow-io-gcs-filesystem 0.34.0                   pypi_0    pypi
termcolor                 2.4.0                    pypi_0    pypi
terminaltables            3.1.10                   pypi_0    pypi
tf-slim                   1.1.0                    pypi_0    pypi
thinc                     8.2.3                    pypi_0    pypi
thop                      0.1.1-2209072238          pypi_0    pypi
threadpoolctl             3.3.0                    pypi_0    pypi
tifffile                  2023.7.10                pypi_0    pypi
timm                      0.5.4                    pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
tokenizers                0.15.2                   pypi_0    pypi
toml                      0.10.2                   pypi_0    pypi
tomli                     2.0.1                    pypi_0    pypi
tomlkit                   0.12.0                   pypi_0    pypi
toolz                     0.12.1                   pypi_0    pypi
torch-complex             0.4.3                    pypi_0    pypi
torch-scatter             2.1.2                    pypi_0    pypi
torchaudio                2.2.1                  py38_cpu    pytorch
torchmetrics              1.3.1                    pypi_0    pypi
torchsummary              1.5.1                    pypi_0    pypi
torchvision               0.17.1                 py38_cpu    pytorch
tqdm                      4.66.2                   pypi_0    pypi
transformers              4.38.2                   pypi_0    pypi
trimesh                   2.35.39                  pypi_0    pypi
typer                     0.9.0                    pypi_0    pypi
typing-extensions         4.10.0                   pypi_0    pypi
typing_extensions         4.9.0            py38h06a4308_1  
tzdata                    2024.1                   pypi_0    pypi
ujson                     5.9.0                    pypi_0    pypi
umap-learn                0.5.5                    pypi_0    pypi
urllib3                   2.2.1                    pypi_0    pypi
utils                     1.0.2                    pypi_0    pypi
uvicorn                   0.27.1                   pypi_0    pypi
videofeatures-clipit      1.0                      pypi_0    pypi
wasabi                    1.1.2                    pypi_0    pypi
wcwidth                   0.2.13                   pypi_0    pypi
weasel                    0.3.4                    pypi_0    pypi
websockets                11.0.3                   pypi_0    pypi
werkzeug                  3.0.1                    pypi_0    pypi
wheel                     0.41.2           py38h06a4308_0  
wrapt                     1.16.0                   pypi_0    pypi
xxhash                    3.4.1                    pypi_0    pypi
xz                        5.4.6                h5eee18b_0  
yacs                      0.1.8                    pypi_0    pypi
yaml                      0.2.5                h7b6447c_0  
yapf                      0.40.2                   pypi_0    pypi
yarl                      1.9.4                    pypi_0    pypi
zhconv                    1.4.3                    pypi_0    pypi
zipp                      3.17.0                   pypi_0    pypi
zlib                      1.2.13               h5eee18b_0  
zstd                      1.5.5                hc292b87_0  

运行imagemagick_test.py报错,FileNotFoundError: [WinError 2] 系统找不到指定的文件

PS D:\model\FunClip-main\funclip> ..\runtime\python.exe .\imagemagick_test.py
Traceback (most recent call last):
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\video\VideoClip.py", line 1137, in init
subprocess_call(cmd, logger=None)
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\tools.py", line 46, in subprocess_call
proc = sp.Popen(cmd, **popen_params)
File "D:\model\FunClip-main\runtime\lib\subprocess.py", line 969, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "D:\model\FunClip-main\runtime\lib\subprocess.py", line 1438, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] 系统找不到指定的文件。

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\model\FunClip-main\funclip\imagemagick_test.py", line 10, in
subtitles = SubtitlesClip(subs, generator)
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\video\tools\subtitles.py", line 86, in init
hasmask = bool(self.make_textclip('T').mask)
File "D:\model\FunClip-main\funclip\imagemagick_test.py", line 4, in
generator = lambda txt: TextClip(txt, font='./font/STHeitiMedium.ttc', fontsize=48, color='white')
File "D:\model\FunClip-main\runtime\lib\site-packages\moviepy\video\VideoClip.py", line 1146, in init
raise IOError(error)
OSError: MoviePy Error: creation of None failed because of the following error:

[WinError 2] 系统找不到指定的文件。.

.This error can be due to the fact that ImageMagick is not installed on your computer, or (for Windows users) that you didn't specify the path to the ImageMagick binary in file conf.py, or that the path you specified is incorrect

ImageMagick确实是已经安装了, 字体文件也在那个目录,还有其它原因会导致这个问题么?
PS D:\model\FunClip-main\funclip> magick --version
Version: ImageMagick 7.1.1-29 Q16-HDRI x64 0deac72:20240225 https://imagemagick.org
Copyright: (C) 1999 ImageMagick Studio LLC
License: https://imagemagick.org/script/license.php
Features: Channel-masks(64-bit) Cipher DPC HDRI Modules OpenCL OpenMP(2.0)
Delegates (built-in): bzlib cairo flif freetype gslib heic jng jp2 jpeg jxl lcms lqr lzma openexr pangocairo png ps raqm raw rsvg tiff webp xml zip zlib

TypeError: generate() missing 1 required positional argument: 'input'

funasr == 1.0.10
modelscope == 1.12.0


Traceback (most recent call last):
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 330, in
main()
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 326, in main
runner(**kwargs)
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 276, in runner
res_text, res_srt, state = audio_clipper.recog((sr, wav), sd_switch)
File "/data/zssy-digital-human/projects/funasrapp/ClipVideo/clipvideo/videoclipper.py", line 35, in recog
rec_result = self.asr_pipeline(audio_in=data)
File "/data/home/yaokj5/anaconda3/envs/geneface/lib/python3.9/site-packages/modelscope/pipelines/audio/funasr_pipeline.py", line 73, in call
output = self.model(*args, **kwargs)
File "/data/home/yaokj5/anaconda3/envs/geneface/lib/python3.9/site-packages/modelscope/models/base/base_model.py", line 35, in call
return self.postprocess(self.forward(*args, **kwargs))
File "/data/home/yaokj5/anaconda3/envs/geneface/lib/python3.9/site-packages/modelscope/models/audio/funasr/model.py", line 61, in forward
output = self.model.generate(*args, **kwargs)
TypeError: generate() missing 1 required positional argument: 'input'

NameError: name 'ClusterBackend' is not defined

Traceback (most recent call last):
File "D:\2 github\FunClip\funclipper\launch.py", line 7, in
funasr_model = AutoModel(model="iic/speech_seaco_paraformer_large_asr_nat-zh-cn-16k-common-vocab8404-pytorch",
File "C:\Users\whyuan\anaconda3\envs\py39\lib\site-packages\funasr\auto\auto_model.py", line 129, in init
self.cb_model = ClusterBackend().to(kwargs["device"])
NameError: name 'ClusterBackend' is not defined

请问上述报错该如何解决呢?

要多大的显存?1070显卡8G不够用

RuntimeError: CUDA error: out of memory
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1.
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

there is no sound in the output video(clipped video).

OS: linux
Python Version:3.8.16
Package Version:pytorch=1.12.1、torchaudio=0.12.1、modelscope=1.6.1、funasr version=0.5.8
Model:clipvideo
Command:

  1. python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 -output_dir output
  2. python videoclipper.py --stage 2 --file ../examples/2022云栖大会_片段.mp4 --output_dir output/ --dest_text '需要的一个社会的基础能力' --start_ost 0 --end_ost 100 --output_file 'output/audioclip.mp4'
    Details:
    stage 1's output is normal; but stage 2's output file audioclip.mp4 is quiet, there is no sound in this file!

tips: there was an error when running stage1, so I changed one line in videoclipper.py, the change is:

  •    wav = librosa.load(audio_file, 16000)[0]
    
  •    wav = librosa.load(audio_file, sr=16000)[0]
    

Error log:
there is no error log.

(1)stage 1's log:
2023-06-09 02:28:27,527 - modelscope - INFO - PyTorch version 1.12.1 Found.
2023-06-09 02:28:27,528 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-06-09 02:28:27,561 - modelscope - INFO - Loading done! Current index file version is 1.6.1, with md5 9d90e25216aa22a0c83204f1426d282d and a total number of 849 components indexed
/root/anaconda3/envs/wenet/bin/python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 -output_dir output
usage: videoclipper.py [-h] [--config CONFIG] --stage {1,2} --file FILE [--output_dir OUTPUT_DIR] [--dest_text DEST_TEXT]
[--start_ost START_OST] [--end_ost END_OST] [--output_file OUTPUT_FILE]
videoclipper.py: error: unrecognized arguments: -output_dir output
(wenet) root@tjtx162-39-101:/home/work/wangyaru05/workspace/E2E/GIT/videoclip_20230608/FunASR-APP/ClipVideo/clipvideo# python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 --output_dir output
2023-06-09 02:28:36,929 - modelscope - INFO - PyTorch version 1.12.1 Found.
2023-06-09 02:28:36,931 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-06-09 02:28:36,963 - modelscope - INFO - Loading done! Current index file version is 1.6.1, with md5 9d90e25216aa22a0c83204f1426d282d and a total number of 849 components indexed
/root/anaconda3/envs/wenet/bin/python videoclipper.py --stage 1 --file ../examples/2022云栖大会_片段.mp4 --output_dir output
WARNING:root:Initializing modelscope asr pipeline.
2023-06-09 02:28:38,535 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.4
INFO:modelscope:Model revision not specified, use the latest revision: v1.2.4
2023-06-09 02:28:38,889 - modelscope - INFO - initiate model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
INFO:modelscope:initiate model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-06-09 02:28:38,890 - modelscope - INFO - initiate model from location /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
INFO:modelscope:initiate model from location /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch.
2023-06-09 02:28:38,890 - modelscope - INFO - initialize model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
INFO:modelscope:initialize model from /root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch
2023-06-09 02:28:38,894 - modelscope - WARNING - No preprocessor field found in cfg.
WARNING:modelscope:No preprocessor field found in cfg.
2023-06-09 02:28:38,894 - modelscope - WARNING - No val key and type key found in preprocessor domain of configuration.json file.
WARNING:modelscope:No val key and type key found in preprocessor domain of configuration.json file.
2023-06-09 02:28:38,894 - modelscope - WARNING - Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
WARNING:modelscope:Cannot find available config to build preprocessor at mode inference, current config: {'model_dir': '/root/.cache/modelscope/hub/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch'}. trying to build by task and model information.
2023-06-09 02:28:38,894 - modelscope - WARNING - No preprocessor key ('generic-asr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
WARNING:modelscope:No preprocessor key ('generic-asr', 'auto-speech-recognition') found in PREPROCESSOR_MAP, skip building preprocessor.
2023-06-09 02:28:40,032 - modelscope - INFO - Model revision not specified, use the latest revision: v1.2.0
INFO:modelscope:Model revision not specified, use the latest revision: v1.2.0
2023-06-09 02:28:40,222 - modelscope - INFO - loading vad model from /root/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch ...
INFO:modelscope:loading vad model from /root/.cache/modelscope/hub/damo/speech_fsmn_vad_zh-cn-16k-common-pytorch ...
2023-06-09 02:28:40,470 - modelscope - INFO - Model revision not specified, use the latest revision: v1.1.7
INFO:modelscope:Model revision not specified, use the latest revision: v1.1.7
2023-06-09 02:28:40,789 - modelscope - INFO - loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch ...
INFO:modelscope:loading punctuation model from /root/.cache/modelscope/hub/damo/punc_ct-transformer_zh-cn-common-vocab272727-pytorch ...
Initializing VideoClipper.
Recognizing video file: ../examples/2022云栖大会_片段.mp4
MoviePy - Writing audio in ../examples/2022云栖大会_片段.wav
MoviePy - Done.
2023-06-09 02:29:12,960 - modelscope - INFO - Decoding with pcm files ...
INFO:modelscope:Decoding with pcm files ...
batch_size_token: 6000
time cost vad: 1.8394007682800293
batch: 5
time cost asr: 2.206648588180542
time cost punc: 0.42623400688171387
2023-06-09 02:29:17,719 - modelscope - INFO - Computing the result of ASR ...
INFO:modelscope:Computing the result of ASR ...
Write total subtitile to output/total.srt
Recognition successed. You can copy the text segment from below and use stage 2.
呃,尊敬的刘书记,那个卢省长,各位领导,各位院士,各位合作伙伴现场的和在线上的所有的伙伴们,大家好啊,这个又站在这个舞台上,又是一年的这个云栖大会非常的激动。这个今年是第十四年了,确实这个这个云栖大会因阿里而生啊,在因阿里的云计算而生,但到今天也是成为了一个**。这个产业界的盛会成为我们这个数字时代。我们大家讨论共同话题的一个场所啊,非常的开心。尤其是刚才我们这个青晨奖的这个颁奖,也是阿里这个近五年来的我们的一个新举措。我们也是希望啊通过这个实世代在的努力,能够啊这个结识更多的啊**的这个青年科学家在他们各自的赛道上能够助力他们去攀登科学的高峰。啊,这个我想也是对阿里巴巴来讲,就像今天我讲的主题一样,就是阿里巴巴的技术责任在哪里?对阿阿里巴巴的技术责任来讲,还是首先是不仅是自身啊去追求我们技术的先进性,同时也用阿里这样的一个平台,一个舞台能够更好的来助力。我们这个更多的青年科学家去多的面向未来的科学家们能够去追求这个科学的高峰,去追求他们的技术的先进性,科学的先进性。所以这个是我们办这个奖的初心啊,我们也会一届一届的办下去,也是希望我们有更多的啊青年科学家参与进来。并且我们在过去五年当中结识的各位的伙伴们啊,能够在各自的赛道上能够有新的建树,能够为**的科技的发展站在世界之巅啊,站在这个先进性的世界之巅,能够做出自己的贡献。这个青春奖就是一个缩影啊,背后我刚才说了也是阿里追求先进性的一个不断的一个努力的结果。今天的整个的伴随着云这个云栖大会的召开,这十四年阿里的这个云计算,包括阿里的这个数字生态也在不断的发展,这也是整个**啊全面的走向这个数字化的一个缩影。啊,今天这个在前面这个包括我们张叶峰的主题这个演讲当中也分享了我们在整个的云计算方面,我们的阿里云的这个过去几年的努力,特别是在今年啊面向未来的发向,我们提出的观点啊,我们努力的方向。这个确实今这十几年来,我们是一代又一代的我们的我们的阿里云的技术人,阿里巴巴的技术人们啊通过自己的努力实践,希望能够在一个全新的赛道上,就是计算。当这个数字字济济代代计算成为一个包需要的一个基础设施,需要的一个社会的基础能力。这样一个全新的赛道上,能够站在世界之巅,同世界各国的所有的这个伙伴们同场竞技。

(2)
stage 2's log:
2023-06-09 02:30:59,346 - modelscope - INFO - PyTorch version 1.12.1 Found.
2023-06-09 02:30:59,348 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2023-06-09 02:30:59,380 - modelscope - INFO - Loading done! Current index file version is 1.6.1, with md5 9d90e25216aa22a0c83204f1426d282d and a total number of 849 components indexed
/root/anaconda3/envs/wenet/bin/python videoclipper.py --stage 2 --file ../examples/2022云栖大会_片段.mp4 --output_dir output/ --dest_text 需要的一个社会的基础能力 --start_ost 0 --end_ost 100 --output_file output/audioclip.mp4
WARNING:root:Initializing VideoClipper.
Moviepy - Building video output/audioclip.mp4.
MoviePy - Writing audio in audioclipTEMP_MPY_wvf_snd.mp3
MoviePy - Done.
Moviepy - Writing video output/audioclip.mp4

Moviepy - Done !
Moviepy - video ready output/audioclip.mp4
WARNING:root:Save clipped mp4 file to output/audioclip.mp4
WARNING:root:Write clipped subtitile to output/audioclip.srt

KeyError: 'sd_sentences' in write_state()

在写入状态的时候未检查key是否存在导致抛出异常。https://github.com/alibaba-damo-academy/FunASR-APP/blob/main/ClipVideo/clipvideo/trans_utils.py#L59

WARNING:root:Write total subtitile to ./output/total.srt
Traceback (most recent call last):
  File "clipvideo/videoclipper.py", line 329, in <module>
    main()
  File "clipvideo/videoclipper.py", line 325, in main
    runner(**kwargs)
  File "clipvideo/videoclipper.py", line 283, in runner
    write_state(output_dir, state)
  File "/data/playground/funasr/FunASR-APP/ClipVideo/clipvideo/trans_utils.py", line 59, in write_state
    fout.write(str(state[key[1:]]))
KeyError: 'sd_sentences'

TypeError: GenericFunASR: 'NoneType' object is not callable

windos 下 使用funasr-1.0.2 modelscope-1.11.1版本报错如下

Traceback (most recent call last):
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\utils\registry.py", line 212, in build_from_cfg
return obj_cls(**args)
^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\pipelines\audio\funasr_pipeline.py", line 62, in init
super().init(model=model, **kwargs)
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\pipelines\base.py", line 100, in init
self.model = self.initiate_single_model(model, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\pipelines\base.py", line 53, in initiate_single_model
return Model.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\models\base\base_model.py", line 183, in from_pretrained
model = build_model(model_cfg, task_name=task_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\models\builder.py", line 35, in build_model
model = build_from_cfg(
^^^^^^^^^^^^^^^
File "D:\appinstall\pycharm-env\FunASR-main\Lib\site-packages\modelscope\utils\registry.py", line 215, in build_from_cfg
raise type(e)(f'{obj_cls.name}: {e}')
TypeError: GenericFunASR: 'NoneType' object is not callable

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.