Giter Site home page Giter Site logo

kakashidan / wespeaker Goto Github PK

View Code? Open in Web Editor NEW

This project forked from wenet-e2e/wespeaker

0.0 0.0 0.0 491 KB

Research and Production Oriented Speaker Recognition Toolkit

License: Apache License 2.0

Shell 2.54% C++ 15.92% Python 80.35% Perl 0.36% CMake 0.84%

wespeaker's Introduction

WeSpeaker

License Python-Version

Roadmap | Paper | Runtime (x86_gpu) | Python binding | Pretrained Models | Huggingface Demo

WeSpeaker mainly focuses on speaker embedding learning, with application to the speaker verification task. We support online feature extraction or loading pre-extracted features in kaldi-format.

Installation

  • Clone this repo
git clone https://github.com/wenet-e2e/wespeaker.git
  • Create conda env: pytorch version >= 1.10.0 is required !!!
conda create -n wespeaker python=3.9
conda activate wespeaker
conda install pytorch=1.12.1 torchaudio=0.12.1 cudatoolkit=11.3 -c pytorch -c conda-forge
pip install -r requirements.txt
  • If you just want to use the pretrained model, try the python binding!
pip3 install wespeakerruntime

๐Ÿ”ฅ News

  • 2023.02.27: Update onnxruntime (C++), see onnxruntime, #135

  • 2023.02.15: Update the code for multi-node training. For how to setup multi-node training, please refer to #131.

  • 2022.11.30: Multi-Query Multi-Head Attentive Pooling (MQMHASTP) and Intertopk-Subcenter Loss are supported, see #115.

Recipes

  • VoxCeleb: Speaker Verification recipe on the VoxCeleb dataset
    • ๐Ÿ”ฅ UPDATE 2022.10.31: We support deep r-vector up to the 293-layer version! Achiving 0.447%/0.043 EER/mindcf on vox1-O-clean test set
    • ๐Ÿ”ฅ UPDATE 2022.07.19: We apply the same setups as the CNCeleb recipe, and obtain SOTA performance considering the open-source systems
      • EER/minDCF on vox1-O-clean test set are 0.723%/0.069 (ResNet34) and 0.728%/0.099 (ECAPA_TDNN_GLOB_c1024), after LM fine-tuning and AS-Norm
  • CNCeleb: Speaker Verification recipe on the CnCeleb dataset
    • ๐Ÿ”ฅ UPDATE 2022.10.31: 221-layer ResNet achieves 5.655%/0.330 EER/minDCF
    • ๐Ÿ”ฅ UPDATE 2022.07.12: We migrate the winner system of CNSRC 2022 report slides
      • EER/minDCF reduction from 8.426%/0.487 to 6.492%/0.354 after large margin fine-tuning and AS-Norm
  • VoxConverse: Diarization recipe on the VoxConverse dataset

Support List:

Discussion

For Chinese users, you can scan the QR code on the left to follow our offical account of WeNet Community. We also created a WeChat group for better discussion and quicker response. Please scan the QR code on the right to join the chat group.

Citations

If you find wespeaker useful, please cite it as

@article{wang2022wespeaker,
  title={Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit},
  author={Wang, Hongji and Liang, Chengdong and Wang, Shuai and Chen, Zhengyang and Zhang, Binbin and Xiang, Xu and Deng, Yanlei and Qian, Yanmin},
  journal={arXiv preprint arXiv:2210.17016},
  year={2022}
}

Looking for contributors

If you are interested to contribute, feel free to contact @wsstriving or @robin1001

wespeaker's People

Contributors

jijijiang avatar cdliang11 avatar czy97 avatar wsstriving avatar robin1001 avatar hunterhuan avatar slyne avatar wd929 avatar xx205 avatar pengzhendong avatar underdogliu avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.