audio-westlakeu/audiossl

A library built for easier audio self-supervised training, downstream tasks evaluation

audiossl's Issues

questions about atst-frame evaluated on audioset_strong_eval

Hi, I notice that your work is the first one to conduct evaluation on audioset_eval_strong dataset, this is really amazing. Recently, I am going to evaluate my method on this set too, so there are some details I want to ask you,

1. Does the 'w/o var-pen' mean that the parameter 'alpha_st' in the psds function equals to 0?
2. While computing the psds2 score on the set, I find that the process gets stuck due to the high CPU demanding, have you ever met the same problem?
3. Since no weak or unlabeled data is available, is the model trained solely with frame-level binary cross-entropy loss on the 100000+ training set?
   I am looking forward to your reply, many thanks.

not found 'assl' package.

Hi, Thanks for the great work!
When I ran audioset.py to convert Audioset to lmdb-format, met "ModuleNotFoundError: No module named 'assl' "
I think 'audiossl' repository hasn't module named 'assl'
How can I solve it?

Extracting embeddings.

Hello,

Could you please provide me information on how to extract embeddings from the model?

I am working with VoxCeleb2 audio data. I am training the model from scratch and would like to extract embeddings for further processing.

Please do let me know.

Regards,
Sreeni...

ATST: Could you share finetuning details, please?

Dear authors,

First, congratulations on the great results you have achieved.
These are wonderful numbers!
(BTW, I think I should clarify that I am the author of BYOL-A. Thank you for making progress!)

I'm trying to replicate your results, especially finetuning of VoxCeleb1, but I found that some of the details are missing.
Could you show us the exact parameters for finetuning, please?

Missing files are:

• audiossl/methods/atst/shell/downtream/finetune/eval_env.sh
• & eval_func.sh

And if you could, could you show me the parameter specifically for reproducing VC1 finetuning?
I was able to start training as follows, but with guessed parameters. I would need the right ones...

cd audiossl/methods/atst
python downstream/train_finetune.py --n_last_blocks 12 \
--pretrained_ckpt_path ./base.ckpt \
--save_path exp \
--learning_rate 5e-2 \
--max_epochs 50 \
--warmup_epochs 5 \
--dataset_name voxceleb1 \
--data_path /lab/data/voxceleb1 \
--batch_size 64

BTW, I'm sure your paper would have been accepted by Interspeech. I hope you could also update the arxiv comment to clarify.

Thank you.

Figure background can be black in a dark mode browser

Hello,
Thank you for sharing your code. I just wanted to let you know that your figures might not be correctly shown on the browser of readers.

It's like this if in dark mode.

I guess filling the background in white will solve your issue.

Congrats to your new version!

Congratulations https://arxiv.org/abs/2306.04186!

As a knee-jerk reaction, I tweeted this:
https://twitter.com/nizumical/status/1666667705737330689?s=20

I'm very impressed with your achievement.
I'm looking forward to checking your code, especially the distillation part. :)

P.S. I'm sure your paper will be on TASLP.

Share the training log

Is there any way to share the training log of the trained models? I would like to see how the loss has changed during training and compare it to my training on a custom data set.

sorry, I want to know how to download the audioset?

sorry to bother you, I only downloaded the tfrecord file on the audioset official website, can i use it to do experiment? If it can't, how can I download the audio file? thank you~