yl4579/slmgan

SLMGAN: Exploiting Speech Language Model Representations for Unsupervised Zero-Shot Voice Conversion in GANs

slmgan's Issues

Some questions about implementation details

1.Does SLMGAN use R1 regularization like StarGANv2-VC? If so, how to apply it? If not, should I use any other techniques to stabilize the training of GAN?
2.After epoch 20, the SLM-based discriminator joins training. At this time, does the Mel-based discriminator need to exit training?
3.When using WavLM as training objectives, what should I pass in to the attention_mask parameter of its forward function? Leave it alone or generate masks based on the length of the source audio?
4.Does increasing the number of speakers during training rather than just the 89 speakers in VCTK lead to better performance?
5.When will the official implementation be released?
Thank you.