Question about the FVD evaluation

[hsi1032]

Question about the FVD evaluation

[alanspike]

Hi,

Thanks for your interests. We used the FVD code from here.

Also, we made some changes for the released MoCoGAN-HD repo, such as changing DataParallel to DistributedDataParallel, and used the repo to train on different datasets to get the released checkpoints, so there might be some differences for the metrics.

[hsi1032]

Thanks for your prompt response!

That means the evaluation process I did is same as your implementation?
(FVD between randomly sampled 2048 real videos and fake videos)

[bluer555]

Yes, we did it in the same way :)

[hsi1032]

Now I understand the detailed evaluation process!

Thanks again for kind replying!

[songweige]

Hi, thank you for maintaining the codebase and replying to the issues timely!

I have a follow-up question based on the comments of @bluer555 and @hsi1032 - did you calculate the distance between the 2048 i3d feature vectors of real and fake batch, or calculate the distance using 16 feature vectors and average over 2048/16=128 distances? If it is the former, how did get the standard deviation in the table? Thanks!

[bluer555]

Hi,

We get the distance by 2048 feature vectors and repeat this process 10 times to get the std.