stonemo/avgn

Official implementation for AVGN

avgn's Issues

Dataset Download

Thank you for your best work! I follow your introduction but fail to download the datasets. Please provide the datasets download links in your paper and give me a more detailed introduction.

How to download VGG-Instruments dataset

The link from “https://github.com/hxixixh/mix-and-localize” can not found this dataset.

Incorrect Evaluation Method for Multi-Source Evaluation

The paper mentions the utilization of 448 x 224 images for evaluation purposes. However, the evaluation process involves splitting the images into two 224 x 224 images in your code. This is totally different from the described methodology in the paper and "mix and localize" paper. Figure 2 in your paper suggest the generation of n localization maps for n mixture sources from a single image, whereas the evaluation in the code operates on already splitted n images. The method suggested in the Figure 2 and the evaluation method employed in the code will be expected significantly different results. In CAP calculation, latter method excludes the evaluation of half of the area where other classes exist. Could you please specify precisely which evaluation method was utilized?

Code References:
In datasets.py, in the getitem function, for multi-source scenarios, instead of having 3x448x224 images, a stack operation is utilized to create a structure of 2 x 3x 224 x 224.

In model.py, in the forward function, when the image channel length is 5 (indicating the presence of stacked images), only the first image is considered.

In train.py, the validate_multi function does not utilize mixture images of size 448x224; rather, it divides them into two 224x224 images, processes them through the model, evaluates each, and averages the results.

Data set processing

Could you please provide the script of data set processing, thank you very much

Pretrain models

Could you release the pre-trained models of this project?