Details about the implementation

[dremaker52]

Details about the implementation

[debasmitdas]

Can you upload your implementation ?

[dremaker52]

I just modified code from here https://github.com/apache/incubator-mxnet/tree/master/example/image-classification. I only change the network architecture to 4 conv blocks.

[pengzhou1108]

@dremaker52 I am also trying to re-implement the network. Could you tell me how did you implement the 2nd training procedure? (the novel weight generator)

[gidariss]

Hi all, I just uploaded the implementation code.

[pengzhou1108]

@gidariss Thanks for the update. How many epoch you have trained to get the numbers reported in README? I just tried 60 epoch for both stage 1 and 2 of training and only got 50.3% of the novel classes for 5-way 1-shot miniImageNet dataset. (Conv128)

[gidariss]

In all Mini-Imagenet experiments both training stages last for 60 training epochs. However, because the training split of Mini-Imagenet is relatively small and there is a danger of overfitting, the training snapshot (i.e., the model parameters at the end of each training epoch) that "survive" from each training stage is that that achieves the highest accuracy on the novel categories of the validation split of Mini-Imagenet. In other words, there is early stopping strategy in order to avoid overfitting.

So, for the model with the Conv128 feature extractor, at the 1st training stage the training snapshot that is kept at the end is that of the 25th training epoch and at the 2nd training stage the training snapshot that is kept at the end is that of the 35th training epoch. This actually means that for the Covn128 case many of the 60 training epochs are actually useless and can be avoided.