Prototypical Network Clarification from Tutorial 16

[AbhirKarande]

Prototypical Network Clarification from Tutorial 16

[phlippe]

Hi,

1. The ProtoNet uses the support set to create the prototype feature vectors, with which the query is compared. In that sense, yes, both support set and query set are inputs to the model.
2. If you fix the support set but still calculate the prototypes by encoding the support set with the same encoder as the queries, then it would still be considered a ProtoNet. Thus, if you take a trained ProtoNet and evaluate it on a new dataset with fixed classes, then it is still a ProtoNet due to the way it was trained. However, if you would remove the prototypes and instead make them learnable feature vectors independent of a support set, then it is not a ProtoNet anymore and actually becomes a standard classifier, since the last layer is equivalent to a linear layer.
3. ProtoNets are more generalizable than normal classifiers to other datasets by adapting their classification head to new datasets. That being said, the model has been trained on CIFAR100. Thus, it will work better with datasets that are similar to CIFAR100, and performance decreases if you use datasets with very different statistics/characteristics.

[AbhirKarande]

Clarified! Thank you very much!