Appropriate layer to adapt

[erictzeng]

Appropriate layer to adapt

[rshaojimmy]

@avisekiit Yes, I got the same understanding and question as yours. May this be a trick in this paper?

[jhoffman]

The comparison of the last layers is only done in aggregate -- usually with batch sizes over 100 for each of the source and target. It's more of a comparison of the distribution shape, rather than a comparison between the similarity of individual images. Thus, the target (and source) labels are not used during ADDA training.

[avisekiit]

@jhoffman Thanks for your reply. I just have a thought: why do you think that it is better to adapt the ultimate last layer which mainly outputs classification logits instead of some intermediate layers which can capture high level features. At least from the diagram of your flow diagram of your paper I got a feel that source encoder and classifier were 2 separate modular components and you adapt the features extracted by the encoder section of both target and source..
Thanks again for your time....