How to calculate the novel class AP in base training

[megvii-research]

How to calculate the novel class AP in base training

[Chauncy-Cai]

Because during base training step, we only train base class. That's to say, no instance of novel classes is trained.
If my memory is right, during the base training stage, the classifier's shape weight is [61,1024], which means the model can't predict any novel class.

[Fly-dream12]

Thanks. So how is the Baseline-FPN results in Table 4 calculated ? (on both base and novel classes) @Chauncy-Cai

[bsun0802]

Thanks. So how is the Baseline-FPN results in Table 4 calculated ? (on both base and novel classes) @Chauncy-Cai

@Fly-dream12
Hi, we forget the reference in Table 4. We added the reference to the paper in an update to the arxiv. Please refer to the new version.

The first two lines, Baseline-FPN and MPSR, are directly coming from the paper MPSR (https://arxiv.org/abs/2007.09384). The 3rd and 4th lines are ours results. The method are different. Please refer to that paper for details.

[bsun0802]

Thanks. So how is the Baseline-FPN results in Table 4 calculated ? (on both base and novel classes) @Chauncy-Cai

Clearly the base detector model can not predict novel instances. The Base AP and Novel AP are for the novel fine-tuned model. The point is, after fine-tune, which method "forget" less about base.