Question about the evaluation

[google-deepmind]

Question about the evaluation

[serycjon]

yes, only the timestamps before the starting point are ignored ( https://github.com/deepmind/tapnet/blob/e8e85c7a55b91524984d54a6eaa2e855efcd7eeb/evaluation_datasets.py#L114 ). Note that the starting point is not always the first frame (frame number 0), but instead, it is the first frame where the given point was visible. E.g. some point is evaluated from frame 17 forward.

[qianduoduolr]

Thanks for your reply.
In the situation we mentioned above, I wonder how TAPNet deals with the occlusions. I find the model leverages the Huber loss only at visible points. When a point is occluded in the next frame and appears later, how the model performs point tracking?