Question about submission file on INTERACTION Challenge

[ChengkaiYang]

Question about submission file on INTERACTION Challenge

[william-gx]

@william-gx The code for deriving the yaw predictions can be found here:

FJMP/fjmp_metrics.py

Line 53 in c8a57e5

def get_psirad_pred(loc_pred, heading_present, ctrs):

@RLuke22 Many thanks for your reply and the code.

[RLuke22]

Hi Chengkai,

To reproduce our results on the INTERACTION leaderboard, we retrain the models with both the train+validation datasets and use the checkpoint at the final epoch to build our submission. As the INTERACTION leaderboard is now open again, I will include the code to build the submission file (including how to derive the yaw predictions). This will be pushed in the next week - thanks for your patience.

[ChengkaiYang]

Hi Chengkai,

To reproduce our results on the INTERACTION leaderboard, we retrain the models with both the train+validation datasets and use the checkpoint at the final epoch to build our submission. As the INTERACTION leaderboard is now open again, I will include the code to build the submission file (including how to derive the yaw predictions). This will be pushed in the next week - thanks for your patience.

Hi, Luke,
I found INTERACTION dataset's challenge benchmark might not exists now (website can't be open in my computer). When I try to open the leaderboard, the competition url page, http://challenge.interaction-dataset.com/prediction-challenge/intro got crashed. Have you met the same problem? If not, could you please tell me the correct challenge url? I would like to know does INTERACTION challenge use a new url which might be different from the old one? Thanks!

[RLuke22]

Hi Chengkai,
To reproduce our results on the INTERACTION leaderboard, we retrain the models with both the train+validation datasets and use the checkpoint at the final epoch to build our submission. As the INTERACTION leaderboard is now open again, I will include the code to build the submission file (including how to derive the yaw predictions). This will be pushed in the next week - thanks for your patience.

Hi, Luke, I found INTERACTION dataset's challenge benchmark might not exists now (website can't be open in my computer). When I try to open the leaderboard, the competition url page, http://challenge.interaction-dataset.com/prediction-challenge/intro got crashed. Have you met the same problem? If not, could you please tell me the correct challenge url? I would like to know does INTERACTION challenge use a new url which might be different from the old one? Thanks!

Yes, I'm facing the same problem, unfortunately. I will still release the test submission code in case the INTERACTION leaderboard goes live again.

[ChengkaiYang]

Hi Chengkai,
To reproduce our results on the INTERACTION leaderboard, we retrain the models with both the train+validation datasets and use the checkpoint at the final epoch to build our submission. As the INTERACTION leaderboard is now open again, I will include the code to build the submission file (including how to derive the yaw predictions). This will be pushed in the next week - thanks for your patience.

Hi, Luke, I found INTERACTION dataset's challenge benchmark might not exists now (website can't be open in my computer). When I try to open the leaderboard, the competition url page, http://challenge.interaction-dataset.com/prediction-challenge/intro got crashed. Have you met the same problem? If not, could you please tell me the correct challenge url? I would like to know does INTERACTION challenge use a new url which might be different from the old one? Thanks!

Yes, I'm facing the same problem, unfortunately. I will still release the test submission code in case the INTERACTION leaderboard goes live again.

Thank you so much!

[william-gx]

@RLuke22 Hi Luke, we notice that the INTERACTION leaderboard opens again. Could you kindly release the test submission code, especially code for deriving the yaw predictions. Many thanks.

[RLuke22]

@ChengkaiYang @william-gx Sorry for the delay on this. The repository is now updated with the INTERACTION test submission code, with instructions in the README.

[RLuke22]

@william-gx The code for deriving the yaw predictions can be found here:

FJMP/fjmp_metrics.py

Line 53 in c8a57e5

def get_psirad_pred(loc_pred, heading_present, ctrs):