Data leakage with tasks 1295 and 1640

[axelmarmet]

Data leakage with tasks 1295 and 1640

[danyaljj]

@axelmarmet Thanks for reporting this!

@yeganehkordi would you be able to address this?

[yeganehkordi]

@yeganehkordi would you be able to address this?

Sure, task1295 is a "Question Answering" task and task1640 is an "Answerability Classification" task, so they are not exactly the same.
I think one solution may be using different instances in these tasks. Also, we can replace one of them with another task. What do you think?

[danyaljj]

@yizhongw suggests moving this task from splits/default/train_tasks.txt to splits/default/excluded_tasks.txt. I think this should address the concern; right?

[yeganehkordi]

Yeah, I'll fix it.