evaluate and test

[nlpyang]

evaluate and test

[astariul]

@antonysama

He meant in your evaluation command, you should replace -bert_data_path ~/o3/PreSumm/bert_data/ into -bert_data_path ~/o3/PreSumm/bert_data/cnndm

[eridgd]

Change -bert_data_path ~/o3/PreSumm/bert_data/ to -bert_data_path ~/o3/PreSumm/bert_data/cnndm, it will append the .valid/test.pt to that.

[antonysama]

@eridgd,

Thanks. The pre- processing steps change the json file 'cnndm_sample.train.0.bert.json' to torch file, 'cnndm_sample.train.0.bert.pt' . The torch file remains with that name throughout the training steps (ex, ab, & ex-ab). It doesn't give me the 'cnndm', which you showed. But I tried appending my torch file like you showed, to no avail : ( (all steps are documented : https://github.com/antonysama/PreSumm/blob/master/README.md).

[antonysama]

@eridgd, @colanim,

How do you get the 'cnndm' file? Because I get 'cnndm_sample.train.0.bert.pt' after preprocessing, and even after training. I'm missing something between the processing and training, and that's the cnndm file you mention.

[astariul]

@antonysama
There is no cnndm file

Specifying -bert_data_path ~/o3/PreSumm/bert_data/cnndm is just a way to indicate to the code the folder with the root name of your training files. So if you have data from another dataset, you can put it in the same folder with a different root name.

Just try to run the same command with this option, without changing anything else.

---

Note : If you data files start with cnndm_sample, you might need to change the option to -bert_data_path ~/o3/PreSumm/bert_data/cnndm_sample

[antonysama]

Thanks, I'll try this. Much appreciated.