uclnlp/ntp

End-to-End Differentiable Proving

ntp's Issues

Running code does not produce stated results from paper

Hello,

I am a PhD student working on a project building on your paper. Running the code in the manner described in the readme does not seem to reproduce the results from the paper.

For example, running learn.py with the countries_S1_complex.conf file yields AUC-PR of 17.5, not 99 as reported in the paper. Similar discrepancies occur using other complEx configuration files, and smaller discrepancies for the NTP setting.

I was wondering if this is a known problem with the code/scripts, or if I am misapprehending the instructions in the readme.

Thank you for your time.

How to determine the number in front of the rule template in nlt files for a new dataset?

From the paper, we can know the number in front of the rule template indicates how often a parameterized rule of the given structure will be instantiated. But I still don't know how to determine this number for a new dataset like FB15K-237. Could you give me some suggestions? Thank you!