marawanokasha/fhv_paper_code

Code for the paper "An LSTM approach to Patent Classification based on Fixed Hierarchy Vectors" to be presented in SDM 2018

FHV Paper Code

Code for the paper: "An LSTM approach to Patent Classification based on Fixed Hierarchy Vectors" to be presented in the SIAM International Conference on Data Mining (SDM) in May 2018.

The code is organized into steps. Run the code for every step from within its folder using the init.sh script provided

fhv_paper_code's Issues

Spark documentation missing

Hi!

I am trying to run the code in step 3. However, I am not sure how the spark service should be set up with respect to your code. Do you have a script to reproduce the setup?

I am also attempting to convert the code to not use spark but I am not sure if that is the right move.

Thanks,
Goonmeet

Missing files

I am trying to replicate your experiments. However, it seems like the Git Repo is missing some pickle files:
doc_classification_map.pkl
training_docs_list.pkl
validation_docs_list.pkl
test_docs_list.pkl
Would you still happen to have these files?

If not are you able to explain the format of these files? Based on the code, it seems that the files contain a list of document indexes and document ids. What exactly is the difference between these fields?

Thanks in advance!