pl8787/setrank

Implementation of SetRank in SIGIR 2020

SetRank

Tenforflow implementation of [SIGIR 2020] SetRank: Learning a Permutation-Invariant Ranking Model for Information Retrieval.

Usage

Quick Start

If you have downloaded Istella Dataset please comment sh download_data.sh.

sh run.sh

Data Preparation

cd data
sh download_data.sh
python norm_split_dataset.py

Model Training/Testing

sh ./scripts/train_lambdamart_istella.sh
sh ./scripts/prepare_data_lambda_istella.sh
sh ./scripts/train_transformer_istella.sh

Citation

If you use SetRank in your research, please use the following BibTex entry.

@inproceedings{pang2019setrank,
    title={SetRank: Learning a Permutation-Invariant Ranking Model for Information Retrieval},
    author={Liang Pang and Jun Xu and Qingyao Ai and Yanyan Lan and Xueqi Cheng and Jirong Wen},
    booktitle = {Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval},
    series = {SIGIR'20},
    year = {2020},
}

License

Apache-2.0

Copyright (c) 2019-present, Liang Pang (pl8787)

setrank's Issues

reverse_input ERROR

SetRank/src/data_utils.py

Line 70 in 3845a5a

if reverse_input:

I guess here should be if not reverse_input ?