emberys/nnqlm_ir

AAAI-2018

NNQLM_IR

Language Modeling (LM) is a fundamental research topic in a range of areas. Recently, inspired by quantum theory, a novel Quantum Language Model (QLM) has been proposed for Information Retrieval (IR). In this paper, they aim to broaden the theoretical and practical basis of QLM. We develop a Neural Network based Quantum-like Language Model (NNQLM) and apply it to Question Answering. Specifically, based on word embeddings, they design a new density matrix, which represents a sentence (e.g., a question or an answer) and encodes a mixture of semantic subspaces. Such a density matrix, together with a joint representation of the question and the answer, can be integrated into neural network architectures (e.g., 2-dimensional convolutional neural networks). Experiments on the Clueweb-09Cat-B and Robust-04 datasets have verified the effectiveness of our proposed models in Ad-hoc retrieval.

End-to-End Quantum-Like Language Models with Application to Question Answering (AAAI-2018)