Confusions about REPLUG

[richhh520]

Confusions about REPLUG

[danielfleischer]

Hi, thanks for the questions. Here we focused more on the LLM part of the REPLUG paper, where documents can be fed in parallel. In general, documents can be retrieved using any method; for the simplicity of the notebook we showed in memory DB that uses BM25 with re-ranker using off-the-shelf sentence transformer. We don't have training code for embedders here, we might add it in the future.

The PromptModel is an abstraction around LLMs where you provide a model name and it generates text based on a prompt, abstracting away whether it is a local model, the hardware specifications or perhaps even a cloud-based service. The API is part of Haystack v1, which we use for the development of our library.

[kerkathy]

Thanks for the work, here also look forward to the implementation of the REPLUG training :)