raphaelsty/neural-cherche

Neural Search

Hello 👋

₁ Passionate about Language Models, Information Retrieval and Knowledge Graphs (PhD).

₂ Love modelizing things using ML. Still haven't found the killer feature yet.

₃ Love sharing models using APIs.

₄ Strong interest for databases and SQL.

₅ Strong interest for the retrieval augmented generation (RAG) paradigm -> cherche, neural-cherche, neural-tree

₆ My personal Knowledge Base is available here.

neural-cherche's Issues

Load the triplets input incrementally

Hi, I have triplets whose size does not fit my memory. Is there a way to avoid OOM, say, by loading "X" incrementally from a file instead?

How to train ColBERT model on a lot of data?

How do i use the trainer to train on a lot of data on limited RAM on colab. Im using the V100 16GB GPU and have close to 6.9M training examples/triplets

Mismatch in documents embeddings size

Hi,

Thanks for the great work on the repo.

While attempting to encode documents using my custom dataset, I've encountered a discrepancy in the number of input docs and the number of embedding produced. For eg.

ranker_documents_embeddings = ranker.encode_documents(
    documents=documents, # total: 30452
    batch_size=batch_size,
)
print(len(ranker_documents_embeddings), len(documents)) #prints 30427 30452

Do you have any insight into what might be causing this issue?

Thanks

[Feature request] ColBERT V2

Hi @raphaelsty,

first of all, thanks a lot for your this project. I really appreciate its simplicity and effectiveness.

Question: do you have any plans to implement ColBERT V2?

Best wishes.

DeepImpact implementation

I would love to see DeepImpact (https://arxiv.org/pdf/2104.12016.pdf) here.

could you please explain the rational behind applying clip on ranking loss

neural-cherche/neural_cherche/losses/ranking.py

Line 74 in 97ba18d

return torch.clip(loss, min=0.0, max=1.0)

License

Hello, thank you for the fantastic work!
Could you please tell me the license of this repository?

What is licence of the splade/sparsembed models hosted in huggingface?

Hi @raphaelsty, could you please let me know what is the licence of the below splade/sparsembed models hosted in huggingface?

https://huggingface.co/raphaelsty/splade-max
https://huggingface.co/raphaelsty/distilbert-splade
https://huggingface.co/raphaelsty/sparsembed-max
https://huggingface.co/raphaelsty/distilbert-sparsembed