[Bug]: milvus_haystack write embedding take more then 3 second

[yoke233]

[Bug]: milvus_haystack write embedding take more then 3 second

[yanliang567]

/assign @jaelgu
could you please help to take a look?
@yoke233 are you running on milvus lite?
/unassign

[yoke233]

milvus running on docker compose

it may be MilvusDocumentStore's bug

[jaelgu]

Forwarded to Milvus-haystack repo: milvus-io/milvus-haystack#29

[zc277584121]

@yoke233 can you try this demo, which excludes other interfering factors

import time

from milvus_haystack import MilvusEmbeddingRetriever, MilvusDocumentStore
from haystack import Document

DEFAULT_CONNECTION_ARGS = {
    # "uri": "http://localhost:19530",  # This uri works for Milvus docker service
    "uri": "./milvus_test.db",  # This uri works for Milvus Lite
}

document_store = MilvusDocumentStore(  # or any other vector db instance
    connection_args=DEFAULT_CONNECTION_ARGS,
    consistency_level="Strong",
    drop_old=True,
)


def run(document_store: MilvusDocumentStore):
    documents = []
    doc = Document(
        content="A Foo Document",
        meta={
            "name": "name_0",
            "page": "100",
            "chapter": "intro",
            "number": 2,
            "date": "1969-07-21T20:17:40",
        },
        embedding=[-10.0] * 128,
    )

    for i in range(1000):
        documents.append(doc)
    t0 = time.time()
    document_store.write_documents(documents)
    t1 = time.time()
    print(f"Time to write documents: {t1 - t0} seconds")

    # retriever = MilvusEmbeddingRetriever(
    #     document_store,
    # )
    # query_embedding = [-10.0] * 128
    # res = retriever.run(query_embedding)


if __name__ == '__main__':
    run(document_store)

## Time to write documents: 0.7143099308013916 seconds

If everything is right, the Time to write documents should be a small number.