error with very large chunk_size

[safevideo]

error with very large chunk_size

[SeeknnDestroy]

Hi @seoeaa, can you please share your code snippet that caused this error?

[fcakyon]

Hello @seoeaa, we appeciate you feedbacks on the autollm 🙏

autollm supports documents with infinite length. Your issue is not related to inserting a lot of text.

Your issue will be fixed once you select lower chunk_size as 512 or 1024. 👍

Check this comment for more context: #77 (comment)

Comment:

I changed it otherwise it didn't work service_context_params = { "chunk size": 4096, "embed_model": "local" }

@seoeaa you should be using smaller chunk sizes such as 1024 or 512. chunk_size is a different parameter than context_size.

Context size automatically arranges by autollm for target llm, you don't have to set it manually.