langchain
langchain copied to clipboard
Unable to create opensearch index.
Hi Team, I am using opensearch as my vectorstore and trying to create index for documents vectors. but unable to create index:
Getting error:
ERROR - The embeddings count, 501 is more than the [bulk_size], 500. Increase the value of [bulk_size]
Can someone please advice ?
Thanks
@msinha251 we are setting a default max limit for bulk_size as 500 and validating the embeddings count with this max limit. So, if you need to ingest embeddings more than 500 then, increase the limit by sending it as an argument like bulk_size=1000
Hi, @msinha251! I'm Dosu, and I'm here to help the LangChain team manage their backlog. I wanted to let you know that we are marking this issue as stale.
From what I understand, you were facing an error while creating an index for document vectors in opensearch. You were advised by @naveentatikonda to increase the value of [bulk_size] if the embeddings count exceeds the current limit of 500. It seems like the issue has been resolved by following this advice.
Before we close this issue, we wanted to check with you if it is still relevant to the latest version of the LangChain repository. If it is, please let us know by commenting on the issue. Otherwise, feel free to close the issue yourself or it will be automatically closed in 7 days.
Thank you for your contribution to the LangChain repository!