chatgpt-retrieval-plugin icon indicating copy to clipboard operation
chatgpt-retrieval-plugin copied to clipboard

Published 20 hours ago • verified publisher icon openai

[Enhancement] Add sentence-transformers embedding support

Open ZhangJianAo opened this issue 2 years ago • 0 comments

Add sentence-transformers embedding support.

Use the EMBEDDING_ENGINE environment variable to control which engine to use.

The sentence-transformers/all-MiniLM-L6-v2 model generates vector with 384 items. Therefore, some datastores may need to create an index based on the vector length of the embedding engines, instead of hardcoding it to 1536.

ZhangJianAo avatar Jul 13 '23 12:07 ZhangJianAo