rag-experiment-accelerator icon indicating copy to clipboard operation
rag-experiment-accelerator copied to clipboard

Add support for shortening dimensions in new OpenAI embeddings models

Open tomconte opened this issue 10 months ago • 0 comments

Background: this is a feature request from a customer project.

Recent models from OpenAI allow shortening the embeddings, e.g. with text-embedding-3-large the dimensions can be reduced from 3072 to 256 with still a better performance than ada-002 with 1536 dimensions. This has the potential benefit of reducing the index size (specifically vector space) without impacting performance.

To support this in the accelerator, the additional "dimensions" parameter can be added to the embeddings.create() call in embedding/aoai_embedding_model.py.

tomconte avatar Apr 22 '24 17:04 tomconte