chroma icon indicating copy to clipboard operation
chroma copied to clipboard

Update sentence_transformer_embedding_function.py

Open louisbrulenaudet opened this issue 4 months ago • 1 comments

Description of changes

  • Improvements & Bug fixes
    • Updated the encoding function to support modification of the batch_size to prevent memory errors on small GPUs or when using large models when the device is set to cuda.

Test plan

  • [x] Tests pass locally with pytest for python.

Documentation Changes

  • The new batch_size parameter is now available in the documentation.

louisbrulenaudet avatar Sep 29 '24 16:09 louisbrulenaudet