julep icon indicating copy to clipboard operation
julep copied to clipboard

Published 20 hours ago • verified publisher icon julep-ai

Increase batch size limit for embedding

Open HamadaSalhab opened this issue 1 year ago • 0 comments
trafficstars

Description

The litellm service throws an error when trying to embed a document with a big list of strings in the content field.

Reproduce

To reproduce, try to embed a document and set the content field to any list of strings that has more than 128 elements.

Logs

image

HamadaSalhab avatar Oct 12 '24 10:10 HamadaSalhab