text-embeddings-inference icon indicating copy to clipboard operation
text-embeddings-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Input validation error: `inputs` must have less than 512 tokens. Given: 534

Open gctian opened this issue 6 months ago • 6 comments

System Info

  • text-embeddings-router 1.1.0

  • python3.10

  • centos

  • A800

Information

  • [ ] Docker
  • [X] The CLI directly

Tasks

  • [ ] An officially supported command
  • [ ] My own modifications

Reproduction

text-embeddings-router start an embedding serving, but always got the error 【 Input validation error: inputs must have less than 512 tokens】，which param should i use to change max tokens of input？512 is too short, i can not find true param in RAEDME or --help

Expected behavior

which param should i use to change max tokens of input？

gctian avatar Jul 26 '24 06:07 gctian