Michael Vandi comments

Repositories
Issues
Comments

Results 3 comments of


                                            Michael Vandi

Return error code (e.g. "message_length_exceeds_limit") from sendMessage

@adminha is that characters or bytes?

Return error code (e.g. "message_length_exceeds_limit") from sendMessage

@emipc @transitive-bullshit @adminha is the 4097 limit based on tokens, characters or bytes?

Adding End-Of-Generation-Token parameter for text generation Inference API

You can do something like this ``` { "inputs": "What is Deep Learning?", "parameters": { "max_new_tokens": 300, "stop": ["", "", "}"] } } ``` Where parameters.stop is an array of...