zjding comments

Repositories
Issues
Comments

Results 2 comments of


                                            zjding

The max tokens of a model deployed using Xinference can only be set to 2048

> > I have upgraded to dify 0.5.3, but the max token can still only be set to 2048. > > > BTW, max_tokens is different from context_size, max_tokens specifies...

The max tokens of a model deployed using Xinference can only be set to 2048

> @lileiseven Something like this. Thanks. Maybe that works on ollama, but the xinference don't have such options, I can only set less than 2048 in dify's interface, is that...