ShAw7ock

icon company Sun Yat-Sen University icon location Guangzhou, China

Results 1 comments of ShAw7ock

[Question]: Why do we need to hard-code the value of max tokens

And I got the similar problem that I even modify the max_tokens setting logic. I modify `api/db/services/dialog_service.py` like: ```python ... # Avoid messages fit # used_token_count, msg = message_fit_in(msg, int(max_tokens...