ChatGLM-6B icon indicating copy to clipboard operation
ChatGLM-6B copied to clipboard

model.chat()方法的max_length是指回答的response的长度吗

Open blue-q opened this issue 2 years ago • 1 comments

Is there an existing issue for this?

  • [X] I have searched the existing issues

Current Behavior

model.chat()方法的max_length是指回答的response的长度吗

Expected Behavior

No response

Steps To Reproduce

model.chat()方法的max_length是指回答的response的长度吗

Environment

OS: Ubuntu 20.04
Python: 3.8
Transformers: 4.26.1
PyTorch: 1.12
CUDA Support: True

Anything else?

No response

blue-q avatar Apr 25 '23 07:04 blue-q

经测试,是输入(历史)+输出的总长度。但是由于输入是外界传入的,所以最终影响的是输出长度。

yuri2peter avatar Jun 27 '23 03:06 yuri2peter