ChatGLM-6B
ChatGLM-6B copied to clipboard
model.chat()方法的max_length是指回答的response的长度吗
Is there an existing issue for this?
- [X] I have searched the existing issues
Current Behavior
model.chat()方法的max_length是指回答的response的长度吗
Expected Behavior
No response
Steps To Reproduce
model.chat()方法的max_length是指回答的response的长度吗
Environment
OS: Ubuntu 20.04
Python: 3.8
Transformers: 4.26.1
PyTorch: 1.12
CUDA Support: True
Anything else?
No response
经测试,是输入(历史)+输出的总长度。但是由于输入是外界传入的,所以最终影响的是输出长度。