DeepSpeedExamples icon indicating copy to clipboard operation
DeepSpeedExamples copied to clipboard

Why does the chat.py script model answer normally, but answer repeatedly when step3

Open Luoxiaohei41 opened this issue 2 years ago • 0 comments

I deployed the model using the chat.py script and the model answered normally, but the output of the actor model was repeated throughout the step3.

chat.py: 捕获

step3: 捕获2

actor model: llama2-13b rw model: llama2-13b hybrid engin enable

Luoxiaohei41 avatar Nov 10 '23 03:11 Luoxiaohei41