ctransformers icon indicating copy to clipboard operation
ctransformers copied to clipboard
verified publisher icon marella

fix: context_length has no effect

Open chosen-ox opened this issue 1 year ago • 0 comments

When I ran the model, I found context_length has no effect. I try to fix it same as https://github.com/marella/ctransformers/blob/ed02cf4b9322435972ff3566fd4832806338ca3d/ctransformers/gptq/llm.py#L213

chosen-ox avatar Jan 28 '24 07:01 chosen-ox