Ze Wang

TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'

14

Warning: Torch did not find available GPUs on this system. If your intention is to cross-compile, this is not an error. By default, Apex will cross-compile for Pascal (compute capabilities...

Error: Warmup(Generation("'bool' object has no attribute 'dtype'"))

3

### System Info lorax latest docker, 2 A100, unbuntu 22.04 ### Information - [X] Docker - [ ] The CLI directly ### Tasks - [ ] An officially supported command...

Need some help. " You need to decrease --max-batch-prefill-tokens."

1

### System Info latest ### Information - [ ] Docker - [ ] The CLI directly ### Tasks - [ ] An officially supported command - [ ] My own...

Error: Warmup(Generation("Not enough memory to handle 1024 prefill tokens. You need to decrease `--max-batch-prefill-tokens`")

2

### System Info latest lorax ### Information - [ ] Docker - [ ] The CLI directly ### Tasks - [ ] An officially supported command - [ ] My...

Is there any plan to support dynamic lora for qwen/chatglm models?

21

### Feature request Cool job! I have successfully run mulit-lora with llama2-70b. I would like to ask if the author has any plans to support other models, such as qwen,...