Shuchang Zhou issues

Repositories
Issues
Comments

Results 2 issues of


                                            Shuchang Zhou

Any plan to support PEFT LoRA models?

I played with the [`hf_generate` ](https://github.com/pytorch/tau/pull/772) branch and it seems quite ready to be expanded to support BLOOM-3B/7B1 models etc (https://github.com/zsc/tau/pull/1 ). Great work! Is there an imminent plan to...

How can I train a model for cuda int4?

Please give some instructions.