p-md-zeeshan-sheikh issues

Repositories
Issues
Comments

Results 1 issues of


                                            p-md-zeeshan-sheikh

Load it in to 16-bit quantization(float16 or bfloat16)

Hi @qiudi0127, Thanks for the support and sharing this repo, I want to load the models in the float16 or bfloat16, but still even though I have ram of 46GB...