Qingrui Hu

It's cool！But is there any progress with this feature？

I use the same `deepspeed.json` as you provide. But when I use `python3 -m FastChat.serve.cli --model-path /path/to/my_model`, I got RuntimeError: 'weight' must be 2-D. This error seems from `torch.embedding`. Have...

> > I use the same `deepspeed.json` as you provide. But when I use `python3 -m FastChat.serve.cli --model-path /path/to/my_model`, I got RuntimeError: 'weight' must be 2-D. This error seems from...

I also think there is a way, but want to know how.

Is there a way to install and use it in Nuget directly?