sheegao comments

Repositories
Issues
Comments

Results 2 comments of


                                            sheegao

How to parallelize a model with fake quantization nodes?

> Hi @sheegao , which framework do you use? Does 'fake quantization nodes' mean quant-dequant pairs? Yes,it's mean quant-dequant pairs,but I have not found any existing distributed frameworks that support...

How to parallelize a model with fake quantization nodes?

> Hi @sheegao , you can directly deploy a fake quantized torch model with torch [DistributedDataParallel API](https://pytorch.org/docs/master/generated/torch.nn.parallel.DistributedDataParallel.html). I don't think this will be a problem. yeah，But I'm interested in pipeline...