PaddleSlim icon indicating copy to clipboard operation
PaddleSlim copied to clipboard

可不可以出一个动态图的bert量化例子

Open kismit opened this issue 2 years ago • 2 comments

kismit avatar May 30 '22 11:05 kismit

@kismit 目前没有动态图量化训练的demo。可以模型动转静后直接量化训练和离线量化: 自动化压缩(量化训练):https://github.com/PaddlePaddle/PaddleSlim/tree/develop/demo/auto_compression/nlp 离线量化:https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/model_compression/pp-minilm/quantization

yghstill avatar Jun 02 '22 03:06 yghstill

pp-minilm这里面提供的是离线量化的方式吧?nlp动态图没有qat的方式?

kismit avatar Jun 02 '22 06:06 kismit