DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

Does deepspeed inference support PTQ?

Open frankxyy opened this issue 1 year ago • 1 comments

I search in the doc and find setting for inference for model of QAT. Is there a function for inference of PTQ model?

frankxyy avatar Apr 23 '23 09:04 frankxyy

has the same question ? any example?

tingshua-yts avatar May 10 '23 06:05 tingshua-yts

Interested in this discussion - Any updates on this ?

aasthavar avatar Oct 02 '23 07:10 aasthavar