FlexGen icon indicating copy to clipboard operation
FlexGen copied to clipboard

Soft Label of Flexgen

Open 2003pro opened this issue 2 years ago • 1 comments

I tried to extract output prediction probs from pytorch_backend.py in flex_opt. But I can not get logits returns. I have little idea about extracting logits from your complex distribution computations. Thus, I am wondering if you could support the output of both ids and logits in apps?

2003pro avatar Feb 25 '23 17:02 2003pro

Sure! I will work on this and upload the code soon.

Ying1123 avatar Feb 26 '23 04:02 Ying1123