BladeDISC icon indicating copy to clipboard operation
BladeDISC copied to clipboard
verified publisher icon alibaba

How to get best performace with optimization with torch_blade

Open JackWeiw opened this issue 1 year ago • 2 comments

My script compare Torch with Disc

However according to profiling , Disc boost litle compare to Torch, even in some dynamic range worse than torch,. Is there some i missing to get optimal performance of Disc? h5120_i13824_n40_2 h4096_i16384_n32_2 h4096_i11008_n32_2

JackWeiw avatar May 07 '24 06:05 JackWeiw

I updated my script like examples in Disc torch inference do, another problem occured 捕获

your kindly help is much appriciated!!! @Yancey1989 @eedalong

JackWeiw avatar May 08 '24 08:05 JackWeiw

I passed the half precission model to blade_disc, however, the saved optimized model by blade_disc is fp32, how come? image

JackWeiw avatar Jun 06 '24 05:06 JackWeiw