Inquiry about the evaluation part

[deadlykitten4]

Hi, thanks for your great work! But is there any update on the code of the efficiency evaluation part? Cause I saw it was uploaded 11 months ago, and I encounter some problems with evaluation, hope that you can help me with that. Thank you! :)

[deadlykitten4]

Hi, I am still confused about the evaluation of the throughput, cause the result I got (as you can see in the picture) is quite different from the result in your paper. I evaluate it on a single A100, the format is FP16. I don't know if there is something wrong with my setting or my implement method. Could you please help me with that?

[ldengjie]

@Ambitious4 the same problem, have you found the reason?

[deadlykitten4]

@ldengjie Nope, I still can't figure out what is the problem of it. And most of my results show that there is no speedup compared to the original model. And may I know what's your experimental setting?

[QZJ-2003]

same problem