ABQ-LLM icon indicating copy to clipboard operation
ABQ-LLM copied to clipboard

Published 20 hours ago • verified publisher icon bytedance

How to reproduce the results of end-to-end throughput experiment?

Open FlyFoxPlayer opened this issue 5 months ago • 4 comments

Thanks for your great work!

I want to know how to reproduce the results of end-to-end throughput experiments? That is e2e_speed. png. Can you provide the complete code integrated into FastTransformer?

Thanks！

FlyFoxPlayer avatar Sep 09 '24 09:09 FlyFoxPlayer