Cydia2018

Of course. Although in my experiments, RepVGG didn't perform as well as darknet.

> Can I add a friend please? I want to ask you better Sure, you can leave your QQ or WeChat if you use them.

> Yes, the current implementation counts the averaged FLOPs across all the examples in the validation set Thanks for your reply!

@hiworldwzj 是的，我没有使用Fast Tokenizer，但是vllm和lightllm都未使用，所以我认为这不是性能差距的主要原因。

@hiworldwzj 请告诉我如何计算max_total_token_num的合理区间，方便的话，请直接告诉我你们在测试65b模型的参数设置（数据集相同），谢谢

@hiworldwzj 我在A1000-smx-80G，tp=8，max_total_token_num最大开到193696，吞吐量仍然只有2.98request/s