lichangW

Thanks for reply. Yes, it's much slower than others when we testing on a single A100 environments with same dataset and load test script. I also tested with text-generation-benchmark --tokenizer-name...

同问，遇到同样的问题