hawkwm

About 1, if just test on one machine, still need to use Triton? Is there any difference between performance tested by Triton and by scripts https://github.com/NVIDIA/FasterTransformer/blob/main/examples/cpp/multi_gpu_gpt/multi_gpu_gpt_example.cc ?