bhsueh_NV comments

Results 639 comments of


                                            bhsueh_NV

May i use triton-inference-server to run T5 model

1. From the model card, T5 v1.1 uses the GEGLU, which is not supported in FasterTransformer now. 2. You should ask this question in the Megatron-LM repo. We are not...

encoder_sample has segment fault on A100.

Please provide the steps to reproduce your issues, including the docker environment, building scripts and running scripts.

encoder_sample has segment fault on A100.

Close this bug because it is inactivated. Feel free to re-open this issue if you still have any problem.

Undefined reference to `MPI::Comm::Comm()'

What docker image do you use?

Undefined reference to `MPI::Comm::Comm()'

Docker is not necessary. But it is helpful to setup the environment. I guess the problem you encounter is you don't install the MPI, or the make file cannot find...

Undefined reference to `MPI::Comm::Comm()'

ok, your driver and gpu are both too old to use the docker. Try to build the repo in your previous environment, but add `-DBUILD_MULTI_GPU=OFF`.

Undefined reference to `MPI::Comm::Comm()'

You can try the suggestion in this issue https://github.com/NVIDIA/FasterTransformer/issues/69.

Undefined reference to `MPI::Comm::Comm()'

Besides, you can try to add `-lmpi` into CMakeLists.txt of `gptj_example`.

Undefined reference to `MPI::Comm::Comm()'

Close this bug because it is inactivated. Feel free to re-open this issue if you still have any problem.

找不到你们的安装文档

Please refer the guides in https://github.com/NVIDIA/FasterTransformer/tree/main/docs.