Jie Ye comments

Repositories
Issues
Comments

Results 4 comments of


                                            Jie Ye

Build TensorRT-LLM occur error without container

BTW, Does Tensorrt-LLM have to use openmpi? Can I build it with mpich or cray-mpich? When I build TensorRT-LLM without using openmpi, it always report the following error: [100%] Built...

Build TensorRT-LLM occur error without container

> I got the same error without container I solve this problem by using cuda12.2 and openmpi.

Build TensorRT-LLM occur error without container

> > openmpi > > what do you mean "openmpi"？ I mean that I installed openmpi library instead of using mpich library. TensorRT-LLM's KVCache Manager rely on mpi for some...

How to use DeepSpeed-MII to deploy a LLM model from DeepSpeed/Megatron-DeepSpeed trained checkpoints?

I got it. Thanks a lot.