Allen

I tried the docker image, but bunch of requirements were not installed, like pytorch-lightning, bitsandbytes. After installing the requirements, there are still problems, stop trying. Enviroment: - image: hpcaitech/colossalai:0.2.0 -...

> [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) is released and FasterTransformer development has transitioned to TensorRT-LLM. > > TensorRT-LLM also supports very long sequence length, please try that. @byshiue Did you mean FasterTransformer will be...