Riley Hun

**Describe the bug** I am doing LLM fine-tuning for the `bigscience/t0-3b model`, and after 8 hours, it was stalling. Out of curiosity, I switched to `t5-small`, and noticed it was...

DJL-TensorRT-LLM Bug: TypeError: Got unsupported ScalarType BFloat16

3

## Description (A clear and concise description of what the bug is.) I'm am building the DJL-Serving TensorRT-LLM LMI inference container from scratch, and deploying on Sagemaker Endpoints for Zephyr-7B...

### System Info ## Description I'm am building the DJL-Serving TensorRT-LLM LMI inference container from scratch, and deploying on Sagemaker Endpoints for Zephyr-7B model. Unfortunately, I run into an error...