Junwei Li
Junwei Li
Did you solve it? I have the same problem.
my command trtllm-build --checkpoint_dir ./tllm_checkpoint_1gpu_fp8 \ --output_dir ./engine_outputs \ --gemm_plugin float16 \ --strongly_typed \ --gpt_attention_plugin bfloat16 \ --workers 1 this is my log, oot@696da90ac847:/TensorRT-LLM/examples/llama/run/quantization/fp8# ./build.sh [TensorRT-LLM] TensorRT-LLM version: 0.9.0.dev2024040900 [04/17/2024-16:36:51]...