star issues

Repositories
Issues
Comments

Results 1 issues of


                                            star

Performance for Llama-2-7b in fp8 is lower than benchmark

### System Info > ### System Info > * CPU architecture: `x86_64` > * GPU: NVIDIA 4090 24GB > * TensorRT-LLM: 0.10.0.dev2024042300 > * Triton Inference Server: `r24.02` > *...

bug

triaged