zkf331 issues

Repositories
Issues
Comments

Results 1 issues of


                                            zkf331

Performance of W4A8 throughput on Hopper GPU.

## System Info Intel(R) Xeon(R) Platinum 8468 NVIDIA H800-80G TensorRT-LLM version 0.12.0 ## Who can help? @Tracin @byshiue ## Reproduction I followed the official procedure for LLama2 7b quantization，and compare...