Ayushman Singh

icon indicating a website link https://www.ayushmansingh.com icon indicating an email [email protected]

icon company Capital One icon location Manhattan, New York icon location Making LLM's go brrr at Capital One

Results 1 issues of Ayushman Singh

Llama 3 70B FP8 engine build failed with FMHA

2 comment

### System Info AWS p5 (4 x 80GB H100 GPUs) TensorRT-LLM v0.11.0 ### Who can help? @byshiue @Tracin ### Information - [X] The official example scripts - [ ] My...

triaged
not a bug
waiting for feedback