tlyhenry

Results 1 issues of tlyhenry

Hey, I am using the tensorrtllm version 0.15 My model is a llama3.2 3b model. And I am using the A100. I am using the generation logits for my use...

triaged
stale
Investigating
waiting for feedback