msgersch

I am on Ubuntu 16.0.4.1 x64 Desktop. I checked out dev and had build issues as well. The patch above partially fixes it, but it still had the same problem...

I'm trying to quantize on 2xA100 and am getting the following out of memory error. I am on TensorRT-LLM 0.9.0 and not sure what the issue is. @njaramish any thoughts?...