Claudio Montanari

icon indicating a website link https://medium.com/@c.montanari.95 icon indicating an email [email protected]

icon company Elevance Health, Inc. icon location Chicago icon location Hello, world! I love technology and solving complex problems. My current interests are distributed systems, generative AI, and cloud-native development

Results 1 issues of Claudio Montanari

Regression on EETQ quantized models

### System Info I have reasons to believe that this https://github.com/huggingface/text-generation-inference/pull/1729 is causing a 2-3x performance regression on decoding stage when running EETQ quantized models on multiple shards with Cuda...