YIFEI SHEN

icon indicating a website link https://barryshen1.github.io/

icon company University of Washington - Seattle icon location Seattle, WA icon location Master student @UW, Seattle

Results 1 issues of YIFEI SHEN

OOM Error when Running AWQ + OmniQuant Combination (Step 2: OmniQuant) Despite Using Multiple GPUs

I'm encountering an Out-of-Memory (OOM) error when trying to run the second step (OmniQuant) of the AWQ + OmniQuant combination quantization method. This happens despite having allocated 2 A40 GPUs...