StableLM icon indicating copy to clipboard operation
StableLM copied to clipboard

Running Quantized Model

Open RaghavMajorBoost opened this issue 2 years ago • 0 comments

Hi All,

Does anyone else run into the following error when attempting to run the 8-Bit version of the StableLM notebook? image

Essentially, all I changed was I set the 8-bit flag to True

RaghavMajorBoost avatar Apr 24 '23 18:04 RaghavMajorBoost