GPTQ-for-LLaMa icon indicating copy to clipboard operation
GPTQ-for-LLaMa copied to clipboard

Published 20 hours ago • verified publisher icon qwopqwop200

LoRa and diff with bitsandbytes

Open RonanKMcGovern opened this issue 2 years ago • 0 comments

  1. What changes would I need to make for GPTQ to support LoRa for Llama 2?
  2. What's the main difference between GPTQ vs bitsandbytes? Is it that GPTQ re-adjusts the weights to keep the same loss function shape?

RonanKMcGovern avatar Aug 03 '23 09:08 RonanKMcGovern