xportz

How do you guys get these benchmarking results? When I CTRL+C out of the program, I get no output. Thanks.

After converting GPTQ to GGML do you still get the benefits of GPTQ with its better accuracy compared to RTN quantization?