Nicolas Iglesias
Results
12
comments of
Nicolas Iglesias
I partially solved this but it's generating a bunch of **A:** ```sh ❯ ./build/bin/gpt-j -m ./ggml-model-f16.bin -p "A continuación hay una instrucción que describe una tarea. Proporciona una respuesta que...
> 8-bit and 4-bit quantization without `groupsuze=128` works. 2-bit quantization does not and return garbage output. `groupsize=128` in each case causes garbage output too. I used groupsize 128 for 4...