Thireus ☠

@matatonic, fantastic work btw! :)

> change to `from utils import find_layers` > > GPTQ just _love_ breaking changes. Thank you. I can confirm that fixes it.

Looks like it fails lint tests - @tobihagemann

Same issue. randomly shows up from time to time in the middle of the assistant's answer.

``` Error occurred when executing KSampler: Given groups=1, weight of size [320, 16, 1, 1], expected input[2, 64, 12, 12] to have 16 channels, but got 64 channels instead ```...

>  In terms of picture details, there is still room for improvement. Occasionally, there are prompts that cause a messy picture like the picture in the upper right corner....

The donation for "Peercoin Marketing Fund" has been somehow collected, but I still cannot find myself in the donors' list: http://peer4commit.com/projects/96/donors That's the transaction that collected the funds (which took...

@suquark, I'm also looking for an openai compatible API. https://github.com/hyperonym/basaran/ does exactly this, but might be best for speed, efficiency and maintenance to implement such API interface directly within FastChat....

@davidliudev, I just tried https://huggingface.co/elinas/alpaca-30b-lora-int4 with alpaca-30b-4bit-128g.safetensors This is what I get:  And similar hallucinations with vicuna. Could you share your parameters please? Edit: Unchecking "do_sample" helps get rid...

@ZYHowell would you have any update for us about a potential 30B version? :)