LaaZa

I've synced this with main, I don't have time to test right now though.

@fxmarty I believe this works now after many fixes and features in AutoGPTQ. Sealion is also supported even though there is extra `transformer.wpe` compared to standard MPT, since all extra...

I have noticed that on linux the port is not being released immediately. This can happen when doing reload or even after closing the program in other ways. But since...

How are you loading a model at startup? What are your launch params?

That's what I'm asking about. How are you loading the model, as in what settings do you have?

Since you do not specify --wbits and --groupsize it's not a GPTQ model(or won't be loaded anyway) Then you might be loading a normal model at 16bit, this could very...

You know you could give a bit more information. What is the exact filename? I need to know what type of model you are actually trying to load.

I don't see the reason why loading should be done when you select the model, just causes more problems. You might also want to load the settings for the model...

@oobabooga think you can merge this soon or give a reason why not? I'm going crazy with how many times the current loading system has f'ed me over. We can...

> i have tried adding a stop button today but it didn't work, I think for the same reason why the "Stop" button doesn't work when the model is outputting...