Quiet-Joker

How does one install accelerate? It's saying ModuleNotFoundError: No module named 'accelerate' Edit: added "accelerate" to "requirements_versions.txt" made it go away. However when training i get "CUDA out of memory....

> I can use Shivam's repo with 3060 12gb if I enable accelerate and 8-bit adam, I can even do 'train_text_encoder' if I enable gradient_checkpointing. I don't see this working...

> I think there might be some issues with loading characters at the moment - didn't have this issue on the older release from a couple days ago. same i'm...


I talked with Jllll on discord and this is what he said.  So hopefully when it comes to the AWQ issue in the new update with Flash Attention 2,...

Mistral 7b and Open-Orca_Mistral-7B-OpenOrca only has a context lenght of 8192 token. So it's safe to say anything above 8192 is not going to be stable. Try setting the max...

> wait... so: why was it fine before that? Because Mistral is trained on a max length of 8192 tokens anything smaller than that is fine. However anything bigger than...

I think it's an installation issue but... i don't know if it will work but... here is my copy of the modules folder. Hope that helps somehow. [modules.zip](https://github.com/oobabooga/text-generation-webui/files/14811110/modules.zip)

i would also like to know. I've been watching this PR for a while and i hope this solves many of the repetitions issues i am having even with the...

Why tho? It's already being displayed on the cmd window. Adding it to the UI would be unnecessary unless you using it through the API in which case it would...