BLoRA

BLoRA copied to clipboard

Benchmark using pytorch - speed up lora operation on batch

4

Bear with me.. I'm learning! I thought that the python for loop would slow things down, instead you could batch the operation. This is still WIP, I'm trying to wrap...

yacineMTB

`OutOfMemoryError: CUDA out of memory. Tried to allocate 20.00 MiB` during output phase with winddude/wizardLM-LlaMA-LoRA-7B:

1

i ran it on free colab. used the code as is. got this at the last cell after it got to winddude/wizardLM-LlaMA-LoRA-7B: ``` winddude/wizardLM-LlaMA-LoRA-7B: Develop an eight sentence short story...

fritol

Do you have plan to expand this projects' functions into stable diffusion domain ?

1

As the title say, expand it into diffuser project.

svjack