Extracted flux lora not working

[DarkViewAI]

2 Issues

1. sometimes it works, but it looks nothing like the fine tuned model.
2. Doesnt work and i get the error below

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/home/Ubuntu/apps/stable-diffusion-webui-forge/modules_forge/main_thread.py", line 30, in work self.result = self.func(*self.args, **self.kwargs) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/modules/txt2img.py", line 112, in txt2img_function processed = processing.process_images(p) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/modules/processing.py", line 815, in process_images res = process_images_inner(p) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/modules/processing.py", line 958, in process_images_inner samples_ddim = p.sample(conditioning=p.c, unconditional_conditioning=p.uc, seeds=p.seeds, subseeds=p.subseeds, subseed_strength=p.subseed_strength, prompts=p.prompts) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/modules/processing.py", line 1329, in sample samples = self.sampler.sample(self, x, conditioning, unconditional_conditioning, image_conditioning=self.txt2img_image_conditioning(x)) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/modules/sd_samplers_kdiffusion.py", line 198, in sample sampling_prepare(self.model_wrap.inner_model.forge_objects.unet, x=x) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/sampling/sampling_function.py", line 380, in sampling_prepare memory_management.load_models_gpu( File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/memory_management.py", line 587, in load_models_gpu loaded_model.model_load(model_gpu_memory_when_using_cpu_swap) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/memory_management.py", line 392, in model_load raise e File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/memory_management.py", line 387, in model_load self.real_model = self.model.forge_patch_model(patch_model_to) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/patcher/base.py", line 226, in forge_patch_model self.lora_loader.refresh(target_device=target_device, offload_device=self.offload_device) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/patcher/lora.py", line 394, in refresh weight = merge_lora_to_weight(current_patches, weight, key, computation_dtype=torch.float32) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/home/Ubuntu/apps/stable-diffusion-webui-forge/backend/patcher/lora.py", line 72, in merge_lora_to_weight weight = weight.to(dtype=computation_dtype) torch.cuda.OutOfMemoryError: Allocation on device 0 would exceed allowed memory. (out of memory) Currently allocated : 45.21 GiB Requested : 252.00 MiB Device limit : 47.44 GiB Free (according to CUDA): 10.25 MiB PyTorch limit (set by user-supplied memory fraction) : 17179869184.00 GiB Allocation on device 0 would exceed allowed memory. (out of memory) Currently allocated : 45.21 GiB Requested : 252.00 MiB Device limit : 47.44 GiB Free (according to CUDA): 10.25 MiB PyTorch limit (set by user-supplied memory fraction) : 17179869184.00 GiB