sd-webui-deforum icon indicating copy to clipboard operation
sd-webui-deforum copied to clipboard

Error when I change the keyframes from 2D to 3D[Bug]:

Open cyberbadger6969 opened this issue 1 year ago • 4 comments

Have you read the latest version of the FAQ?

  • [X] I have visited the FAQ page right now and my issue is not present there

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Are you using the latest version of the Deforum extension?

  • [X] I have Deforum updated to the lastest version and I still have the issue.

What happened?

when I go to the deforum and change the keyframes to 3D it shows mee this error: Error: 'Input type (float) and bias type (struct c10::Half) should be the same'. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of . Full error message is in your terminal/ cli.

Win11 GTX 1660Ti Python3.10.6

Steps to reproduce the problem

Go to Deforum Change keyframes to 3D Click generate ERROR

What should have happened/how would you fix it?

No response

Torch version

[webui [5ab7f213] deforum exten](torch: 2.0.0+cpu)

On which platform are you launching the webui with the extension?

Local PC setup (Windows)

Deforum settings

https://drive.google.com/file/d/1bnOKfQIgegX4wdNfWEvhKUIiHyeR_y8A/view?usp=sharing

Webui core settings

https://drive.google.com/file/d/1j5OvKc4Y6fyGnvjZfT4UspVGQSGzQuqc/view?usp=drive_link

Console logs

Already up to date.
venv "E:\DEFORUM\stable-diffusion-webui-directml\venv\Scripts\Python.exe"
fatal: No names found, cannot describe anything.
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug  1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: 1.5.1
Commit hash: b180d1df30125ed606f94a779536f2dfb8aca74a


Launching Web UI with arguments:
no module 'xformers'. Processing without...
no module 'xformers'. Processing without...
No module 'xformers'. Proceeding without it.
2023-08-10 02:22:14,497 - ControlNet - INFO - ControlNet v1.1.237
ControlNet preprocessor location: E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-controlnet\annotator\downloads
2023-08-10 02:22:14,579 - ControlNet - INFO - ControlNet v1.1.237
Loading weights [879db523c3] from E:\DEFORUM\stable-diffusion-webui-directml\models\Stable-diffusion\dreamshaper_8.safetensors
*Deforum ControlNet support: enabled*
Creating model from config: E:\DEFORUM\stable-diffusion-webui-directml\configs\v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
Startup time: 12.1s (launcher: 1.3s, import torch: 4.5s, import gradio: 1.2s, setup paths: 1.6s, other imports: 1.8s, list SD models: 0.2s, load scripts: 0.8s, create ui: 0.4s, gradio launch: 0.3s).
DiffusionWrapper has 859.52 M params.
Applying attention optimization: InvokeAI... done.
Model loaded in 4.2s (load weights from disk: 0.6s, create model: 0.3s, apply weights to model: 0.5s, apply half(): 0.5s, move model to device: 2.1s, calculate empty prompt: 0.1s).
started run_deforum
times_to_run: 1
Deforum extension for auto1111 webui
Git commit: ff0680bb
Starting job task(vvbsc33qytsrqt0)-0...
Saving animation frames to:
E:\DEFORUM\stable-diffusion-webui-directml\outputs/img2img-images\Deforum_20230810022355
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Animation frame: 0/120
Seed: 3690456440
Prompt: tiny cute bunny, vibrant diffraction, highly detailed, intricate, ultra hd, sharp photo, crepuscular rays, in focus, by tomasz alen kopera
Neg Prompt: nsfw, nude
Not using an init image (doing pure txt2img)
╭─────┬───┬───────┬────┬────┬────┬────┬────┬────╮
│Steps│CFG│Denoise│Tr X│Tr Y│Tr Z│Ro X│Ro Y│Ro Z│
├─────┼───┼───────┼────┼────┼────┼────┼────┼────┤
│ 25  │7.0│   0   │ 0  │ 0  │1.75│ 0  │ 0  │ 0  │
╰─────┴───┴───────┴────┴────┴────┴────┴────┴────╯
100%|██████████████████████████████████████████████████████████████████████████████████| 25/25 [00:40<00:00,  1.60s/it]
Animation frame: 2/120  █▊                                                            | 25/556 [00:37<13:06,  1.48s/it]
Creating in-between cadence frame: 0; tween:0.50;

*START OF TRACEBACK*
Traceback (most recent call last):
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\run_deforum.py", line 94, in run_deforum
    render_animation(args, anim_args, video_args, parseq_args, loop_args, controlnet_args, root)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\render.py", line 305, in render_animation
    depth = depth_model.predict(turbo_next_image, anim_args.midas_weight, root.half_precision)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\depth.py", line 88, in predict
    depth_tensor = self.midas_depth.predict(prev_img_cv2, half_precision)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\depth_midas.py", line 60, in predict
    midas_depth = self.midas_model.forward(sample)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\dpt_depth.py", line 166, in forward
    return super().forward(x).squeeze(dim=1)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\dpt_depth.py", line 114, in forward
    layers = self.forward_transformer(self.pretrained, x)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\vit.py", line 13, in forward_vit
    return forward_adapted_unflatten(pretrained, x, "forward_flex")
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\utils.py", line 86, in forward_adapted_unflatten
    exec(f"glob = pretrained.model.{function_name}(x)")
  File "<string>", line 1, in <module>
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions\sd-webui-deforum\scripts\deforum_helpers\src\midas\backbones\vit.py", line 47, in forward_flex
    x = self.patch_embed.proj(x).flatten(2).transpose(1, 2)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\module.py", line 1501, in _call_impl
    return forward_call(*args, **kwargs)
  File "E:\DEFORUM\stable-diffusion-webui-directml\extensions-builtin\Lora\networks.py", line 376, in network_Conv2d_forward
    return torch.nn.Conv2d_forward_before_network(self, input)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\conv.py", line 463, in forward
    return self._conv_forward(input, self.weight, self.bias)
  File "E:\DEFORUM\stable-diffusion-webui-directml\venv\lib\site-packages\torch\nn\modules\conv.py", line 459, in _conv_forward
    return F.conv2d(input, weight, bias, self.stride,
  File "E:\DEFORUM\stable-diffusion-webui-directml\modules\dml\amp\autocast_mode.py", line 39, in <lambda>
    setattr(resolved_obj, func_path[-1], lambda *args, **kwargs: forward(op, args, kwargs))
  File "E:\DEFORUM\stable-diffusion-webui-directml\modules\dml\amp\autocast_mode.py", line 13, in forward
    return op(*args, **kwargs)
RuntimeError: Input type (float) and bias type (struct c10::Half) should be the same
*END OF TRACEBACK*

User friendly error message:
Error: Input type (float) and bias type (struct c10::Half) should be the same. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of \.
Deforum progress:   4%|██▊                                                            | 25/556 [00:39<13:53,  1.57s/it]

Additional information

No response

cyberbadger6969 avatar Aug 09 '23 23:08 cyberbadger6969

did you fix it?

IsmaelBMAT avatar Aug 10 '23 17:08 IsmaelBMAT

no

cyberbadger6969 avatar Aug 10 '23 18:08 cyberbadger6969

Win11 RADEON 6800 XT Python3.10.6

cyberbadger6969 avatar Aug 10 '23 18:08 cyberbadger6969

Screenshot_20231025_220256_Chrome How to fix this? SD using CPU instead of GPU?

Inflamery avatar Oct 25 '23 19:10 Inflamery