sd-webui-deforum icon indicating copy to clipboard operation
sd-webui-deforum copied to clipboard

[Bug]: Error: Hybrid video - color coherence video input mode

Open batuhanbozyel opened this issue 1 year ago • 0 comments

Have you read the latest version of the FAQ?

  • [X] I have visited the FAQ page right now and my issue is not present there

Is there an existing issue for this?

  • [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

Are you using the latest version of the Deforum extension?

  • [X] I have Deforum updated to the lastest version and I still have the issue.

What happened?

The following error occurs when using hybrid video with hybrid motion (Optical flow in my case) and with color coherence video input mode selected:

Error: '[Errno 2] No such file or directory: '/home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/inputframes/3s+(1)000000006.jpg''. Check your schedules/ init values please. Also make sure you don't have a backwards slash in any of your PATHs - use / instead of . Full error message is in your terminal/ cli.

If the color coherence mode is switched back to LAB, the video is generated just fine. If I set "Extract to frame" to 5 to avoid the error, it still tries to find the 6th frame.

Steps to reproduce the problem

  1. From the Hybrid Video tab, set hybrid motion to Optical flow (other motion types produce the same error as well) and enable generate input frames
  2. From the Init tab, set the video init path and enable Overwrite extracted frames
  3. From the Keyframes tab, go to the Coherence tab and set Color coherence to Video Input

What should have happened/how would you fix it?

No response

Torch version

torch version: 2.0.0+cu117

On which platform are you launching the webui with the extension?

Local PC setup (Linux)

Deforum settings

https://gist.github.com/batuhanbozyel/4d756c6f92a3acd7bff01b53d5730784

Webui core settings

Defaults from a clean install.

Console logs

Python 3.10.7 (main, Mar 10 2023, 10:47:39) [GCC 12.2.0]
Commit hash: 6a5901a3fd5bab8d5d5933f56d1f0f991535793d
Installing requirements


Launching Web UI with arguments: --listen --port 7861 --opt-sdp-attention --no-hashing
No module 'xformers'. Proceeding without it.
Civitai Helper: Get Custom Model Folder
Civitai Helper: Load setting from: /home/stable-diffusion-webui/extensions/Stable-Diffusion-Webui-Civitai-Helper/setting.json
Civitai Helper: No setting file, use default
2023-07-04 13:04:46,051 - ControlNet - INFO - ControlNet v1.1.220
ControlNet preprocessor location: /home/stable-diffusion-webui/extensions/sd-webui-controlnet/annotator/downloads
2023-07-04 13:04:46,272 - ControlNet - INFO - ControlNet v1.1.220
reading lora /home/stable-diffusion-webui/models/Lora/SixtiesRamada.safetensors: AssertionError
Traceback (most recent call last):
  File "/home/stable-diffusion-webui/extensions-builtin/Lora/lora.py", line 84, in __init__
    self.metadata = sd_models.read_metadata_from_safetensors(filename)
  File "/home/stable-diffusion-webui/modules/sd_models.py", line 232, in read_metadata_from_safetensors
    assert metadata_len > 2 and json_start in (b'{"', b"{'"), f"{filename} is not a safetensors file"
AssertionError: /home/stable-diffusion-webui/models/Lora/SixtiesRamada.safetensors is not a safetensors file

Loading weights [None] from /home/stable-diffusion-webui/models/Stable-diffusion/cuterichstyle.ckpt
*Deforum ControlNet support: enabled*
Running on local URL:  http://0.0.0.0:7861

To create a public link, set `share=True` in `launch()`.
Startup time: 36.5s (import torch: 5.6s, import gradio: 3.9s, import ldm: 0.7s, other imports: 8.1s, list SD models: 0.2s, setup codeformer: 0.2s, load scripts: 2.4s, opts onchange: 0.8s, create ui: 14.0s,
 gradio launch: 0.5s).
Creating model from config: /home/stable-diffusion-webui/configs/v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Applying scaled dot product cross attention optimization.
Textual inversion embeddings loaded(8): BadDream, dld_hergra, EasyNegativeV2, harstyles94, ng_deepnegative_v1_75t, Style-Renaissance, Style-Renaissance-neg, verybadimagenegative_v1.3
Model loaded in 25.3s (load weights from disk: 18.2s, create model: 0.3s, apply weights to model: 0.5s, apply half(): 0.4s, move model to device: 5.7s, load textual inversion embeddings: 0.2s).
Loading weights [None] from cache
Creating model from config: /home/stable-diffusion-webui/configs/v1-inference.yaml
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
Applying scaled dot product cross attention optimization.
Model loaded in 7.5s (create model: 0.2s, apply weights to model: 0.6s, apply half(): 0.5s, move model to device: 6.2s).
Error completing request
Arguments: ('task(urcr5qailugw6z1)', None, False, None) {}
Traceback (most recent call last):
  File "/home/stable-diffusion-webui/modules/call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "/home/stable-diffusion-webui/modules/ui_common.py", line 46, in save_files
    data = json.loads(js_data)
  File "/usr/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Error completing request
Arguments: ('tunti_test.txt', False, None, '3D') {}
Traceback (most recent call last):
  File "/home/stable-diffusion-webui/modules/call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "/home/stable-diffusion-webui/modules/ui_common.py", line 46, in save_files
    data = json.loads(js_data)
  File "/usr/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

Error completing request
Arguments: ('tunti_test.txt', False, None, '3D') {}
Traceback (most recent call last):
  File "/home/stable-diffusion-webui/modules/call_queue.py", line 57, in f
    res = list(func(*args, **kwargs))
  File "/home/stable-diffusion-webui/modules/ui_common.py", line 46, in save_files
    data = json.loads(js_data)
  File "/usr/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.10/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

reading custom settings from tunti_test.txt
Deforum extension for auto1111 webui, v2.4b
Git commit: Unknown
Video to extract: https://avatar-input.s3.us-west-2.amazonaws.com/3s+(1).mp4
Extracting video (1 every 1) frames to /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/inputframes...
Trying to extract frames from video with input FPS of 29.959929611804863. Please wait patiently.
Extracted 91 frames from video in 9.01 seconds!
Using 6 input frames from /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/inputframes...
Using init_image from video: /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/inputframes/3s+(1)000000000.jpg
Unpacking ControlNet 1 base video
Exporting Video Frames to /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes...
Trying to extract frames from video with input FPS of 29.959929611804863. Please wait patiently.
Extracted 91 frames from video in 9.41 seconds!
Loading 6 input frames from /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes and saving video frames to /home/stable-diffusion-webui/outputs/img2img-image
s/Deforum_20230704130618
ControlNet 1 base video unpacked!
Saving animation frames to:
/home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618
Loading MiDaS model from dpt_large-midas-2f21e586.pt...
Loading RAFT model...
Animation frame: 0/6
Seed: 2983315821
Prompt: yoda, star wars, a jedi, a picture, unsplash, digital art, headshot photo, green face, pointy ears, two hands
Neg Prompt: nsfw, nude, more than two hands
‚≠‚‚‚‚‚‚¨‚‚‚‚¨‚‚‚‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚Æ
‚Steps‚CFG‚Denoise‚Tr X‚Tr Y‚Tr Z‚Ro X‚Ro Y‚Ro Z‚
‚‚‚‚‚‚‚º‚‚‚‚º‚‚‚‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚§
‚ 25  ‚7.0‚  0.5  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚
‚∞‚‚‚‚‚‚¥‚‚‚‚¥‚‚‚‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚Ø
Reading ControlNet 1 base frame #0 at /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes/000000000.jpg
2023-07-04 13:06:50,256 - ControlNet - INFO - Loading model: control_v11p_sd15_softedge [a8575a2a]
2023-07-04 13:06:55,087 - ControlNet - INFO - Loaded state_dict from [/home/stable-diffusion-webui/extensions/sd-webui-controlnet/models/control_v11p_sd15_softedge.pth]
2023-07-04 13:06:55,087 - ControlNet - INFO - Loading config: /home/stable-diffusion-webui/extensions/sd-webui-controlnet/models/control_v11p_sd15_softedge.yaml
2023-07-04 13:07:00,066 - ControlNet - INFO - ControlNet model control_v11p_sd15_softedge [a8575a2a] loaded.
2023-07-04 13:07:00,085 - ControlNet - INFO - Loading preprocessor: hed
2023-07-04 13:07:00,085 - ControlNet - INFO - Pixel Perfect Computation:
2023-07-04 13:07:00,085 - ControlNet - INFO - resize_mode = ResizeMode.INNER_FIT
2023-07-04 13:07:00,085 - ControlNet - INFO - raw_H = 1024
2023-07-04 13:07:00,085 - ControlNet - INFO - raw_W = 576
2023-07-04 13:07:00,085 - ControlNet - INFO - target_H = 1024
2023-07-04 13:07:00,085 - ControlNet - INFO - target_W = 576
2023-07-04 13:07:00,085 - ControlNet - INFO - estimation = 576.0
2023-07-04 13:07:00,085 - ControlNet - INFO - preprocessor resolution = 576
100%|‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚| 13/13 [00:07<00:00,  1.85it/s]
Animation frame: 1/6  |‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚                                                                                     | 13/30 [00:02<00:03,  5.36it/s]
Calculating RAFT optical flow  for frames 0 to 1
Seed: 2983315822
Prompt: yoda, star wars, a jedi, a picture, unsplash, digital art, headshot photo, green face, pointy ears, two hands
Neg Prompt: nsfw, nude, more than two hands
‚≠‚‚‚‚‚‚¨‚‚‚‚¨‚‚‚‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚Æ
‚Steps‚CFG‚Denoise‚Tr X‚Tr Y‚Tr Z‚Ro X‚Ro Y‚Ro Z‚
‚‚‚‚‚‚‚º‚‚‚‚º‚‚‚‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚§
‚ 25  ‚7.0‚  0.2  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚
‚∞‚‚‚‚‚‚¥‚‚‚‚¥‚‚‚‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚Ø
Reading ControlNet 1 base frame #1 at /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes/000000001.jpg
2023-07-04 13:07:20,202 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_softedge [a8575a2a]
2023-07-04 13:07:20,203 - ControlNet - INFO - Loading preprocessor: hed
2023-07-04 13:07:20,203 - ControlNet - INFO - Pixel Perfect Computation:
2023-07-04 13:07:20,203 - ControlNet - INFO - resize_mode = ResizeMode.INNER_FIT
2023-07-04 13:07:20,203 - ControlNet - INFO - raw_H = 1024
2023-07-04 13:07:20,203 - ControlNet - INFO - raw_W = 576
2023-07-04 13:07:20,203 - ControlNet - INFO - target_H = 1024
2023-07-04 13:07:20,203 - ControlNet - INFO - target_W = 576
2023-07-04 13:07:20,203 - ControlNet - INFO - estimation = 576.0
2023-07-04 13:07:20,203 - ControlNet - INFO - preprocessor resolution = 576
100%|‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚| 5/5 [00:00<00:00,  5.31it/s]
Animation frame: 2/6  |‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚                                                            | 18/30 [00:05<00:04,  2.88it/s]
Calculating RAFT optical flow  for frames 1 to 2
Seed: 2983315823
Prompt: yoda, star wars, a jedi, a picture, unsplash, digital art, headshot photo, green face, pointy ears, two hands
Neg Prompt: nsfw, nude, more than two hands
‚≠‚‚‚‚‚‚¨‚‚‚‚¨‚‚‚‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚Æ
‚Steps‚CFG‚Denoise‚Tr X‚Tr Y‚Tr Z‚Ro X‚Ro Y‚Ro Z‚
‚‚‚‚‚‚‚º‚‚‚‚º‚‚‚‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚§
‚ 25  ‚7.0‚  0.2  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚
‚∞‚‚‚‚‚‚¥‚‚‚‚¥‚‚‚‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚Ø
Reading ControlNet 1 base frame #2 at /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes/000000002.jpg
2023-07-04 13:07:23,100 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_softedge [a8575a2a]
2023-07-04 13:07:23,100 - ControlNet - INFO - Loading preprocessor: hed
2023-07-04 13:07:23,100 - ControlNet - INFO - Pixel Perfect Computation:
2023-07-04 13:07:23,100 - ControlNet - INFO - resize_mode = ResizeMode.INNER_FIT
2023-07-04 13:07:23,100 - ControlNet - INFO - raw_H = 1024
2023-07-04 13:07:23,100 - ControlNet - INFO - raw_W = 576
2023-07-04 13:07:23,100 - ControlNet - INFO - target_H = 1024
2023-07-04 13:07:23,100 - ControlNet - INFO - target_W = 576
2023-07-04 13:07:23,100 - ControlNet - INFO - estimation = 576.0
2023-07-04 13:07:23,100 - ControlNet - INFO - preprocessor resolution = 576
100%|‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚| 5/5 [00:00<00:00,  5.32it/s]
Animation frame: 3/6  |‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚                                   | 23/30 [00:08<00:02,  2.80it/s]
Calculating RAFT optical flow  for frames 2 to 3
Seed: 2983315824
Prompt: yoda, star wars, a jedi, a picture, unsplash, digital art, headshot photo, green face, pointy ears, two hands
Neg Prompt: nsfw, nude, more than two hands
‚≠‚‚‚‚‚‚¨‚‚‚‚¨‚‚‚‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚Æ
‚Steps‚CFG‚Denoise‚Tr X‚Tr Y‚Tr Z‚Ro X‚Ro Y‚Ro Z‚
‚‚‚‚‚‚‚º‚‚‚‚º‚‚‚‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚§
‚ 25  ‚7.0‚  0.2  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚
‚∞‚‚‚‚‚‚¥‚‚‚‚¥‚‚‚‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚Ø
Reading ControlNet 1 base frame #3 at /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes/000000003.jpg
2023-07-04 13:07:25,989 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_softedge [a8575a2a]
2023-07-04 13:07:25,989 - ControlNet - INFO - Loading preprocessor: hed
2023-07-04 13:07:25,989 - ControlNet - INFO - Pixel Perfect Computation:
2023-07-04 13:07:25,989 - ControlNet - INFO - resize_mode = ResizeMode.INNER_FIT
2023-07-04 13:07:25,989 - ControlNet - INFO - raw_H = 1024
2023-07-04 13:07:25,989 - ControlNet - INFO - raw_W = 576
2023-07-04 13:07:25,989 - ControlNet - INFO - target_H = 1024
2023-07-04 13:07:25,989 - ControlNet - INFO - target_W = 576
2023-07-04 13:07:25,989 - ControlNet - INFO - estimation = 576.0
2023-07-04 13:07:25,989 - ControlNet - INFO - preprocessor resolution = 576
100%|‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚| 5/5 [00:00<00:00,  5.31it/s]
Animation frame: 4/6  |‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚          | 28/30 [00:11<00:00,  2.80it/s]
Calculating RAFT optical flow  for frames 3 to 4
Seed: 2983315825
Prompt: yoda, star wars, a jedi, a picture, unsplash, digital art, headshot photo, green face, pointy ears, two hands
Neg Prompt: nsfw, nude, more than two hands
‚≠‚‚‚‚‚‚¨‚‚‚‚¨‚‚‚‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚¨‚‚‚‚‚Æ
‚Steps‚CFG‚Denoise‚Tr X‚Tr Y‚Tr Z‚Ro X‚Ro Y‚Ro Z‚
‚‚‚‚‚‚‚º‚‚‚‚º‚‚‚‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚º‚‚‚‚‚§
‚ 25  ‚7.0‚  0.2  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚ 0  ‚
‚∞‚‚‚‚‚‚¥‚‚‚‚¥‚‚‚‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚¥‚‚‚‚‚Ø
Reading ControlNet 1 base frame #4 at /home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/controlnet_1_inputframes/000000004.jpg
2023-07-04 13:07:28,813 - ControlNet - INFO - Loading model from cache: control_v11p_sd15_softedge [a8575a2a]
2023-07-04 13:07:28,813 - ControlNet - INFO - Loading preprocessor: hed
2023-07-04 13:07:28,813 - ControlNet - INFO - Pixel Perfect Computation:
2023-07-04 13:07:28,813 - ControlNet - INFO - resize_mode = ResizeMode.INNER_FIT
2023-07-04 13:07:28,813 - ControlNet - INFO - raw_H = 1024
2023-07-04 13:07:28,813 - ControlNet - INFO - raw_W = 576
2023-07-04 13:07:28,813 - ControlNet - INFO - target_H = 1024
2023-07-04 13:07:28,813 - ControlNet - INFO - target_W = 576
2023-07-04 13:07:28,813 - ControlNet - INFO - estimation = 576.0
2023-07-04 13:07:28,813 - ControlNet - INFO - preprocessor resolution = 576
100%|‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚‚| 5/5 [00:00<00:00,  5.31it/s]
Animation frame: 5/6   [00:14,  2.83it/s]

*START OF TRACEBACK*
Traceback (most recent call last):
  File "/home/stable-diffusion-webui/extensions/sd-webui-deforum/scripts/deforum.py", line 111, in run_deforum
    render_animation(args, anim_args, video_args, parseq_args, loop_args, controlnet_args, root.animation_prompts, root)
  File "/home/stable-diffusion-webui/extensions/sd-webui-deforum/scripts/deforum_helpers/render.py", line 375, in render_animation
    prev_vid_img = Image.open(os.path.join(args.outdir, 'inputframes', get_frame_name(anim_args.video_init_path) + f"{frame_idx+1:09}.jpg"))
  File "/usr/local/lib/python3.10/dist-packages/PIL/Image.py", line 3227, in open
    fp = builtins.open(filename, "rb")
FileNotFoundError: [Errno 2] No such file or directory: '/home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/inputframes/3s+(1)000000006.jpg'
*END OF TRACEBACK*

User friendly error message:
Error: [Errno 2] No such file or directory: '/home/stable-diffusion-webui/outputs/img2img-images/Deforum_20230704130618/inputframes/3s+(1)000000006.jpg'. Check your schedules/ init values please. Also make
 sure you don't have a backwards slash in any of your PATHs - use / instead of \.
Deforum progress: 33it [00:14,  2.27it/s]

Additional information

No response

batuhanbozyel avatar Jul 04 '23 13:07 batuhanbozyel