AnimateDiff icon indicating copy to clipboard operation
AnimateDiff copied to clipboard

horrible results when using sd 1.5

Open loboere opened this issue 1 year ago • 6 comments

I'm trying to run the base model without any dreambooth lora but the results are random or meaningless stuff

.yaml config

NewModel:
  path: ""
  base: ""

  motion_module:
    - "models/Motion_Module/mm_sd_v14.ckpt"
    - "models/Motion_Module/mm_sd_v15.ckpt"
    
  steps:          25
  guidance_scale: 7.5

  prompt:
    - "a girl"

  n_prompt:
    - ""

if something is wrong can you tell me how to configure it well for sd 1.5

loboere avatar Jul 16 '23 02:07 loboere

I have met the same problem. The result generated by sd1.5 is wired.

sciart17 avatar Jul 19 '23 03:07 sciart17

I'm trying to run the base model without any dreambooth lora but the results are random or meaningless stuff

.yaml config

NewModel:
  path: ""
  base: ""

  motion_module:
    - "models/Motion_Module/mm_sd_v14.ckpt"
    - "models/Motion_Module/mm_sd_v15.ckpt"
    
  steps:          25
  guidance_scale: 7.5

  prompt:
    - "a girl"

  n_prompt:
    - ""

if something is wrong can you tell me how to configure it well for sd 1.5

see the training procedure, motion_module are connected with the base model, must be used

vicentowang avatar Jul 25 '23 02:07 vicentowang

@vicentowang The weight forms of dreabooth and stable diffusion are exactly the same. So, if the code to load the custom t2I is not executed, unet will be initialized with stable diffusion v1.4(5). The code to load the motion module works completely independently and separately from this process.

rlawjdghek avatar Jul 29 '23 09:07 rlawjdghek

Can you post result here?

haofanwang avatar Aug 07 '23 11:08 haofanwang

The result of sd1.4 instead of DREAMBOOTH:

0-best-quality,-masterpiece,-1girl,-looking-at-viewer,-blurry-background,-upper

rlawjdghek avatar Aug 07 '23 13:08 rlawjdghek

I have met the same problem.

zengziru avatar Feb 15 '24 06:02 zengziru