InvokeAI icon indicating copy to clipboard operation
InvokeAI copied to clipboard

Use Diffusers 0.30.0 / Enable offline single file model loading

Open lstein opened this issue 1 year ago • 2 comments

Summary

This PR bumps diffusers to v0.30.0 and reenables the ability to load main checkpoint models without a connection to the internet.

Related Issues / Discussions

Closes #6623.

QA Instructions

  1. Test generation with sd-1, sd-2 and sdxl models.
  2. Test controlnet guidance
  3. Test ti-adapter guidance
  4. Test ip-adapter guidance
  5. Test model loading when internet not connected.

Merge Plan

Given that this introduces the two regressions noted above, we should discuss whether to merge now or wait until the issue is fixed in diffusers.

Checklist

  • [X] The PR has a short but descriptive title, suitable for a changelog
  • [X] Tests added / updated (if applicable)
  • [X] Documentation added / updated (if applicable)

lstein avatar Aug 14 '24 02:08 lstein

Link to the diffusers issue for reference: https://github.com/huggingface/diffusers/issues/9171

RyanJDick avatar Aug 14 '24 13:08 RyanJDick

The issue with v_prediction vs epsilon has been worked-around. The issue with unconvertible sd 1.5 controlnets has been worked-around. Loading of SDXL controlnet single files still does not work.

lstein avatar Aug 17 '24 18:08 lstein

Are you still following this PR @lstein ? I can take it over and get it across the line if you'd like

brandonrising avatar Oct 18 '24 17:10 brandonrising

Are you still following this PR @lstein ? I can take it over and get it across the line if you'd like

I’m very happy to see renewed activity on this PR. I thought it was comatose. I’ll take it across the finish line.

lstein avatar Oct 22 '24 01:10 lstein

Are you still following this PR @lstein ? I can take it over and get it across the line if you'd like @brandonrising I've removed the absolute path name from the controlnet json file and have corrected a merge conflict. Should be ready for a re-review.

lstein avatar Oct 26 '24 14:10 lstein