InvokeAI icon indicating copy to clipboard operation
InvokeAI copied to clipboard

[DO NOT MERGE YET] wip: CLIP Vision becomes its own thing

Open blessedcoolant opened this issue 1 year ago • 0 comments

Summary

CLIP Vision is currently a sub part of IP Adapter. There are other uses for CLIP Vision. Better to have it extracted now rather than later. This PR will try to accomplish that.

DONE

  • [x] CLIP Vision Model Loader Node - Used for loading the available CLIP Vision Models

opera_USzyVeLX4B

  • [x] IP Adapter Node updated to use a plugged in CLIP Vision rather than a drop down
  • [x] CLIP Vision Models now display in the Model Manager

opera_Zt3m9Nk5i9

  • [x] CLIP Vision Models added to Starter Models

opera_dOOyS36N3w

  • [x] Linear UI works now with the new CLIP Vision setup. (But the CLIP Vision Models need be manually set each model) --- We'll most likely make this a user config that they can set in the model editor.
  • [x] New Field For CLIP Vision
  • [x] [MAJOR] Implement CLIP Vision Safetensors support

TODO

  • Update models.invoke.com to actually use the right CLIP Vision names.

blessedcoolant avatar Apr 05 '24 20:04 blessedcoolant