diffusers icon indicating copy to clipboard operation
diffusers copied to clipboard

when using diffusers and transformer: module transformers has no attribute FeatureExtractionMixin

Open TheOneTrueGuy opened this issue 2 years ago • 3 comments

Describe the bug

I'm trying to use diffusers alongside another package, CLIP Interrogator. When I install the dependencies for CLIP Interrogator my diffuser code goes kerplooie! and throws this error: module transformers has no attribute FeatureExtractionMixin

Reproduction

a notebook with the code to replicate this behavior is here: https://colab.research.google.com/drive/1W3NS1_dMhlZNYLybjLMRr-l9G3TdxN9L?usp=sharing error_clip_diffusers_11_26_2022

Logs

No response

System Info

running on a google colab

TheOneTrueGuy avatar Nov 27 '22 04:11 TheOneTrueGuy

Thank you for the report! I believe it is the BLIP requirement of Clip Interrogator that pins transformers to an older version from last December and thus can you kindly try to upgrade transformers and try?

kashif avatar Nov 27 '22 08:11 kashif

I changed the transformer install to the most recent version and still get the same result.

TheOneTrueGuy avatar Nov 27 '22 18:11 TheOneTrueGuy

swapped the transformer install so it followed the BLIP install and that changed the error. Now it's doing this: errors2 I'll see if the maker of CLIP Interrogator responds this time...

TheOneTrueGuy avatar Nov 27 '22 19:11 TheOneTrueGuy

Hey @TheOneTrueGuy,

Sorry could you give me access to the colab or even better just copy-paste your code snippet here?

patrickvonplaten avatar Nov 30 '22 12:11 patrickvonplaten

No, sorry to you, Patrick. We got it fixed yesterday afternoon and I just didn't have time to report here. I restricted that version after I posted a version to my github account that works. Still a little dicey and I'd prefer a version that works with the later version of diffusers and CLIP but it works for now,. Please check it out, it makes some trippy animations: https://github.com/TheOneTrueGuy/DigitalDayDream

TheOneTrueGuy avatar Nov 30 '22 16:11 TheOneTrueGuy

Cool!

patrickvonplaten avatar Dec 01 '22 17:12 patrickvonplaten

yes, I'm having a huge fun time. I've spun off another version that transforms videos instead of feedback-looping the init frame. Gotta say it's fire. It's in the same repo if you have 10 minutes to try it. Xfer_short60a_2fps

TheOneTrueGuy avatar Dec 03 '22 01:12 TheOneTrueGuy