fairseq
fairseq copied to clipboard
Support videoclip with newer version of dependencies
🚀 Feature Request
I hope there could be a code base for videoclip with newer version of dependencies (such as python, pytorch, transformers, diffusers, etc)
Motivation
Recently I am working on a project trying to combine videoclip with diffusion model, but found the denpendencies for videoclip (MMPT) in this repository confilict with modern diffusion models, As the modern diffusion models require newer version of diffusers, transformers and other dependencies.
Pitch
Would you please provide support for videoclip models with newer version of dependencies such as diffusers, transformers, tokenizers, etc?
Hi, I have adapted videoCLIP for a higher version of transformers for 4.37.2 from these two commits:
- https://github.com/MarkChenYutian/fairseq_SpaceQADepend/commit/8f0926631554933cfa899acec4f1184f4b4ac581
- https://github.com/MarkChenYutian/fairseq_SpaceQADepend/commit/7cfc3e28f2d5be18047c8142b6270afaffa1203c