fairseq icon indicating copy to clipboard operation
fairseq copied to clipboard

Support videoclip with newer version of dependencies

Open SystemErrorWang opened this issue 1 year ago • 1 comments

🚀 Feature Request

I hope there could be a code base for videoclip with newer version of dependencies (such as python, pytorch, transformers, diffusers, etc)

Motivation

Recently I am working on a project trying to combine videoclip with diffusion model, but found the denpendencies for videoclip (MMPT) in this repository confilict with modern diffusion models, As the modern diffusion models require newer version of diffusers, transformers and other dependencies.

Pitch

Would you please provide support for videoclip models with newer version of dependencies such as diffusers, transformers, tokenizers, etc?

SystemErrorWang avatar Dec 19 '23 08:12 SystemErrorWang

Hi, I have adapted videoCLIP for a higher version of transformers for 4.37.2 from these two commits:

  • https://github.com/MarkChenYutian/fairseq_SpaceQADepend/commit/8f0926631554933cfa899acec4f1184f4b4ac581
  • https://github.com/MarkChenYutian/fairseq_SpaceQADepend/commit/7cfc3e28f2d5be18047c8142b6270afaffa1203c

MarkChenYutian avatar Feb 25 '24 21:02 MarkChenYutian