ImageBind issues

whats the easiest way to test this code app

1

I cloned this app into pycharm and copied the initial file when i ran "python file.py" it began downloading 5 gigs of data. Did I do something wrong or is...

pythonyalfa

How to use ImageBind to generate image or audio?

10

I can run the example code. But how to run the model to generate the some images and audio? ![image](https://github.com/facebookresearch/ImageBind/assets/40257516/881881cf-de6a-48e4-ace5-60ca1d3f56bd)

NateDong72

Could not find a version that satisfies the requirement decord==0.6.0

4

lahfir

How could I train ImageBind completely from scratch?

4

Thank you for the very cool work! I'm having trouble finding your implementation of NCE loss, however. I know @fabawi has implemented a version of this for his LoRA fine-tuning...

ChloeL19

Finetuning ImageBind with LoRA

7

I created a simple ImageBind finetuning example using LoRA: https://github.com/fabawi/ImageBind-LoRA Make sure you clone it recursively to include the example dataset: git clone --recurse-submodules -j8 [email protected]:fabawi/ImageBind-LoRA.git Install the requirements following...

fabawi

ImageBind with SAM Simple Demo: Segment with Different Modalities

4

Thanks a lot for release such an amazing work! We implement a simple and interesting demo by combing ImageBind with SAM here: [ImageBind-SAM](https://github.com/IDEA-Research/Grounded-Segment-Anything/tree/main/playground/ImageBind_SAM) which can segment things with different modalities,...

rentainhe

Text/Audio/Image > Video/3D

3

Great Job! Will it support ```Text/Audio/Image > Video/3D``` conversion, approximately when?

becauseofAI

The issue about Audio to Image Generation

3

An amazing work!!! It's well known that https://github.com/lucidrains/DALLE2-pytorch and https://github.com/LAION-AI/dalle2-laion used open-clip as pretrianed text and image encoder. However, I have noticed that you used a private DALLE-2 to generate...

liu-zhy