Yiyuan Zhang
Yiyuan Zhang
The causal pretraining process is exactly as you say, which is intuitive and simple.
If you have any further questions, please feel free to reach out.
> run inference_demo.py，print:['a man riding skis down a snow covered slope. a man is speaking with background noise and breathing sounds.'],which describe example/test.jpg. Is it right? > > load_from_pretrained: ./MiCo-g/ckpt/model_step_319989.pt...
> can I do other experiment ,such as cross-modal abilities, omni-cross abilities? Exactly, you can use it for any experiments you want, since it has been well-pretrained.
So, how can I know what tasks you require to use pretrained models? I do not know your problems at all.
These codes are tested under python 3.8 & python 3.9 with Linux OS, we suggest you would better not use Windows to reproduce our experiments.
Yes! We promise all these data and code will be publicly available. We are hard-working cleaning up code and preparing documents for pretraining, fine-tuning, and instruction tuning with LLMs, while...