Investigate Potential Use of Pretrained Models in Generalist /Massively Multimodal Setting

[harshsikka]

Rather than training from scratch, we might use pretrained weights to serve as a basis for our model.

We want to understand models might serve as the basis for our multimodal model? • first place to start might be with other multimodal papers. • beyond this, the llm literature could also be useful.

Outcome: writeup/analysis on the above