Adriel Kuek
Adriel Kuek
@ZrrSkywalker thanks for the reply. Yea, I did a work-around by using the text to cache value affinity, and retrieve the corresponding images associated with the one-hot labels in the...
#93 indicates model naming error. Need to add "mgm" into the name for lookup.
Hi, thank you very much for the update! Will wait for the updates for the new files. Thanks.
> > > > > This is my experiments with prompt tunning. Not perfect but pretty amazing > > > > Seems like img1,img2,text is better performing. Hi, possible to...
> @wjjlisa, do you mean the multi-turn conversation in CLI, as in our Gradio demo? This is planned for release by the end of this month. Was busy working on...
> Yes, this is the code I updated: > > ```python > image = load_image(args.image_file) > image_tensor = image_processor.preprocess(image, return_tensors='pt')['pixel_values'][0] > ``` > > with > > ```python > image_tensor...
> Hi Vishaal, thanks for sharing the code. Indeed the fork has changed quite a fair bit. Seems like the mm-projector is removed, and the pretrained model as well. I...
Hi Yanwei, apologies for the late response. Thank you very much for providing the guidance on this. Appreciate it!
Hi. In reference to this question, I'm a little bit confused on the selection of the projector weights. As mentioned by the OP that should we want to fine-tune from...
> So there are two types of finetuning: > > > > 1. You start with a Vicuna (pure LLM), and you want to finetune it for multimodal capability (visual...