OneLLM issues

Inference inputs multiple modalities other than text at once

Hello, I would like to ask, the current code seems to support only one modality and text modality at a time of inference, is it possible to input multiple modal...

xxrbudong

Clotho V2 annotation file

5

Hey authors, Can y'all share the annotation json for clothov2 evaluation.

manushree635

freezing of LLM during pretrain stage

2

Hi, Thanks for the awesome contribution to the community! There's something that has been bugging me for hours. It is mentioned in the paper that the LLM is frozen during...

eugenelet

Training code

4

Hello! Your work is excellent and I am also very interested, I wonder when you can open source the training code or give some examples, thanks!

Yanllan

fmri data

1

Hi, Any idea or reference of the input fmri format or how to process the data?

fredfyyang

About evaluation and training codes

3

well done! I wonder when will the training and inference related code be provided?

yan9qu

Fmri data is gray image or some numerical data

1

Yang-bug-star

Provide some inference examples

1

Could you provide some simple examples for inference? Like this one [SPHINX-inference](https://github.com/Alpha-VLLM/LLaMA2-Accessory/tree/main/SPHINX#inference) 🤥

Hambaobao