Yu-won Lee
Yu-won Lee
If it occurs in the same data check the conversdation format. `\n` should be after the ``. Mostly it is caused by the data format.
What do you mean `tempral_patch_size`? I couldn't get it what you are asking.
Thanks for the issue! I'll take a look.
It looks like the optimizer config in deepspeed configs takes the priority when creating the optimizer.
Maybe the optimizer config in the deepspeed config part overrides the optimizer config part. I've erased the part from the deepspeed config file.
Yes it's fine. You could use the `finetune_lora.sh`. ``` --freeze_vision_tower True \ --freeze_llm True \ --tune_merger False \ ``` You could set like this. Then it would only finetune the...
Yes it should be set to true.
@koookieee 1. Yes it's fine. The warninig is showed up by `gradient_checkpoining`. 2. Can you show me the config.json in the output directory? I think the config is some what...
It looks like the config.json isn't in the directory right?
Yes that one, not the `adapater_config.json`