dszpr

Results 10 comments of dszpr

Error finetuning InstructBLIP flant5

> > > > hello, have you solved the probelm? I have encountered the same problem and hope you can share some suggestions. > > > > > > >...

Prompt for BLIP2 OPT VQA

Hi！ @codezakh @YuanLiuuuuuu I noticed that in forward function in blip2_opt.py, only the questions in the VQA dateset are used. Both the text_input and the target lables are derived from...

Fine-tuning InstructBLIP?

mark！

[BLIP2]: Low accuracy of zeroshot VQA of BLIP2-opt-2.7b

Hi！ @LiJunnan1992 I noticed that in forward function in blip2_opt.py, only the questions in the VQA dateset are used. Both the text_input and the target lables are derived from the...

ERROR when eval internvl_chat_llava model

My model_path is the OUTPUT_DIR of the fituned internvit6b_224to336_vicuna7b model. Does the error have something to do with the fituned model? It really confused me. Everything went right when finetuning.

ERROR when eval internvl_chat_llava model

The problem has been solved after updating transformers. Thanks.

RuntimeError: Error(s) in loading state_dict for ResNet

Hi！ After uninstall timm and 'python setup.py develop' the vision_encoder, I just can't find timm module: ModuleNotFoundError: No module named 'timm' I also tried to use 'pip install -e .'...

When will the finetune code open sourced?

+4

/envs/Qwen/lib/python3.11/site-packages/flash_attn/flash_attn_interface.py", line 10, in <module> import flash_attn_2_cuda as flash_attn_cuda ImportError: /home/apus/mambaforge/envs/Qwen/lib/python3.11/site-packages/flash_attn_2_cuda.cpython-311-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi

It might be the torch version issue. I met this error before and fixed it by downgrade torch==2.0.1

/envs/Qwen/lib/python3.11/site-packages/flash_attn/flash_attn_interface.py", line 10, in <module> import flash_attn_2_cuda as flash_attn_cuda ImportError: /home/apus/mambaforge/envs/Qwen/lib/python3.11/site-packages/flash_attn_2_cuda.cpython-311-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi

In my env, torch 2.0.1 and flash-attn 2.3.1.post1 are complied.