LISA++ err

[fwbc]

when i use lisa++,error Please input your prompt: What can make the woman stand higher? Please output segmentation mask and explain why Please input the image path: imgs/stand_higher.jpg Traceback (most recent call last): File "/home/heruyi/work/LISA-main/chat.py", line 253, in main(sys.argv[1:]) File "/home/heruyi/work/LISA-main/chat.py", line 211, in main output_ids, pred_masks = model.evaluate( File "/home/heruyi/work/LISA-main/model/LISA.py", line 356, in evaluate outputs = self.generate( File "/home/heruyi/anaconda3/envs/lisa/lib/python3.10/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context return func(*args, **kwargs) File "/home/heruyi/anaconda3/envs/lisa/lib/python3.10/site-packages/transformers/generation/utils.py", line 1538, in generate return self.greedy_search( File "/home/heruyi/anaconda3/envs/lisa/lib/python3.10/site-packages/transformers/generation/utils.py", line 2362, in greedy_search outputs = self( File "/home/heruyi/anaconda3/envs/lisa/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1194, in _call_impl return forward_call(*input, **kwargs) File "/home/heruyi/anaconda3/envs/lisa/lib/python3.10/site-packages/accelerate/hooks.py", line 170, in new_forward output = module._old_forward(*args, **kwargs) File "/home/heruyi/work/LISA-main/model/LISA.py", line 166, in forward return super().forward(**kwargs) File "/home/heruyi/work/LISA-main/model/llava/model/language_model/llava_llama.py", line 88, in forward ) = self.prepare_inputs_labels_for_multimodal( File "/home/heruyi/work/LISA-main/model/llava/model/llava_arch.py", line 110, in prepare_inputs_labels_for_multimodal (attention_mask.shape[0], past_key_values[-1][-1].shape[-2] + 1), AttributeError: 'NoneType' object has no attribute 'shape'

[Mozhgan91]

Hi, you should use their lisa_plus branch which is based on LLaVA1.5 and use chat_instance.py to perform inference.