LLaVA-NeXT icon indicating copy to clipboard operation
LLaVA-NeXT copied to clipboard

About LLaMA-3-LLaVA-NeXT-8B: The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.

Open wangtong627 opened this issue 1 year ago • 1 comments

I am trying to use the llama3-llava-next-8b model, and I replaced --model-path with the local path of llama3-llava-next-8b that I downloaded. When I run python -m llava.serve.model_worker --host 0.0.0.0 --controller http://localhost:10000 --port 40000 --worker http://localhost:40000 --model-path '/to/my/path/llama3-llava-next-8b', I encountered the following error. Could you please help me resolve this issue?

The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's attention_mask to obtain reliable results. Setting pad_token_id to eos_token_id:128001 for open-end generation. image

wangtong627 avatar Aug 30 '24 08:08 wangtong627