LLaVA It's so strange, accelerate==0.21.0, It said cannot import name 'LlavaLlamaForCausalLM' from 'llava.model' when I change accelerate==0.28.0. It worked

It's so strange, accelerate==0.21.0, It said cannot import name 'LlavaLlamaForCausalLM' from 'llava.model' when I change accelerate==0.28.0. It worked

Open 459737087 opened this issue 4 months ago • 4 comments

Describe the issue

Issue:

Command:

python -m llava.serve.controller --host 0.0.0.0 --port 10000

Log:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/runpy.py", line 187, in _run_module_as_main
    mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
  File "/usr/local/lib/python3.10/runpy.py", line 110, in _get_module_details
    __import__(pkg_name)
  File "/data/yanxin/LLaVA-main/llava/__init__.py", line 1, in <module>
    from .model import LlavaLlamaForCausalLM
ImportError: cannot import name 'LlavaLlamaForCausalLM' from 'llava.model'

when I use accelerate==0.28.0 run

python -m llava.serve.gradio_web_server --controller http://localhost:10000 --model-list-mode reload --port 8080

ERROR | stderr | /usr/local/lib/python3.10/site-packages/gradio/components/dropdown.py:163: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include: or set allow_custom_value=True.

and I can't curl the http