LLaVA-Plus-Codebase icon indicating copy to clipboard operation
LLaVA-Plus-Codebase copied to clipboard

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

Results 21 LLaVA-Plus-Codebase issues
Sort by recently updated
recently updated
newest added

### Describe the issue Issue: I try to run your given example: Detect the person and frisbee in the image in detection examples. Sometime i meet error: SyntaxError: invalid syntax...

### Describe the issue Issue: When start model worker and tool worker (example grounding_dino), usually controller call api /worker_generate_stream to tool worker and return 404 in tool worker Log: ```...

### Describe the issue Issue: Dataloader in train code maybe wrong. Command: ``` deepspeed train.py \ --deepspeed scripts/zero2.json \ --model_name_or_path "LLaVA-VL/vicuna-7b-v1.3" \ --pretrain_mm_mlp_adapter "LLaVA-VL/liuhaotian/llava-v1.5-mlp2x-336px-pretrain-vicuna-7b-v1.5/mm_projector.bin" \ --version v1 \ --data_path data/toy/aug_toy.json,data/toy/merge_toy.json...

### Question I'd like the model to become better at some tasks I need it to do (in the next version, I guess). (the tasks are related to reading/understanding comic...

### Question Hi, does anyone encounters this issue when calling the tool worker like grounding dino? $ python serve/grounding_dino_worker.py Traceback (most recent call last): File "/media/mwang34/study/mengjun/llm/LLaVA-Plus/serve/grounding_dino_worker.py", line 31, in from...

### Question when I run `python -m llava.serve.gradio_web_server_llava_plus --controller http://localhost:20001 --model-list-mode reload` ![LYA7HI1}3%1@`MBH 5M{0PJ](https://github.com/LLaVA-VL/LLaVA-Plus-Codebase/assets/66856620/b718e6ef-a5d5-4893-b4af-e467d6aba872) and give instruction to it, then `requests.exceptions.MissingSchema: Invalid URL '/worker_generate': No scheme supplied` throwed

### Describe the issue Issue: Why this error? Command: ``` python -m llava.serve.gradio_web_server_llava_plus --controller http://localhost:20001 --model-list-mode reload ... ``` Log: ``` 2024-02-02 13:49:53 | ERROR | stderr | /root/miniconda3/envs/llava/lib/python3.10/site-packages/gradio/blocks.py:261: UserWarning:...

Error Message: ```bash import pycocotools.mask as mask_util ModuleNotFoundError: No module named 'pycocotools' ```

### Describe the issue When I ran the second step, I entered the downloaded `llava_plus_v0_7b` model path in advance, which brought the following error, can you tell me where the...

### Describe the issue Issue:Demo is down https://llavaplus.ngrok.io/ ![image](https://github.com/LLaVA-VL/LLaVA-Plus-Codebase/assets/101007608/4782378a-5b85-42ed-8b7c-6152fa2ebed3)